Samsung has finally signed up for the royalty-free video codec group, the Alliance for Open Media (AOMedia), in what is sure to throw the cat among the pigeons at this week’s big broadcast show, NAB 2019, where MPEG will be demonstrating many advances in its own codec technologies, targeting 5G applications among others, and pushing its own royalty-free option too.
Samsung could be interested in getting on board to influence developments around AV2, the successor to the AV1 codec currently in development as AOMedia’s alternative to the other major codec, HEVC. Samsung is also a member of HEVC Advance, the patent pool behind that would-be standard, but will want to keep its options open as both technologies fight to dominate mobile and 8K video platforms in future.
This means that AOMedia has now signed up two of the three largest smartphone makers in the world, Apple having joined at the start of 2018.
Samsung’s EVP of research, Seunghwan Cho, said: “Samsung is a recognized pioneer in next generation multimedia and video compression technology and an active contributor to the international video coding standards. We are committed to fostering innovation through openness. We’re excited to join AOMedia to help open up new possibilities to use AV1 open source, cross-platform, online video in ways that will optimize today’s ecosystem to meet the increasing demands of next generation users.”
Video codecs, and their relationship to 5G, will be hot topics at this NAB 2019, with MPEG set to make a wide range of announcements from holographic compression with V-PCC, to non-video genomic data sets with MPEG-G, through to licence-free codecs with MPEG-5.
Not surprisingly the latter is garnering most interest, and it marks the coming of age and industry acceptance for London-based V-Nova, whose Perseus technology has been embraced within the working draft of MPEG-5 as an extension to existing codecs, to improve processing and compression efficiency.
MPEG-5 comes in two parts, with part 1, otherwise known as Essential Video Coding (EVC), being an emerging and fully independent codec pitched as a royalty-free competitor not just to AOMedia’s AV1, but also MPEG’s own HEVC, as well as its forthcoming Versatile Video Coding (VVC).
MPEG-5 part 2 is completely independent of part 1 and designed as a codec-agnostic enhancement, which is where Perseus fits in. It is a wrapper capable of adapting to any other codec, whether or not from the MPEG stable. In all cases it improves compression, or video quality at a given bit rate, while reducing processing power consumed, although to varying degrees.
Part 2 itself has some interesting potential use cases since it can enhance legacy codecs, notably AVC/H.264 and Google’s VP9 as the ancestor to AV1, which are both widely installed. MPEG-5 Part 2 can boost efficiency of those by perhaps 50%, which will enable a number of traditional operators, as well as streaming providers, to delay upgrading to new codecs.
As V-Nova has argued, operators such as Twitch, the world’s leading streaming provider for gaming, will not be able to scale up toms of users with new codecs such as AV1, VVC or for that matter MPEG-5 part 1 for many years. With part 2, streaming providers can halve the encoding opex, noting that this one is not royalty free and indeed that V-Nova hopes to recoup a significant amount from its deployment.
It is worth summarizing the evolution of V-Nova’s Perseus to see how it got to this position. The original Perseus, launched on April 1st, 2015 and now called Perseus Pro, was pitched initially as an intra-only codec primarily for high end contribution. It was for this purpose V-Nova’s launch partner, Sky Italia, deployed Perseus Pro, although it was later adopted also for distribution, but again intra-only. V-Nova then developed a version that can also work in temporal mode under the new name Perseus Pro. This is a complete codec which effectively combines the intra functions of say JPEG and PNG with the temporal side of H.264, but with different underlying technology that in principle could be applied to any complex data set and not just video.
Perseus Plus then evolved from Pro with the initial design goal being to cater for live use cases where decoding requirements are much tighter and where compatibility with more complex workflows perhaps involving dynamic ad insertion or metadata management are required. This initially simplified the original Perseus by taking just two correction layers starting with intra-only and then adding temporal prediction.
Perseus Plus then is the foundation of MPEG-5 part 2, at least in the working version ahead of final standardization later in 2019. The working group is in fact being co-chaired by Dolby alongside V-Nova, so it is unlikely now that Perseus Plus will fail to make the final version, although enhancements are anticipated from other MPEG participants. The latter may include Comcast as a shareholder in V-Nova through its acquisition of Sky, while Amazon and Technicolor are definitely involved.
This leaves various possibilities, given that MPEG-5 Part 2 is independent of Part 1. What we think quite likely is that Part 1 itself will integrate a version of Part 2 that would give it a greater competitive edge. After all, Part 2 is an enhancement rather than a standalone codec.
It is also possible that VVC and AV1 will do something similar since it would accelerate processing and therefore make them cheaper and easier to adopt. These camps may even decide to incorporate what V-Nova would present as a fresh and relatively clean body of valuable IP (Intellectual Property) to build on, since it would dovetail well with their existing technology.
But meanwhile MPEG itself is embroiled over internal conflicts between MPEG-5 part 1 and VVC, which is its designated direct successor to HEVC. Otherwise known as MPEG-I Part 3, VVC is due for release in 2020 by the Joint Video Exploration Team (JVET), a combined MPEG and ITU consortium. It has sometimes also been referred to as Future Video Coding (FVC) or ITU H.266 and we may recall the German Fraunhofer Institute staging a demonstration at IBC 2018 showing 40% to 50% improvement in efficiency over HEVC.
But the institute noted that AV1 had already shown similar performance while being at least closer to royalty-free and already implemented. The institute expressed doubt that VVC would be able to keep pace with AV1 and – just to muddy the waters – at NAB Harmonic will be demonstrating its version of AV1 for full HD. This means MPEG might do well to favor MPEG-5 part amplified by Perseus.
This analysis by Phil Hunter was first published in Wireless Watch’s sister service, Faultline Online Reporter, which provides weekly insights into digital video markets and technologies. For subscription information, and to request a free trial, please contact Simon Thompson on [email protected]