The MPEG LA has issues its proposed terms for licensing the HEVC (H.265) codec and so far, there has not been the usual universal condemnation that accompanies this sort of pricing, although it is a bit stiff compared to the first cut of the previous H.264 royalty charges.
The biggest change is that really large companies, typically Apple, Google, Microsoft and some operators, will have to shell out $25 million annually, growing over time, compared to the $6.5 million they have to pay for H.264 today. This increased cost is perhaps why Google has been so aggressively pushing its own VP9, a codec that should perform similarly to H.265, as royalty free ‘ although it may find itself in legal hot water with this particular group of patent holders
Interestingly the H.2654 patent pool consists of almost no new compression ideas, just more extended use of them, in particular using variable pixels blocks instead of standardized blocks sizes. Most of the performance gain comes out of faster processing speeds that are available in hardware today, over when H.264 was announced.
The MPEG LA has said that essential patents come from just 25 companies, and these have now agreed on HEVC license terms that are expected to be issued as part of an HEVC Patent Portfolio License in early 2014. The next-generation codec license ‘will use a modern streamlined pool licensing approach, making the technology readily accessible to the largest possible market in the shortest possible time.’ Final agreements are yet to be concluded.
The list of licensees for HEVC includes Apple, BBC, Cisco, Electronics and Telecommunications Research Institute (ETRI) of Korea, Fraunhofer-Gesellschaft, Hitachi, HUMAX, JVC, KT, LG, M&K Holdings, NEC, Nippon Hoso Kyokai, Nippon Telegraph and Telephone Corporation, NTT DOCOMO, Orange, Siemens, SK Telecom, Ericsson, Thomson Licensing, and Vidyo. Four additional patent holders have declined to be identified, but others are invited to join the pool.
For HEVC products sold to end users there are no royalty charges up to 100,000 units a, and it then rises to $0.20 per unit after first 100,000 units a year, rising up to maximum annual royalty payable by an enterprise of $25 million for over 5 million shipments a year. This includes the rights to make, use and sell, and royalties are payable for HEVC products from May 1st 2013 onwards.
These terms are notably different to the H.264 agreement. The maximum annual royalty has nearly trebled, from $6.5 million, and there used to be a discounted rate above 5 million units a year, but now all units above 5 million are free. However $25 million is pocket change for companies of this size, although in the past that has not been a reason from them not to complain about MPEG LA pricing.
H.264 licensors included Apple, Cisco, Dolby, Electronics and Telecommunications Research Institute, Fraunhofer-Gesellschaft, Fujitsu, Hewlett-Packard, Hitachi, JVC, Koninklijke Philips, LG, Microsoft, Mitsubishi, NTT DOCOMO, Nippon Telegraph and Telephone Corporation, Orange, Panasonic, Polycom, Robert Bosch, Samsung, Sedna Patent Services, Sharp, Siemens, Sony, Ericsson, Trustees of Columbia University, Toshiba, Vidyo, and ZTE.
BBC, Dolby, and HUMAX are notable new members, but the likes of Microsoft, Sony, and Samsung are absent from the HEVC patent pool, although they may be among the four unnamed contributors. The MPEG LA has yet to publish the complete list of patents included in the pool, or prospective distribution of royalties between members. The initial proposal is likely to be rejected by its members, who will try to push their luck the first time around. With the potential maximum royalty payment having trebled since the last iteration of the patent pool, there is a lot of money at stake for the companies involved in these lengthy negotiations.
Other important differences between H.264 and HEVC include the new decision not to include separate royalties for HEVC content and the ability for hardware vendors to pay the royalties on behalf of their customer, who would otherwise be a licensee. There will not be any content related royalties for HEVC, as there is for H.264 ‘ on pay-per-view and subscription bases. One of the reasons given by MPEG LA VP Bill Greary was that it was quite simple to track owed royalties with H.264, but with today’s plethora of viewing mediums it would not be the case for HEVC.
Google is still actively pushing its rival VP9 codec. VP9 is also designed to support 4K UHD resolutions, but is claimed to be open-source and royalty free. (there is an open source version of it, but Google adds some proprietary extensions to the version it delivers). It claims to be easy to adopt, and to save about 50% of bandwidth compared to H.264. HEVC can scan 64×64 superblocks, and perform up to 35 infra-prediction directions to recompile the image, compared to the 16 x16 blocks and 9 intra-prediction directions of H.264. VP9 is able to scan blocks that aren’t square, like 64 x 32 or 4 x 8, but can only perform 10 predictions to rebuild the image from the data provided.
While VP9’s performance looks to be on par with HEVC, Google hopes that its royalty free codec will fuel adoption of the standard. It sees the MPEG LA payments as ‘an unacceptable financial burden for startups, programmers, schools, and others who might want to launch a video project on the Internet,’ which of course is rubbish if the first 100,000 are free.
MPEG LA took Google’s initial announcement of VP9 as a good time to point out that VP8 infringed on 12 MPEG LA members’ patents. Google was then forced to negotiate a deal with 11 of the 12 organizations to resolve the issue, but Nokia still refused to settle over patents it claims are essential to VP8. As that legal action rumbles on, many will be worried that much of the reused material in VP9 from VP8 could be subject to further legal scrutiny. Another complication that faces Google is the lack of hardware support for VP8 compared to H.264. Dedicated decoders for H.264 in mobile devices save battery consumption, and are much more prevalent than VP8 decoders ‘ something that Google will want to counter if it wants VP9 to take off.
Google’s argument about the cost of licensing H.264 or HEVC is diminished when the figures and rates are examined more closely. Companies that pay large amounts of royalties inherently produce large amounts of devices or applications. Microsoft is reported to pay into H.264 about twice the amount it receives from the use of its own patents in the codec. When a company like Microsoft pays licenses for millions of devices, the security it gains from an agreement like the H.264 patent pool will justify the cost of the license itself.
To be sued for patent infringement to the tune of 5 million or more devices would be a far greater cost than the pennies per device the company would pay to license the codec in the first place. With the new HEVC agreement, hardware vendors are able to pay the royalties that their end customers might incur, and doing so may allow them to lower their prices thanks to the scaling of the license agreement. Instead of a buyer paying the license on 400,000 cameras, the semiconductor vendor could preemptively pay the royalty on 10,000,000 chips ‘ it would be a cheaper royalty cost per device for the manufacturer. This is a huge simplification over the H.264 license costs which included broadcasters and other content companies.
MPEG LA spokesman Tom O’Reilly said that ‘we hope that those who have not yet agreed to support the license terms will do so at the next stage when final agreements are made. In our history, many pool licenses have started with a critical mass of patent holders and grown substantially to include many more following launch.’
While Google’s royalty-free codec has garnered support from LG, Panasonic, Sony, Samsung, Toshiba, Philips, Sharp, ARM, Intel, Nvidia, Qualcomm, Realtek and Mozilla, all these companies have also pledged to support HEVC. MPEG LA’s legacy in the hardware industry is likely to give it an edge over VP9.
Google may not charge a royalty, but that does not mean that VP9 does not infringe on essential patents in HEVC. There is always the potential for drawn-out lawsuits from any of the 25 parties involved in HEVC, in the same manner as the Nokia claim against VP8.