Joint technical meeting of Vehicular Technology Society, Broadcast Technology Society, Communications Society, and Signal Processing Society
In this talk we review several recent advances in OTT streaming, including content-aware encoding (CAE) and context-aware encoding (CtxAE).
The content-aware encoding exploits diversity of properties of content, assigning fewer bits to videos with lower encoding complexity (e.g. cartoons), and more bits to videos with complex content (e.g. sports, action, etc.). The context-aware encoding exploits diversity of properties of delivery devices (mobiles, tablets, PCs, connected TVs, etc) and access networks used to connect them to internet (3G, 4G, WiFi, Cable, etc). The objective of context aware encoding is to generate a multiset of encoded sequences, which can be optimally used for ABR streaming to devices and access networks of each kind. We will explain how these concepts can be formulated in mathematical terms, and identify classes of existing algorithms/solutions suitable for solving them.
Both CAE and CtxAE are now hot topics in OTT streaming delivery. CAE emerged earlier, around 2016, with Netflix first reporting major advancements based on this (they called it per-title encoding). CtxAE is a newer technology, first deployed by Brightcove in 2017.
Below paper is a recent Jan Ozer's review of these and several other related products on the market:
Further introductory information on the topic can be found in