Sony Pixel Power calrec Sony

What's the delay? Pushing the limits of ultra-low latency HLS streaming

22/04/2021

Recent updates to the HTTP Live Streaming (HLS) standard have made new ways of standard-compliant low-latency streaming possible. But how low can the latency be, by how much do different low-latency flavours of HLS differ and what will the future of HLS bring in terms of delay? NativeWaves Andreas Unterweger and Bartosz Ziemski investigate

By Contributor

Published: April 22, 2021

Recent updates to the HTTP Live Streaming (HLS) standard have made new ways of standard-compliant low-latency streaming possible. But how low can the latency be, by how much do different low-latency flavours of HLS differ and what will the future of HLS bring in terms of delay? NativeWaves' Andreas Unterweger and Bartosz Ziemski investigate

target=_blank title=Share on LinkedIn class=share-linkedin>

Live streaming over the internet is an increasingly popular supplement to traditional broadcasting. With ever increasing demands regarding fast and scalable streaming, the widely adopted HTTP Live Streaming (HLS) standard has undergone recent (draft) revisions to enable lower end-to-end latencies. This version of the standard is commonly referred to as Apple Low-Latency HLS (LLHLS). It is different from previous efforts to supplement the old HLS standard with low-latency capabilities, commonly referred to as Community Low-Latency HLS (LHLS).

Simply put, Community LHLS advertises the most recent (edge) media segment to the receiver while it is still being produced, whereas Apple LLHLS advertises only those portions of it which are already available. Both approaches have their own upsides and downsides. Most prominently, Community LHLS breaks Adaptive Bit Rate (ABR) streaming due to chunked transfer and is already phased out in most implementations in favor of Apple LLHLS. The latter, however, makes caching through Content Delivery Network (CDNs) very hard due to very frequent and potentially client-dependent playlist updates.

While the choice of HLS flavour seems to boil down to the technical, logistical and practical pros and cons, it does not appear to be a question of delay - low latency is low latency after all, or is it not? Perhaps surprisingly, the practical delay bounds for each HLS flavour are not the same and their relative impact on end-to-end delay is larger than one might think. Let us investigate.

End-to-end delay comprises of many different factors, only some of which the sender (operating the live streaming source) can influence directly. Even the most creative engineers have very limited means against, for example, the transmission delay itself - the speed of light is quite a tough barrier to break in our Universe. However, accepting the physical limits of our Universe and thus our global network connections as they come, the remaining delay that can be influenced directly is worth analysing.

To explore the limits of HLS in terms of (influenceable) delay, engineers at NativeWaves set up a streaming server, a distribution (caching) server and a client (player) in a local network. The setup depicted in the image below is based on typical real-world setups for live events: The server captures a known Serial Digital Interface (SDI) input signal with a capture card, encodes it in hardware (on a Graphics Processing Unit (GPU)) and sends the encoded data via HLS directly to a distribution server which streams it to the client. Standard software (including FFmpeg with nvenc support) and typical settings (e.g., six seconds segment size) are used to make the results representative and as close as possible to practice.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/04/1-726x143.png alt= width=726 height=143 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/04/1-726x143.png 726w, https://www.tvbeurope.com/wp-content/uploads/2021/04/1-353x69.png 353w, https://www.tvbeurope.com/wp-content/uploads/2021/04/1-768x151.png 768w, https://www.tvbeurope.com/wp-content/uploads/2021/04/1-1536x302.png 1536w, https://www.tvbeurope.com/wp-content/uploads/2021/04/1-2048x403.png 2048w data-sizes=(max-width: 726px) 100vw, 726px />Setup used for testing consisting of a streaming server, a distribution server and a clientThe end-to-end delay is measured - from the time of capture at the streaming server to the earliest possible playback time at the client in the same local network. The measurements are analysed statistically, but instead of reporting the mean or median delay values, the 95th percentiles are presented. Reasoning about the worst-case delay that 95 per cent of users encounter portrays practical latency experiences much more accurately than focusing only on the better half of experiences.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/04/2.png alt= width=198 height=148 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/04/2.png 554w, https://www.tvbeurope.com/wp-content/uploads/2021/04/2-353x263.png 353w, https://www.tvbeurope.com/wp-content/uploads/2021/04/2-160x120.png 160w data-sizes=(max-width: 198px) 100vw, 198px />Comparison of delay between classical HLS, Apple LLHLS and Community LHLS with a segment size of 6 sSo, what do the results look like? The image on the right shows a comparison of the measured delay values for classical (non-low-latency) HLS (left), Apple LLHLS (middle) and Community LHLS (right). As expected, classical HLS produces orders of magnitude higher delay than the two low-latency flavours. The latter are nearly indistinguishable at this scale, but their differences will be broken down in more detail later. First, let us find out what causes the big difference between classical HLS and the two low-latency flavours.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/04/3.png alt= width=253 height=189 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/04/3.png 554w, https://www.tvbeurope.com/wp-content/upl
LINK: https://www.tvbeurope.com/media-delivery/whats-the-delay-pushing-the-l...
See more stories from tvb

Europe Stories

03/06/2024

Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives

Dalet, a leading technology and service provider for media-rich organizations, a...

28/04/2024

Mediahaus delivers the first SRT live-streaming sports production over 5G with URSA Broadcast G2

Mediahaus delivers the first SRT live-streaming sports production over 5G with U...

28/03/2024

No votes for all

Out of an estimated 20,000 journalists in Pakistan, less than one thousand are women according to a recent Gender Disparity Report published by the Internationa...

28/03/2024

The 4K cameras giving audiences an astronaut's view of Earth

TVBEurope meets Charles Black, founder and CEO of Sen, which has sent a payload of 4K cameras to the ISS to livestream images of Earth to audiences around the w...

28/03/2024

VEON Pays Back Outstanding Balance and Cancels its Revolving Credit Facility

28 Mar 2024 VEON Pays Back Outstanding Balance and Cancels its Revolving Credit Facility Amsterdam, 28 March 2024, 09.30 CET - VEON Ltd. (Nasdaq: VEON, Euronex...

28/03/2024

Rohde & Schwarz first to show measurements on novel Bluetooth Channel Sounding signals for positioning accuracy

Rohde & Schwarz first to show measurements on novel Bluetooth Channel Sounding ...

28/03/2024

Julia Rodgers Joins Riedel Communications as Southeast Regional Sales Manager, Bringing Decades of Industry Expertise

Wuppertal March 28, 2024 Julia Rodgers Joins Riedel Communications as Southeas...

28/03/2024

Thales speeds up its development of AI for defence

Facebook Twitter LinkedIn Thales, Europe's leading high-tech company in the civil and defence fields, has announced the creation of cortAIx, which bri...

27/03/2024

UKTV sets up second series of Dream Car Fixers for Yesterday and UKTV Play

Wednesday 27 March 2024 - UKTV has commissioned a second series of Dream Car Fixers (6x60) for leading factual channel Yesterday and free streaming service UKTV...

27/03/2024

Paving the Way' for Spotify's NextGen Scholarship Recipients

Spotify is committed to amplifying the voices of underrepresented groups, and that starts with empowering the creators who will shape our industry's future....

27/03/2024

I knew there were cameras, lighting, some buttons and microphones involved': How Crew Room Academy is inspiring the next generation

TVBEurope hears from some of the students who took part in Crew Room Academys Sc...

27/03/2024

Adobe reveals Gen AI solutions for content supply chain

Elsewhere, Adobe revealed a new feature in Adobe Firefly, which uses the companys generative AI to easily apply the structure of an existing image to newly gene...

27/03/2024

Best of Show Awards for 2024 NAB Show entries close soon

The awards, from industry-leading brands of Future plc, provide a great opportunity for companies to stand out at one the most attended shows in the industry B...

27/03/2024

Meet the director of IT and operations

By TVBEurope Staff Published: March 27, 2024 Updated: March 28, 2024 CueScript's director of IT and operations, Meghan Tyler, tells TVBEurope about h...

27/03/2024

2023 Annual Report Publication

Ad hoc announcement pursuant to Art. 53 LR Cheseaux-sur-Lausanne, Switzerland, and Phoenix (AZ), USA, March 27 2024 - The Kudelski Group has published its 2023...

27/03/2024

Publication of Annual Report 2023

Annual Report 2023...

27/03/2024

ALOFT AeroArchitects equips private Boeing Business Jet aircraft with Eutelsat OneWeb's LEO satellite connectivity service

Photo credit: ALOFT AeroArchitects Press release - 27 March 2024 12:27 ALOFT...

27/03/2024

Dalet Showcases AI-Enabled Production, Automation and Monetization at NAB 2024

Dalet, a leading technology and service provider for media-rich organizations, today announced its 2024 NAB showcase (booth #W1713). Attendees can experience fi...

27/03/2024

Cinegy Multiviewer 24.2 - Scales of Efficiency

SL6031, NAB Show, Las Vegas, 14-17 April 2024: Cinegy, the premier provider of software defined television technology for digital video capture, processing, ass...

27/03/2024

PERCEVAL: Thales and partners reshape the future of airline pilot training

Facebook Twitter LinkedIn Thales has formed a consortium with ENAC, lENS Paris-Saclay, Simaero, AviaSim and Corsair to develop a tooled methodology for ev...

27/03/2024

Advocacy in Action: Creating a future where public service media thrive

Advocacy in Action: Creating a future where public service media thrive...

27/03/2024

EBU calls on MEP candidates to Do the next right thing for media and democracy!'

EBU calls on MEP candidates to Do the next right thing for media and democracy!...

27/03/2024

The media industry gave away the keys to the kingdom once - that shouldn't happen again

The media industry gave away the keys to the kingdom once - that shouldn't h...

26/03/2024

Sube la temperatura con las canciones del verano 2024 en Argentina y Brasil

De diciembre a marzo, cuando los ciudadanos del hemisferio sur disfrutan del verano, la m sica se convierte en una poderosa representaci n de las culturas y cos...

26/03/2024

Aumente o Som com as Msicas do Vero de 2024 da Argentina e do Brasil

De dezembro a mar o, medida que as pessoas em todo o Hemisf rio Sul aproveitam o ver o, a m sica surge frequentemente como uma representa o poderosa das cult...

26/03/2024

Turn Up the Heat With Argentina's and Brazil's 2024 Songs of Summer

From December to March, as people across the Southern Hemisphere soak up the summer, music often emerges as a powerful representation of a region's cultures...

26/03/2024

A Collaboration With Panavision: Pedro Luque, SCU

Cinematographer Pedro Luque, SCU's credits include the features Body Cam, Antebellum and director J.A. Bayona's Best International Feature Oscar-nominat...

26/03/2024

China's Leading Mobile Operators First To Commercially Launch New Fraud Reducing Password Service, After Receiving GSMA Open Gateway Certification

GSMA welcomes CITIC Telecom, Huawei and ZTE as Channel Partners 26 March 2024, Beijing: China's three leading mobile operators - China Mobile, China Telec...

26/03/2024

China's 5G market is set to add almost $260 billion to the Chinese economy in 2030 with connections set to top 1 billion this year

At the Post-MWC Sharing Event in Beijing, leaders from the GSMA contextualised t...

26/03/2024

Crown Works Studios moves forward following council approval

The studios are expected to be one of the largest in Europe, with 20 premium sound stages suitable for major feature film and high-end TV (HETV) productions By...

26/03/2024

The Slovak democracy must not be dismantled in silence

The Slovak democracy must not be dismantled in silence...

26/03/2024

VEON announces sale of stake in Beeline Kyrgyzstan, increasing the focus on its large markets

26 Mar 2024 VEON announces sale of stake in Beeline Kyrgyzstan, increasing the ...

26/03/2024

embedded world 2024: Rohde & Schwarz presents its cutting-edge test solutions for embedded systems

embedded world 2024: Rohde & Schwarz presents its cutting-edge test solutions fo...

26/03/2024

Riedel and TSL Provide Cost-Effective, High-Quality Video Routing and Control for Leading Financial Corporation

Wuppertal March 26, 2024 Riedel and TSL Provide Cost-Effective, High-Quality V...

26/03/2024

IBM Announces EMEA Geography Winners of the 2024 IBM Partner Plus Awards

London, UK, March 26, 2024 Today, IBM (NYSE: IBM) announced the EMEA geography winners of the 2024 IBM Partner Plus Awards, which celebrate IBM partners who a...

26/03/2024

Eutelsat OneWeb services activated for enterprise and maritime in Australia and New Zealand through Sat One partnership

Photo credit: GETTY IMAGES Press release - 26 March 2024 11:29 Eutelsat OneW...

26/03/2024

2024-03-26

CUPERTINO, CALIFORNIA Apple today announced it will host its annual Worldwide Developers Conference (WWDC) online from June 10 through 14, 2024. Developers and ...

25/03/2024

Spotify Tests Video-Based Learning Courses in the UK

Today we're launching a test for video-based courses on Spotify in the U.K. We've partnered with educational tech companies including BBC Maestro, PLAYv...

25/03/2024

NEP Australia expands IP and remote production with Calrec Argo

NEP Australia expands its IP and remote production capabilities with first install of Calrec Argo consoles NEP Australia, a division of NEP Group and a prominen...

25/03/2024

NAB 2024 Preview | Why attend NAB 24?

NAB 2024 Preview | April 14 -17 | Booth C6307 | Las Vegas Convention Center We're looking forward to meeting up with customers and partners at the 2024 NAB ...

25/03/2024

Blackbird adds indexing and AI auto sequencing to video editing platform

Twelve Labs AI will enable editors to locate specific storytelling moments within their video content using natural language, said the companies By Jenny Pries...

25/03/2024

Meet the director of strategic marketing

By TVBEurope Staff Published: March 25, 2024 Updated: March 26, 2024 Bruno Fran on, director of strategic marketing at Backlight, talks to TVBEurope abou...

25/03/2024

With the EMFA, the EU has a new toolbox to prevent governments from taking over the media

With the EMFA, the EU has a new toolbox to prevent governments from taking over ...

22/03/2024

SGL Carbon achieves annual targets for 2023 and invests more in growth markets

In fiscal year 2023, SGL Carbon achieved the sales and earnings targets set at the beginning of the year despite the drop in demand from the important wind mark...

22/03/2024

Grass Valley secures $220 million in strategic refinancing

The company said it intends to accelerate innovation across its entire portfolio, most notably in the AMPP ecosystem following the refinancing By Jenny Priestl...

22/03/2024

RT kicks off Guinness Women's Six Nations coverage with France v Ireland

Watch all the games live across RT and Virgin Media Television from Saturday 23rd March All Ireland games live on RT Radio The Guinness Women's Six Nat...

22/03/2024

Telenor releases its Annual report for 2023

1 minute read Share alt=Alternative descriptive text class=lazyload main main-lazyloaded responsive-image data-v-1a5ebb10> Our digital lives are becomi...