Sony Pixel Power calrec Sony

What's the delay? Pushing the limits of ultra-low latency HLS streaming

22/04/2021

Recent updates to the HTTP Live Streaming (HLS) standard have made new ways of standard-compliant low-latency streaming possible. But how low can the latency be, by how much do different low-latency flavours of HLS differ and what will the future of HLS bring in terms of delay? NativeWaves Andreas Unterweger and Bartosz Ziemski investigate

By Contributor

Published: April 22, 2021

Recent updates to the HTTP Live Streaming (HLS) standard have made new ways of standard-compliant low-latency streaming possible. But how low can the latency be, by how much do different low-latency flavours of HLS differ and what will the future of HLS bring in terms of delay? NativeWaves' Andreas Unterweger and Bartosz Ziemski investigate

target=_blank title=Share on LinkedIn class=share-linkedin>

Live streaming over the internet is an increasingly popular supplement to traditional broadcasting. With ever increasing demands regarding fast and scalable streaming, the widely adopted HTTP Live Streaming (HLS) standard has undergone recent (draft) revisions to enable lower end-to-end latencies. This version of the standard is commonly referred to as Apple Low-Latency HLS (LLHLS). It is different from previous efforts to supplement the old HLS standard with low-latency capabilities, commonly referred to as Community Low-Latency HLS (LHLS).

Simply put, Community LHLS advertises the most recent (edge) media segment to the receiver while it is still being produced, whereas Apple LLHLS advertises only those portions of it which are already available. Both approaches have their own upsides and downsides. Most prominently, Community LHLS breaks Adaptive Bit Rate (ABR) streaming due to chunked transfer and is already phased out in most implementations in favor of Apple LLHLS. The latter, however, makes caching through Content Delivery Network (CDNs) very hard due to very frequent and potentially client-dependent playlist updates.

While the choice of HLS flavour seems to boil down to the technical, logistical and practical pros and cons, it does not appear to be a question of delay - low latency is low latency after all, or is it not? Perhaps surprisingly, the practical delay bounds for each HLS flavour are not the same and their relative impact on end-to-end delay is larger than one might think. Let us investigate.

End-to-end delay comprises of many different factors, only some of which the sender (operating the live streaming source) can influence directly. Even the most creative engineers have very limited means against, for example, the transmission delay itself - the speed of light is quite a tough barrier to break in our Universe. However, accepting the physical limits of our Universe and thus our global network connections as they come, the remaining delay that can be influenced directly is worth analysing.

To explore the limits of HLS in terms of (influenceable) delay, engineers at NativeWaves set up a streaming server, a distribution (caching) server and a client (player) in a local network. The setup depicted in the image below is based on typical real-world setups for live events: The server captures a known Serial Digital Interface (SDI) input signal with a capture card, encodes it in hardware (on a Graphics Processing Unit (GPU)) and sends the encoded data via HLS directly to a distribution server which streams it to the client. Standard software (including FFmpeg with nvenc support) and typical settings (e.g., six seconds segment size) are used to make the results representative and as close as possible to practice.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/04/1-726x143.png alt= width=726 height=143 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/04/1-726x143.png 726w, https://www.tvbeurope.com/wp-content/uploads/2021/04/1-353x69.png 353w, https://www.tvbeurope.com/wp-content/uploads/2021/04/1-768x151.png 768w, https://www.tvbeurope.com/wp-content/uploads/2021/04/1-1536x302.png 1536w, https://www.tvbeurope.com/wp-content/uploads/2021/04/1-2048x403.png 2048w data-sizes=(max-width: 726px) 100vw, 726px />Setup used for testing consisting of a streaming server, a distribution server and a clientThe end-to-end delay is measured - from the time of capture at the streaming server to the earliest possible playback time at the client in the same local network. The measurements are analysed statistically, but instead of reporting the mean or median delay values, the 95th percentiles are presented. Reasoning about the worst-case delay that 95 per cent of users encounter portrays practical latency experiences much more accurately than focusing only on the better half of experiences.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/04/2.png alt= width=198 height=148 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/04/2.png 554w, https://www.tvbeurope.com/wp-content/uploads/2021/04/2-353x263.png 353w, https://www.tvbeurope.com/wp-content/uploads/2021/04/2-160x120.png 160w data-sizes=(max-width: 198px) 100vw, 198px />Comparison of delay between classical HLS, Apple LLHLS and Community LHLS with a segment size of 6 sSo, what do the results look like? The image on the right shows a comparison of the measured delay values for classical (non-low-latency) HLS (left), Apple LLHLS (middle) and Community LHLS (right). As expected, classical HLS produces orders of magnitude higher delay than the two low-latency flavours. The latter are nearly indistinguishable at this scale, but their differences will be broken down in more detail later. First, let us find out what causes the big difference between classical HLS and the two low-latency flavours.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/04/3.png alt= width=253 height=189 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/04/3.png 554w, https://www.tvbeurope.com/wp-content/upl
LINK: https://www.tvbeurope.com/media-delivery/whats-the-delay-pushing-the-l...
See more stories from tvb

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

14/03/2026

HISONG announce the AirStudio S1

Combines mic, USB interface & wireless IEMs Following a successful Kickstarter campaign, HISONG have announced that their innovative AirStudio S1 device is ...

13/03/2026

A New Era of Personalization: Shape Your Taste Profile on Spotify

Spotify has always been built around your taste. More than 80% of listeners say personalization is what they love most about us. Now we're taking that even ...

13/03/2026

Spotify Debuts Legends Club for Popular German-Language Podcasts With Kaulitz Hills'

The new Spotify Legends Club has opened its doors. Its members: select German-sp...

13/03/2026

Klevgrand release OneShot2

Pushing drum sampler technology into new territories The latest version of Klevgrand's software drum sampler has just arrived, boasting a newly designe...

13/03/2026

IK Multimedia update ARC On-Ear

Expanded headphone support & engine improvements IK Multimedia's recently introduced ARC On-Ear system brings the power of their monitoring-correction s...

13/03/2026

UVI introduce Mosaiq 26

Extra sound collections, more presets & new Keys category UVI's rhythm and pattern instrument has just received a major update that introduces four new ...

13/03/2026

VEON Delivers Record Digital Growth: 4Q25 Digital Revenues Grow 84% to 20.1% of Total, Driving 17% Revenue and 29% EBITDA Growth in 4Q25

13 Mar 2026 VEON Delivers Record Digital Growth: 4Q25 Digital Revenues Grow 84%...

13/03/2026

Sky Adds Blood on Snow to Original Film Slate in Acquisition Headlined by Benedict Cumberbatch and Aaron TaylorJohnson

Friday 13 March 2026 Sky Adds Blood on Snow to Original Film Slate in Acquisiti...

13/03/2026

RT announces Rick O'Shea as new presenter on RT Radio 1's Arena

RT has announced today that Rick O'Shea is the new presenter of Arena RT Radio 1's flagship weeknight arts and culture programme. Rick has been pres...

13/03/2026

Lights! Camera! Action! The 98th Oscars set to air live as RT backs the Irish nominees

Lights! Camera! Action! The 98th Oscars set to air live as RT backs the Irish n...

12/03/2026

Milano Cortina 2026: Yospace helps ad-funded rights-holders claim advertising gold

Staines-upon-Thames, UK, 11th March, 2026 - Yospace, the trusted leader in Dyna...

12/03/2026

Mon Laferte Leads All-Women Spotify Session as EQUAL Celebrations Kick Off in Latin America

In Latin America, women are shaping music and defining its future. To kick off t...

12/03/2026

Mon Laferte lidera la edicin EQUAL de Spotify Sessions, mientras comienzan las celebraciones de EQUAL en Latinoamrica

En Am rica Latina, las mujeres est n moldeando la m sica y definiendo su futuro....

12/03/2026

As Spotify Turns 20, the Most Global and Diverse Music Industry in History Has Taken Shape

Let's turn back the clock 20 years: The music landscape was a world away fro...

12/03/2026

Bad Bunny Brings the Sounds of Puerto Rico to Tokyo for Spotify's Billions Club Live

Bad Bunny is no stranger to Spotify's Billions Club. In fact, he has a whopp...

12/03/2026

At the London Book Fair, Spotify Shares Our Vision for the Future of Reading

Spotify was at the London Book Fair this week, joining conversations across the publishing industry about how people can make reading part of their daily lives....

12/03/2026

Ohlhorst Digital & Tokyo Dawn Labs launch Ancora

Mastering tool improves mono compatibility Tokyo Dawn Labs' Ohlhorst Digital range is a series of mastering-focused plug-ins developed by Jan Ohlhorst, ...

12/03/2026

Lewitt partner with Elgato

Wave FX processor integrated into four products Lewitt have teamed up with Elgato to create a new processor for the company's Wave Next product range, i...

12/03/2026

Mix Notes iOS App by David Thomas

Free tool for annotating audio files Mix Notes is a new, free iOS App that provides users with a simple way to annotate their audio files. It's been cre...

12/03/2026

Duck 2 from Devious Machines

Side-chain ducking tool gets an upgrade Devious Machines' popular side-chaining and envelope-shaping tool has just been kitted out with an improved enve...

12/03/2026

MPG Awards 2026: Shortlist announced

Ceremony to take place on 16 April 2026 The MPG (Music Producers Guild) have revealed the full shortlist for this year's MPG Awards, which will be takin...

12/03/2026

Overloud introduce Gem Comp160

Emulates three classic dbx 160 variants The latest arrival to Overloud's Gem Series plug-in range faithfully recreates not one, but three versions of th...

12/03/2026

Grainferno from Baby Audio

New granular soft synth announced Said to be their most advanced software synthesizer to date, Baby Audio's latest release has been built on a new granu...

12/03/2026

Bitwig Studio 6 launches

Latest version now live! Edit 11 March 2026 - Bitwig Studio 6 is now live, and available for all to download! The latest version of Bitwig's DAW softwa...

12/03/2026

Stereo Miking: The Sound On Sound Guide

Latest free eBook now available! Designed for recording engineers, audio-technology students and technically minded musicians, our latest free eBook deliver...

12/03/2026

Rohde & Schwarz Cybersecurity expands SITLine network encryptor portfolio - more bandwidth, higher port density, future-proof architecture

Rohde & Schwarz Cybersecurity expands SITLine network encryptor portfolio - more...

12/03/2026

Rohde & Schwarz to showcase future-proof EMC testing solutions at EMV 2026

Rohde & Schwarz to showcase future-proof EMC testing solutions at EMV 2026 Rohde & Schwarz will participate in EMV 2026, Europe's premier trade fair and c...

12/03/2026

Blue Lucy's 6 Key Tenets

Modern media operations demand a platform that unites automation, orchestration, and human oversight without compromise. In this post, we explore the six key te...

12/03/2026

Blue Lucy Technology

A deep dive into the platform Architecture The Blue Lucy platform follows a distributed microservices architecture, meaning the overall operational capability...

12/03/2026

Blue Lucy Brings Order to the AI Wild West at NAB 2026

Orchestration platform enables broadcasters to deploy multiple AI models safely with full auditability, rights protection, and regulatory oversight. LONDON, En...

12/03/2026

Riedel Expands Managed Technology Division in the Americas, Taps Jan Schaffner to Lead Regional Growth

Wuppertal March 12, 2026 Riedel Expands Managed Technology Division in the Ame...

12/03/2026

Harmonic Redefines the Economics of Video Playout with New Spectrum X Plus Media Server

Advanced Media Server Delivers Double the Channel Density at Half the Cost per C...

12/03/2026

Jam-packed weekend of Irish entertainment, sport and music across RT for St Patrick's Day

The Late Late Show Show St Patrick's Day special Dancing with the Stars f...

11/03/2026

SES Brings Satellite Connectivity to Refugees in Chad

First Medium-Earth Orbit (MEO) deployment of the emergency.lu platform for refugees and their host communities' use provides dependable broadband for humani...

11/03/2026

Reign extended for CLASSIC CAR KINGS with two more series ordered for U and U&YESTERDAY

Following a successful first series, UKTV today announces the commission of two ...

11/03/2026

Sky and CANAL+ launch new partnership to develop English-language drama

Wednesday 11 March 2026 Sky and CANAL launch new partnership to develop English-language drama Sky and CANAL are today announcing a strategic co commissioni...

11/03/2026

NTCA, Cartesian Release New Report on the Business Case for USF

NTCA, Cartesian Release New Report on the Business Case for USF March 11, 2026 Network Economics News NTCA - March 11, 2026 - As the FCC and Congr...

11/03/2026

The 2026 RT Short Story Competition is now open for entries

TELL US YOUR (SHORT) STORIES The 2026 RT Short Story Competition is now open for entries Recognising and rewarding the best new Irish fiction writing for...

11/03/2026

Celtic Media Festival 2026 Nominees Announced

RT 's The Traitors Ireland is among the nominees for the 2026 Celtic Media Festival Torc Awards for Excellence, announced today....

10/03/2026

VEON's Largest Market Pakistan Almost Triples Mobile Spectrum in Reform Push; Jazz Secures Largest Allocation with 190 MHz

10 Mar 2026 VEON's Largest Market Pakistan Almost Triples Mobile Spectrum i...

09/03/2026

Duality Strings Bundle from VSL

Contains all six dual-ensemble libraries VSL's Duality Strings series offers an intriguing alternative to your average string library, capturing two str...

09/03/2026

The 1975 to receive MPG Award

Outstanding Contribution To UK Music Photo: Samuel Bradley Ahead of their upcoming MPG Awards, the Music Producers Guild (MPG) have revealed the latest win...

09/03/2026

Strymon reveal the PCH X1 & X2

Two new high-quality DI boxes announced Boasting some impressive technical specifications and versatile routing options, Strymon's latest active DI boxe...

09/03/2026

Sonora Cinematic introduce Pure Steel String

Latest MPE-capable Soundbox library released The follow-up release for Sonora Cinematic's Pure Nylon has arrived, and becomes the latest addition to the...