Sony Pixel Power calrec Sony

What's the delay? Pushing the limits of ultra-low latency HLS streaming

22/04/2021

Recent updates to the HTTP Live Streaming (HLS) standard have made new ways of standard-compliant low-latency streaming possible. But how low can the latency be, by how much do different low-latency flavours of HLS differ and what will the future of HLS bring in terms of delay? NativeWaves Andreas Unterweger and Bartosz Ziemski investigate

By Contributor

Published: April 22, 2021

Recent updates to the HTTP Live Streaming (HLS) standard have made new ways of standard-compliant low-latency streaming possible. But how low can the latency be, by how much do different low-latency flavours of HLS differ and what will the future of HLS bring in terms of delay? NativeWaves' Andreas Unterweger and Bartosz Ziemski investigate

target=_blank title=Share on LinkedIn class=share-linkedin>

Live streaming over the internet is an increasingly popular supplement to traditional broadcasting. With ever increasing demands regarding fast and scalable streaming, the widely adopted HTTP Live Streaming (HLS) standard has undergone recent (draft) revisions to enable lower end-to-end latencies. This version of the standard is commonly referred to as Apple Low-Latency HLS (LLHLS). It is different from previous efforts to supplement the old HLS standard with low-latency capabilities, commonly referred to as Community Low-Latency HLS (LHLS).

Simply put, Community LHLS advertises the most recent (edge) media segment to the receiver while it is still being produced, whereas Apple LLHLS advertises only those portions of it which are already available. Both approaches have their own upsides and downsides. Most prominently, Community LHLS breaks Adaptive Bit Rate (ABR) streaming due to chunked transfer and is already phased out in most implementations in favor of Apple LLHLS. The latter, however, makes caching through Content Delivery Network (CDNs) very hard due to very frequent and potentially client-dependent playlist updates.

While the choice of HLS flavour seems to boil down to the technical, logistical and practical pros and cons, it does not appear to be a question of delay - low latency is low latency after all, or is it not? Perhaps surprisingly, the practical delay bounds for each HLS flavour are not the same and their relative impact on end-to-end delay is larger than one might think. Let us investigate.

End-to-end delay comprises of many different factors, only some of which the sender (operating the live streaming source) can influence directly. Even the most creative engineers have very limited means against, for example, the transmission delay itself - the speed of light is quite a tough barrier to break in our Universe. However, accepting the physical limits of our Universe and thus our global network connections as they come, the remaining delay that can be influenced directly is worth analysing.

To explore the limits of HLS in terms of (influenceable) delay, engineers at NativeWaves set up a streaming server, a distribution (caching) server and a client (player) in a local network. The setup depicted in the image below is based on typical real-world setups for live events: The server captures a known Serial Digital Interface (SDI) input signal with a capture card, encodes it in hardware (on a Graphics Processing Unit (GPU)) and sends the encoded data via HLS directly to a distribution server which streams it to the client. Standard software (including FFmpeg with nvenc support) and typical settings (e.g., six seconds segment size) are used to make the results representative and as close as possible to practice.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/04/1-726x143.png alt= width=726 height=143 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/04/1-726x143.png 726w, https://www.tvbeurope.com/wp-content/uploads/2021/04/1-353x69.png 353w, https://www.tvbeurope.com/wp-content/uploads/2021/04/1-768x151.png 768w, https://www.tvbeurope.com/wp-content/uploads/2021/04/1-1536x302.png 1536w, https://www.tvbeurope.com/wp-content/uploads/2021/04/1-2048x403.png 2048w data-sizes=(max-width: 726px) 100vw, 726px />Setup used for testing consisting of a streaming server, a distribution server and a clientThe end-to-end delay is measured - from the time of capture at the streaming server to the earliest possible playback time at the client in the same local network. The measurements are analysed statistically, but instead of reporting the mean or median delay values, the 95th percentiles are presented. Reasoning about the worst-case delay that 95 per cent of users encounter portrays practical latency experiences much more accurately than focusing only on the better half of experiences.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/04/2.png alt= width=198 height=148 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/04/2.png 554w, https://www.tvbeurope.com/wp-content/uploads/2021/04/2-353x263.png 353w, https://www.tvbeurope.com/wp-content/uploads/2021/04/2-160x120.png 160w data-sizes=(max-width: 198px) 100vw, 198px />Comparison of delay between classical HLS, Apple LLHLS and Community LHLS with a segment size of 6 sSo, what do the results look like? The image on the right shows a comparison of the measured delay values for classical (non-low-latency) HLS (left), Apple LLHLS (middle) and Community LHLS (right). As expected, classical HLS produces orders of magnitude higher delay than the two low-latency flavours. The latter are nearly indistinguishable at this scale, but their differences will be broken down in more detail later. First, let us find out what causes the big difference between classical HLS and the two low-latency flavours.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/04/3.png alt= width=253 height=189 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/04/3.png 554w, https://www.tvbeurope.com/wp-content/upl
LINK: https://www.tvbeurope.com/media-delivery/whats-the-delay-pushing-the-l...
See more stories from tvb

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

21/11/2026

fedDSP introduce Kami

Compressor plug-in free for first two weeks The latest plug-in to join fedDSP's Amps & Pedals line-up has just arrived, and the company are kindly offer...

20/11/2026

Lemur Audio release Dorothe

New EQ plug-in aimed at mastering duties Lemur Audio's latest plug-in has just arrived, delivering a characterful EQ that's aimed primarily at maste...

20/11/2026

Soundtoys Black Friday Sale

Discounts of up to 75% now available Soundtoys' annual Black Friday sale is now live, with discounts of up to 75% applied across the company's range...

20/11/2026

SoundGhost release Fragment

New creative looping tool revealed Described as a cycling audio fragmenter , the latest addition to the SoundGhost range draws its inspiration from tape ph...

20/11/2026

Heritage Audio's Herchild 670 goes virtual

Fairchild recreation gets plug-in counterpart Heritage Audio's Herchild 670 offers a meticulous hardware recreations of the much-loved Fairchild 670 and...

19/11/2026

Expressive E release Maestro Brass

New performance-focused brass library announced Expressive E's latest release brings together four meticulously sampled brass instruments: sousaphone, b...

19/11/2026

Korg introduce phase8 companion

Acoustic synthesizer gains free web editor The phase8 acoustic synthesizer has been an ongoing project for Korg Berlin. It was unveiled as an early prototyp...

19/11/2026

Impact GX49 & GX61 Mk3 from Nektar

MIDI controller keyboards upgraded Designed for users who want a full-size keyboard and hands-on DAW control but in a relatively compact footprint, Nektar&#...

19/11/2026

IK Multimedia unveil the iLoud Micro Monitor 2

Hugely popular compact monitor overhauled IK Multimedia's ultra-compact monitors have proven to be incredibly popular, and the company say that they'...

19/11/2026

Rohde & Schwarz brings company-wide technology and service expertise to critical infrastructure

Rohde & Schwarz brings company-wide technology and service expertise to critical...

19/11/2026

Ready, set, go: must-follow broadband tips for blockbuster game downloads

Thursday 19 November 2026 Ready, set, go: must-follow broadband tips for blockbuster game downloads Ahead of GTA VIs launch, Sky Broadband saw record levels o...

19/11/2026

Dolby and Honda Bring Dolby Atmos to the New SUV AVANCIER

November 19 2026, 19:00 (PST) Dolby and Honda Bring Dolby Atmos to the New SUV AVANCIER Marking the First Integration of Dolby Atmos in a Vehicle from a Ja...

19/11/2026

Kerry Godliman takes star comedians on brand new U series, Kerry On Camping

Frank Skinner, Judi Love and Richard Ayoade join Kerry Godliman for three outdoor adventures across Dorset, Wales and Norfolk. Kerry Godliman is swapping comed...

19/11/2026

The Day of the Jackal: Eddie Redmayne returns in first-look teaser for series 2 of global hit Sky Original, coming March 2027

Thursday 19 November 2026 The Day of the Jackal: Eddie Redmayne returns in firs...

19/11/2026

Why the world needs the next generation at the standards table

When I first started my career in lighting engineering, it felt cutting edge and rewarding to be designing solutions that affect all of us every day, whether at...

19/11/2026

UK radio listeners to benefit from major DAB network expansion

UK radio listeners to benefit from major DAB network expansion Significant expansion in availability for 30 national digital radio stations -- Share to Link...

18/11/2026

William Kamau: Young Journalist of the Year finalist 2026

William Kamau is an investigative journalist from Kenya. He says witnessing the pain, displacement and killings' that followed the country's 2007 elect...

18/11/2026

Humberto Basilio: Young Journalist of the Year finalist 2026

Humberto Basilio is a freelance science, health and environmental journalist from Mexico. He says that working in one of the most dangerous countries in the wo...

18/11/2026

Aaron Atsahyel: Young Journalist of the Year finalist 2026

Aaron Atsahyel is a multimedia investigative journalist from Nigeria who draws on his own experiences as someone displaced by the Boko Haram insurgency to tell...

18/11/2026

Eventide launch SplitEQ 2

Dynamic bands, unmasking features & new stereo tools Launched in 2021, Eventide's SplitEQ plug-in introduced an interesting new approach to EQ, with the...

18/11/2026

IK Multimedia announce Tonex Parametric

Parametric Tone Models emulate control responses & interactions IK Multimedia have just announced the launch of Parametric Tone Models, a new technology tha...

18/11/2026

Shure launch the MV360 Spatial Audio Microphone

Captures immersive audio on phone, tablet or computer via USB-C Shure have just announced the launch of the MV360 Spatial Audio Microphone, a compact USB-C ...

18/11/2026

Live from London, its Saturday night! Saturday Night Live UK returns 16 January on Sky and NOW

Wednesday 18 November 2026 Live from London, it's Saturday night! Saturday ...

18/11/2026

Sky Kids Investigates: Being a Boy

BAFTA award-winning series sees 16-year-old reporter explore topics including toxic digital influencers and disrespectful attitudes to girls in a groundbreaking...

18/11/2026

Choosing a display for TMxCore

TMxCore has no built-in display. If you use TMxCore with a network display, you may not need a dedicated display at all. If you prefer a directly connected scre...

18/11/2026

TeleData Accelerates XGS-PON Service Rollout in Germany and Unifies its Network with Harmonic's cOS Broadband Platform

Key Takeaways TeleData is building a unified DOCSIS and fiber network with Ha...

18/11/2026

Successfully achieved BSI C5 attestation

Arvato Systems Expands BSI-C5 Testing Greater Confidence in Cloud Security and Regulatory Resilience Successful BSI-C5 Retest Certification in accordance wi...

18/11/2026

RT to premiere new three-part documentary series Able

Brendan O'Connor joins six disabled job seekers as they navigate the barriers of finding work and challenge perceptions of disability in the workplace Begi...

18/11/2026

When writing becomes a weapon : New true-crime podcast series to reveal the impact of anonymous poison-pen letter case

Poison Ink begins Friday 20 November 2026 on RT Listen and RT Radio 1 Listen ...

18/11/2026

RT Choice Music Prize 2027 Key Dates Announcement

RT Choice Music Prize In association with IMRO and IRMA 2027 KEY DATES Irish Album of the Year 2026 Shortlist 18th January Irish Artist of the Year 2026 ...

17/11/2026

Freqport introduce FreqLift plug-in

Multiband dynamics plug-in boasts FT1 integration Freqport's latest plug-in combines multiband upward and downward dynamics with the company's renow...

17/11/2026

Studio 5X: Debut monitors from Teufel Audio

Hi-fi experts launch two pro-audio models Berlin-based hi-fi experts Teufel Audio have recently branched out into the pro-audio world with their first pairs...

17/11/2026

EastWest Black Friday 2026

A year of ComposerCloud+ for $99 EastWest's annual Black Friday Sale is already live, and new users are being offered one year of the all-encompassing C...

17/11/2026

SOS Awards: Make Your Vote Count!

Pick your favourite gear from 2026 The annual SOS Awards are now underway, and as always, we're asking readers to help us choose the best pro-audio rele...

17/11/2026

Production capacity expanded at SGL Carbons Ried im Innkreis site

As part of an ongoing series production program for a German automaker, production capacity has been increased at SGL Carbon's Austrian site in Ried im Innk...

17/11/2026

Clear-Com Delivers Portable Wireless Systems for Secure Aircraft Communications Testing

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

17/11/2026

Sky announces major free upgrade to the Sky Glass and Sky Stream experience with the launch of the new Sky OS

Tuesday 17 November 2026 Sky announces major free upgrade to the Sky Glass and ...

17/11/2026

Passion, Betrayal and Scandal: Sky Arts Reveals the Man Behind the Music in Dangerous Debussy, Premiering 1 December

Tuesday 17 November 2026 Passion, Betrayal and Scandal: Sky Arts Reveals the Ma...

17/11/2026

Apple Podcasts names Baby, this is Keke\u00A0Palmer the 2026 Show of the Year - UPDATE - Posted on 17 November 2026

Today, Apple Podcasts named Baby, this is Keke Palmer its Show of the Year, hono...

16/11/2026

New plug-in suite from Berry Effects

Creative effects designed to encourage experimentation Berry Effects is the brainchild of Abe and Ralph, a pair of multi-instrumentalists and audio engineer...

16/11/2026

Anukari 1.1 now available

Physics-based synth gets first major update Anukari have just released a new version of their innovative physics-based software synth, marking the instrumen...

16/11/2026

Hit'n'Mix RipX DAW 9 arrives

Both versions kitted out with new tools & improvements Hit'n'Mix have just launched the latest major version of their innovative DAW software, with ...

16/11/2026

Eventide to launch SplitEQ 2

Dynamic bands, unmasking features & new stereo tools Launched in 2021, Eventide's SplitEQ plug-in introduced an interesting new approach to EQ, with the...

16/11/2026

Rohde & Schwarz Japan demonstrates multi-vendor ASA-ML communication with highperformance oscilloscope

Rohde & Schwarz Japan demonstrates multi-vendor ASA-ML communication with high p...

16/11/2026

CNAO and Hitachi launch advanced rotating proton therapy system in Italy

November 16, 2026 Hitachi system enables proton beams to be delivered from 360 degrees around the patient, expanding treatment capacity and supporting more pre...

16/11/2026

SES and ITU Expand Partner2Connect Digital-learning Initiative to 30 African Schools

Initiative in Malawi, Burundi, Zambia and Zimbabwe will leverage SES satellite s...

16/11/2026

U sees new original drama Fleet Street from the creators of Miss Scarlet

Images available HERE UKTV has announced Fleet Street (6x60'), a new period crime drama from Miss Scarlet creators Rachael New and Ben Edwards, coming to f...

16/11/2026

Sky and NOW bring some of the UKs biggest video podcasts to the big screen at no extra cost with Platform Media as first partner

From Graham Norton to Olivia Attwood and Joe Marler, a new collection of hit vid...

16/11/2026

Can Digital Product Passports help meet climate goals?

As countries gather to discuss climate targets at COP 31 this week, one question that is at the heart of debates is how to measure the environmental impact of t...