Recent updates to the HTTP Live Streaming (HLS) standard have made new ways of standard-compliant low-latency streaming possible. But how low can the latency be, by how much do different low-latency flavours of HLS differ and what will the future of HLS bring in terms of delay? NativeWaves Andreas Unterweger and Bartosz Ziemski investigate
By Contributor
Published: April 22, 2021
Recent updates to the HTTP Live Streaming (HLS) standard have made new ways of standard-compliant low-latency streaming possible. But how low can the latency be, by how much do different low-latency flavours of HLS differ and what will the future of HLS bring in terms of delay? NativeWaves' Andreas Unterweger and Bartosz Ziemski investigate
target=_blank title=Share on LinkedIn class=share-linkedin> Recent updates to the HTTP Live Streaming (HLS) standard have made new ways of standard-compliant low-latency streaming possible. But how low can the latency be, by how much do different low-latency flavours of HLS differ and what will the future of HLS bring in terms of delay? NativeWaves' Andreas Unterweger and Bartosz Ziemski investigate
https://www.tvbeurope.com/media-delivery/whats-the-delay-pushing-the-limits-of-ultra-low-latency-hls-streaming title=Share via Email class=share-email>
Live streaming over the internet is an increasingly popular supplement to traditional broadcasting. With ever increasing demands regarding fast and scalable streaming, the widely adopted HTTP Live Streaming (HLS) standard has undergone recent (draft) revisions to enable lower end-to-end latencies. This version of the standard is commonly referred to as Apple Low-Latency HLS (LLHLS). It is different from previous efforts to supplement the old HLS standard with low-latency capabilities, commonly referred to as Community Low-Latency HLS (LHLS).
Simply put, Community LHLS advertises the most recent (edge) media segment to the receiver while it is still being produced, whereas Apple LLHLS advertises only those portions of it which are already available. Both approaches have their own upsides and downsides. Most prominently, Community LHLS breaks Adaptive Bit Rate (ABR) streaming due to chunked transfer and is already phased out in most implementations in favor of Apple LLHLS. The latter, however, makes caching through Content Delivery Network (CDNs) very hard due to very frequent and potentially client-dependent playlist updates.
While the choice of HLS flavour seems to boil down to the technical, logistical and practical pros and cons, it does not appear to be a question of delay - low latency is low latency after all, or is it not? Perhaps surprisingly, the practical delay bounds for each HLS flavour are not the same and their relative impact on end-to-end delay is larger than one might think. Let us investigate.
End-to-end delay comprises of many different factors, only some of which the sender (operating the live streaming source) can influence directly. Even the most creative engineers have very limited means against, for example, the transmission delay itself - the speed of light is quite a tough barrier to break in our Universe. However, accepting the physical limits of our Universe and thus our global network connections as they come, the remaining delay that can be influenced directly is worth analysing.
To explore the limits of HLS in terms of (influenceable) delay, engineers at NativeWaves set up a streaming server, a distribution (caching) server and a client (player) in a local network. The setup depicted in the image below is based on typical real-world setups for live events: The server captures a known Serial Digital Interface (SDI) input signal with a capture card, encodes it in hardware (on a Graphics Processing Unit (GPU)) and sends the encoded data via HLS directly to a distribution server which streams it to the client. Standard software (including FFmpeg with nvenc support) and typical settings (e.g., six seconds segment size) are used to make the results representative and as close as possible to practice.
Setup used for testing consisting of a streaming server, a distribution server and a client The end-to-end delay is measured - from the time of capture at the streaming server to the earliest possible playback time at the client in the same local network. The measurements are analysed statistically, but instead of reporting the mean or median delay values, the 95th percentiles are presented. Reasoning about the worst-case delay that 95 per cent of users encounter portrays practical latency experiences much more accurately than focusing only on the better half of experiences.
Comparison of delay between classical HLS, Apple LLHLS and Community LHLS with a segment size of 6 s So, what do the results look like? The image on the right shows a comparison of the measured delay values for classical (non-low-latency) HLS (left), Apple LLHLS (middle) and Community LHLS (right). As expected, classical HLS produces orders of magnitude higher delay than the two low-latency flavours. The latter are nearly indistinguishable at this scale, but their differences will be broken down in more detail later. First, let us find out what causes the big difference between classical HLS and the two low-latency flavours.
Breakdown of delay of LHS with a segment size of 6 s Breaking down the delay into its individual parts sheds some light onto the root cause of the high delay in classical HLS. As can be seen in the image to the left, all other parts become negligible when compared to segmenting (shown in green), i.e., the time required for splitting the content into segments.
Why is that? Since classical HLS requires producing a full segment before announcing it in the playlist, this means that, in the worst case, nearly one full segment worth of delay (6 seconds) is added on the production side when w
What's the delay? Pushing the limits of ultra-low latency HLS streaming
22/04/2021
| LINK: | https://www.tvbeurope.com/media-delivery/whats-the-delay-pushing-the-l... |
| See more stories from tvb |
Europe Stories
12/05/2021
Spotify's Regional Mexican Playlist Los Que Mandan Highlights Creators Who Break the Rules of the Genre
Genre-fluid playlists like Lorem, Pollen, and Our Generation have found a home o...
12/05/2021
Spotify Singles, 5 Billion Streams Later
Spotify Singles has been home to music you love from creators you adore-recorded in ways you've never heard-since 2016. To date, there have been more than 6...
12/05/2021
Accelerate the speed with Xperia 10 III - the attainable and compact 5G solution, available to pre-order now
12th May 2021, Available to pre-order now, the new Xperia 10 III is the first mo...
12/05/2021
SGL Carbon with solid development in the first quarter - Outlook for 2021 fully confirmed
SGL Carbons consolidated sales amounted to 241.5 million in the first quarter (...
12/05/2021
BPX Appointed as Schneider Electric Alliance Master Partner in Industrial Automation Distribution
Home News & Press Releases Spokespeople Assets Blog Contact us ...
12/05/2021
ProSiebenSat.1 Group increases full-year outlook for revenues and adjusted EBITDA following a good first quarter
ProSiebenSat.1 Group increases full-year outlook for revenues and adjusted EBITD...
12/05/2021
Nokia appoints David Mulholland as Head of Investor Relations
Nokia appoints David Mulholland as Head of Investor Relations Press Release Nokia appoints David Mulholland as Head of Investor Relations 12 May 2021 Espo...
12/05/2021
Nokia reaches 100 customers for its Quillion-based fixed broadband solutions
Nokia reaches 100 customers for its Quillion-based fixed broadband solutions Press Release Nokia reaches 100 customers for its Quillion-based fixed broadban...
12/05/2021
ITV launches Drama vs Reality brand campaign
BAFTA-winning actor Jason Watkins and Love Island winner Kem Cetinay go head-to-head in fight for our attention Unlikely pairing launch new ITV brand campaign ...
12/05/2021
The BRIT Awards 2021 with Mastercard - WINNERS LIST
The BRIT Awards 2021 with Mastercard - WINNERS LIST Broadcast exclusively on ITV and ITV Hub and streamed worldwide on YouTube UK leads the world on the retu...
12/05/2021
5 Gold Rings is coming to Mongolia
5 Gold Rings is coming to Mongolia Hit game show conquers 11th territory May 12, 2021 - ITV Studios' hit game show 5 Gold Rings has been commissioned by ...
12/05/2021
Hitachi Announces Changes of Top Managements
Tokyo, May 12, 2021 - Hitachi, Ltd. (TSE: 6501) today announced the change of Executive Chairman and President in accordance with a resolution passed by the mee...
12/05/2021
Over 40 EBU radio music channels to support cultural diversity on landmark UNESCO date
Over 40 EBU radio music channels to support cultural diversity on landmark UNESC...
12/05/2021
AvidPlay is the First DIY Music Distribution Service to Support Dolby Atmos Music
July 29, 2020 AvidPlay is the First DIY Music Distribution Service to Support ...
12/05/2021
Electronic Duo, Booka Shade Re-Release Ninth Studio Album Dear Future Self in Dolby Atmos
July 29, 2020 Electronic Duo, Booka Shade Re-Release Ninth Studio Album Dear F...
12/05/2021
John Williams And Wiener Philharmoniker Performance In Vienna Set For Immersive Dolby Atmos Music...
August 13, 2020 John Williams And Wiener Philharmoniker Performance In Vienna ...
12/05/2021
Megabox to deploy Dolby technologies to provide premium experiences to moviegoers in Korea
September 24, 2020 Megabox to deploy Dolby technologies to provide premium exp...
12/05/2021
Iconic Dean St. Studios Relaunches with State-of-the-Art Dolby Atmos Mixing Facilities
October 06, 2020 Iconic Dean St. Studios Relaunches with State-of-the-Art Dolb...
12/05/2021
NATAS to Honor Dolby with Technical and Engineering Emmy for Advancements in HDR
January 25, 2021 The National Academy of Television Arts & Sciences to Honor Dolby with Technical & Engineering Emmy for Advancements in HDR The National Ac...
12/05/2021
Dolby Named to Fast Company's Annual List of the World's Most Innovative Companies in Music for t...
March 09, 2021 Dolby Named to Fast Company's Annual List of the World'...
12/05/2021
Lucid Air is the World's First Vehicle to Integrate Dolby Atmos
March 17, 2021 Lucid Air is the World's First Vehicle to Integrate Dolby Atmos Dolby Atmos will be part of Lucid Air's new 21-speaker Surreal Sound...
12/05/2021
Box and Dolby Transform Media in the Cloud (duplicate)
May 03, 2021 Box and Dolby Transform Media in the Cloud New Integration Provides Box Users Worldwide Access to Automated Audio Enhancement Tools Powered by...
12/05/2021
Dolby Laboratories Announces Executive Retirement
May 04, 2021 Dolby Laboratories Announces Executive Retirement Executive Vice President and Chief Financial Officer, Lewis Chew to retire later this year ...
12/05/2021
dB Broadcast Delivers First of ITV Daytime's New Green Machines
May 2021 dB Broadcast has delivered the first of four satellite vehicles for use by ITV Daytime in locations around the country. They replace ITV Daytime's...
12/05/2021
Dolby Atmos live broadcast mixing: What you need to know
Dolby Atmos live broadcast mixing: What you need to know Mixing live broadcasts with Dolby Atmos allows you to put the viewers right in the action by precisely...
12/05/2021
2021-05-12
The first Apple Developer Academy opened in Brazil in 2013, with the goal of providing the tools and training for aspiring entrepreneurs, developers, and design...
12/05/2021
Senetas and Thales launch the world's first quantum resistant network encryption solution
Facebook Twitter LinkedIn Customers are able to protect sensitive data aga...
12/05/2021
Thales reports its order intake and sales for the first quarter of 2021
Facebook Twitter LinkedIn Thales (Euronext Paris: HO) announced today its order intake and sales for the first quarter of 2021. Q1 2021 sales and order ...
12/05/2021
First H145 Full Flight Simulator in North America inaugurated in Texas
Facebook Twitter LinkedIn Grand Prairie, Texas, May 10, 2021 - The Helisim Simulation Center, located inside the Airbus Helicopters Inc. facility in Grand...
12/05/2021
Quicklink joins the SRT Alliance to integrate SRT into their award-winning contribution solutions
Quicklink joins the SRT Alliance to integrate SRT into their award-winning contr...
12/05/2021
Presteigne Broadcast invests in 45 Panasonic 4K PTZ cameras
AW-UE100 integrated pan/tilt/zoom camera supports a variety of IP transmission protocols, including high-bandwidth NDI, high-efficiency NDI|HX and SRT By Jenny...
12/05/2021
Confidence is rising': Avid CEO discusses the outlook for the industry
Avid CEO Jeff Rosica talks to TVBEurope about the media tech industrys recovery from the pandemic, and sounds a note of caution about the return to physical tra...
12/05/2021
iLok v3 released
USB-C version connects directly to modern Macs Software copyright protection company PACE have just announced a new version of their ubiquitous iLok. The th...
12/05/2021
Lewitt LCT 140 Air now available in pairs
Affordable stereo recording kit Lewitt Audios affordable LCT 140 Air microphones are now available in matched pairs, for stereo recording. The kit includes ...
12/05/2021
DPA expand headset mic range
Cardioid and omni models released Danish electret microphone experts DPA have just released two new headset mics: the omnidirectional 4466 Core and the card...
12/05/2021
UA update Luna & UAD platform
Luna gains API console emulation Universal Audio have released a major update to Luna. Version 1.1.8 introduces a complete end to end console emulation to...
12/05/2021
TV2 Deploys Fully-Equipped SNG and IP Vans Featuring AVIWEST Technology for Live Coverage and Multicasting
TV2 Deploys Fully-Equipped SNG and IP Vans Featuring AVIWEST Technology for Live...
12/05/2021
When seeing becomes understanding: The centrality of metadata in the management of media assets
The ability to generate thoughts and build relationships within the stream of co...
11/05/2021
Magyar Telekom results for the first quarter of 2021
Magyar Telekom results for the first quarter of 2021 Budapest, May 11, 2021 17:30 Magyar Telekom today reported its consolidated financial results for the ...
11/05/2021
Spotify: For the Record' Explores the Art-and Science-of Lullabies
What is it about a lullaby that gently nudges a fussy newborn or rambunctious toddler into a slumber? On the latest episode of our podcast, Spotify: For the Rec...
11/05/2021
Kayo Chingonyi Decodes Black' from Dave's Brit Award-Winning Album PSYCHODRAMA'
For the past several years, Spotify Original podcast DISSECT has delved deep int...
11/05/2021
Sony Expands Functionality of Camera Remote SDK and Increases Range of Compatible Models
Alpha 1 and RX0 II added to list of compatible Sony's cameras Latest versio...
11/05/2021
Award-winning actress Noomi Rapace and renowned actor Nicholas Pinnock join the cast of Django
A CANAL+ cr ation originale and Sky original TV series starring Matthias Schoena...
11/05/2021
Riverdance: The Animated Adventure, a Sky Original is coming exclusively to Sky Cinema and NOW on 28 May 2021
If you were swept away by the phenomenon that is celebrated by millions globally...
11/05/2021
Joe Marler stars in Sky Sports documentary exploring the matter of Mental Health
Big Boys Don't Cry follows the England Rugby forward as he discusses his own struggles and learns new methods of managing mental wellbeing. Sky Sports has ...
11/05/2021
RT and Virgin Media in deal over Six Nations Rugby
Six Nations Rugby today confirmed that it has commenced joint long form contract discussions with broadcasters Virgin Media Television and RT having agreed a j...
11/05/2021
RT continues proud support of School Digital Champion Programme
#digitalchamps RT is proud to continue its support of the School Digital Champion Programme which culminates in the annual showcase (virtual) event this Wedne...
11/05/2021
SevenVentures Pitch Day is back in 2021: Virtual event offers start-ups the chance to win media advertising worth 3 million and budget for TV spot
SevenVentures Pitch Day is back in 2021: Virtual event offers start-ups the chan...
11/05/2021
Lauren Lyle to star as Karen Pirie in ITV cold case murder drama Karen Pirie
Lauren Lyle to star as Karen Pirie in ITV cold case murder drama, Karen Pirie Lauren Lyle to star as Karen Pirie in ITV cold case murder drama, based on acclai...
