Sony Pixel Power calrec Sony

The future of video quality has AI written all over it

30/11/2023

Yoann Hinard, COO at Witbe, looks at how AI has the potential to transform the video industry in various ways, including real-time video quality evaluation and third-party app performance testing, ensuring that users enjoy uninterrupted and flawless streaming experiences

By Contributor

Published: November 30, 2023

Yoann Hinard, COO at Witbe, looks at how AI has the potential to transform the video industry in various ways, including real-time video quality evaluation and third-party app performance testing, ensuring that users enjoy uninterrupted and flawless streaming experiences

target=_blank title=Share on LinkedIn class=share-linkedin>

In today's digital media landscape, audiences have come to expect nothing less than flawless streaming experiences. As a result, the highest priority for content and service providers is the delivery of pristine video quality. To meet their customers' discerning expectations, it's imperative to conduct regular testing to assess and enhance the quality of video streams. Artificial intelligence (AI) has emerged as a powerful tool in delivering this capability.

However, while AI has already made significant strides in ensuring exceptional video quality for content providers like Netflix and Hulu, its full potential has yet to be fully harnessed for service providers that deliver linear TV and offer over-the-top apps on their set-top boxes (STBs).

The role of machine learning neural networks Currently, the predominant AI technology being employed for assessing video quality is machine learning (ML) neural networks. These neural networks play a pivotal role in identifying defects that emerge during the content compression process by measuring the degradation in quality between the source content and its compressed counterpart. This method, in its various iterations, is rapidly gaining traction among content providers. They have been harnessing AI tools to enhance their encoding processes, particularly for premium, high-demand content.

Neural networks allow for the fine-tuning of encoding parameters and enable per-title encoding. They find extensive use in the realm of video-on-demand content, which requires experimenting with various encoding parameters and making iterative adjustments to obtain the highest video quality at the lowest bit rate, ultimately resulting in lower distribution costs. This methodology has evolved into an industry-standard exemplified by VMAF, an algorithm pioneered by Netflix and widely adopted throughout the industry in the initial stages of encoding.

Taking a device-based approach While the use of neural networks in assessing video quality is helpful for content providers, it comes with a notable limitation for service providers - it's unsuitable for any content that lacks a reference stream to compare against. Consequently, it cannot be employed for testing live content due to the inherent nature of live streams, which cannot be preprocessed. So, for service providers delivering live linear content like sporting events, the primary hurdle in harnessing AI lies in the ability to evaluate content quality in real-time, including ad breaks.

A promising solution currently under development involves evaluating video quality from the perspective of an end-user after the stream has been decoded by a viewing device. This approach requires a higher level of AI sophistication, since it entails evaluating content without prior knowledge and assessing it in a manner akin to how a human would. It also mandates the utilisation of real physical devices with distinct operating systems, which introduces its own set of complexities.

Navigating the interface of physical devices necessitates an approach that mirrors human interaction. This is a capability best achieved through AI, as scripting every conceivable action to access every piece of content is unfeasible. Therefore, the process of content retrieval becomes dynamic, calling for adaptable AI solutions capable of handling diverse scenarios.

Once the content is reached, a further challenge arises in distinguishing between genuine defects and non-defective scenarios. AI must differentiate between blurriness resulting from compression and deliberate artistic choices, or between a black screen indicative of a defect and one that occurs during a transition. The ability to accurately identify true defects is paramount to improve the provider's service and enhance the user experience.

Ensuring the functionality of third-party apps For service providers offering third-party apps like Disney+ or Amazon Prime Video on their STBs, ensuring their proper functionality presents a unique challenge. The responsibility for these apps and their configuration doesn't fall squarely on service providers' shoulders, and they may be reluctant to take it on since it falls outside their core services of linear TV, DVR functionality, and on-demand portals. However, neglecting to ensure the proper performance of third-party apps, which account for a substantial portion of customer viewing time on their platform, is not in their best interests.

If an app fails to perform satisfactorily on a service provider's STB, there's a good chance viewers will opt for an alternative device. At this point, there's no shortage of options: from Smart TVs to streaming boxes, gaming consoles, mobile devices, and more. At best, this results in a reduction in viewership on the service provider's platform, with viewers eventually returning to their STBs to consume other content. At worst, viewers don't return at all and decide to cancel their subscription with the service provider. This issue is of particular concern in the United States, where the high cost of cable subscriptions frequently leads to cord-cutting, where viewers abandon traditional service providers an
LINK: https://www.tvbeurope.com/artificial-intelligence/the-future-of-video-...
See more stories from tvb

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

14/03/2026

HISONG announce the AirStudio S1

Combines mic, USB interface & wireless IEMs Following a successful Kickstarter campaign, HISONG have announced that their innovative AirStudio S1 device is ...

13/03/2026

A New Era of Personalization: Shape Your Taste Profile on Spotify

Spotify has always been built around your taste. More than 80% of listeners say personalization is what they love most about us. Now we're taking that even ...

13/03/2026

Spotify Debuts Legends Club for Popular German-Language Podcasts With Kaulitz Hills'

The new Spotify Legends Club has opened its doors. Its members: select German-sp...

13/03/2026

Klevgrand release OneShot2

Pushing drum sampler technology into new territories The latest version of Klevgrand's software drum sampler has just arrived, boasting a newly designe...

13/03/2026

IK Multimedia update ARC On-Ear

Expanded headphone support & engine improvements IK Multimedia's recently introduced ARC On-Ear system brings the power of their monitoring-correction s...

13/03/2026

UVI introduce Mosaiq 26

Extra sound collections, more presets & new Keys category UVI's rhythm and pattern instrument has just received a major update that introduces four new ...

13/03/2026

VEON Delivers Record Digital Growth: 4Q25 Digital Revenues Grow 84% to 20.1% of Total, Driving 17% Revenue and 29% EBITDA Growth in 4Q25

13 Mar 2026 VEON Delivers Record Digital Growth: 4Q25 Digital Revenues Grow 84%...

13/03/2026

Sky Adds Blood on Snow to Original Film Slate in Acquisition Headlined by Benedict Cumberbatch and Aaron TaylorJohnson

Friday 13 March 2026 Sky Adds Blood on Snow to Original Film Slate in Acquisiti...

13/03/2026

RT announces Rick O'Shea as new presenter on RT Radio 1's Arena

RT has announced today that Rick O'Shea is the new presenter of Arena RT Radio 1's flagship weeknight arts and culture programme. Rick has been pres...

13/03/2026

Lights! Camera! Action! The 98th Oscars set to air live as RT backs the Irish nominees

Lights! Camera! Action! The 98th Oscars set to air live as RT backs the Irish n...

12/03/2026

Milano Cortina 2026: Yospace helps ad-funded rights-holders claim advertising gold

Staines-upon-Thames, UK, 11th March, 2026 - Yospace, the trusted leader in Dyna...

12/03/2026

Mon Laferte Leads All-Women Spotify Session as EQUAL Celebrations Kick Off in Latin America

In Latin America, women are shaping music and defining its future. To kick off t...

12/03/2026

Mon Laferte lidera la edicin EQUAL de Spotify Sessions, mientras comienzan las celebraciones de EQUAL en Latinoamrica

En Am rica Latina, las mujeres est n moldeando la m sica y definiendo su futuro....

12/03/2026

As Spotify Turns 20, the Most Global and Diverse Music Industry in History Has Taken Shape

Let's turn back the clock 20 years: The music landscape was a world away fro...

12/03/2026

Bad Bunny Brings the Sounds of Puerto Rico to Tokyo for Spotify's Billions Club Live

Bad Bunny is no stranger to Spotify's Billions Club. In fact, he has a whopp...

12/03/2026

At the London Book Fair, Spotify Shares Our Vision for the Future of Reading

Spotify was at the London Book Fair this week, joining conversations across the publishing industry about how people can make reading part of their daily lives....

12/03/2026

Ohlhorst Digital & Tokyo Dawn Labs launch Ancora

Mastering tool improves mono compatibility Tokyo Dawn Labs' Ohlhorst Digital range is a series of mastering-focused plug-ins developed by Jan Ohlhorst, ...

12/03/2026

Lewitt partner with Elgato

Wave FX processor integrated into four products Lewitt have teamed up with Elgato to create a new processor for the company's Wave Next product range, i...

12/03/2026

Mix Notes iOS App by David Thomas

Free tool for annotating audio files Mix Notes is a new, free iOS App that provides users with a simple way to annotate their audio files. It's been cre...

12/03/2026

Duck 2 from Devious Machines

Side-chain ducking tool gets an upgrade Devious Machines' popular side-chaining and envelope-shaping tool has just been kitted out with an improved enve...

12/03/2026

MPG Awards 2026: Shortlist announced

Ceremony to take place on 16 April 2026 The MPG (Music Producers Guild) have revealed the full shortlist for this year's MPG Awards, which will be takin...

12/03/2026

Overloud introduce Gem Comp160

Emulates three classic dbx 160 variants The latest arrival to Overloud's Gem Series plug-in range faithfully recreates not one, but three versions of th...

12/03/2026

Grainferno from Baby Audio

New granular soft synth announced Said to be their most advanced software synthesizer to date, Baby Audio's latest release has been built on a new granu...

12/03/2026

Bitwig Studio 6 launches

Latest version now live! Edit 11 March 2026 - Bitwig Studio 6 is now live, and available for all to download! The latest version of Bitwig's DAW softwa...

12/03/2026

Stereo Miking: The Sound On Sound Guide

Latest free eBook now available! Designed for recording engineers, audio-technology students and technically minded musicians, our latest free eBook deliver...

12/03/2026

Rohde & Schwarz Cybersecurity expands SITLine network encryptor portfolio - more bandwidth, higher port density, future-proof architecture

Rohde & Schwarz Cybersecurity expands SITLine network encryptor portfolio - more...

12/03/2026

Rohde & Schwarz to showcase future-proof EMC testing solutions at EMV 2026

Rohde & Schwarz to showcase future-proof EMC testing solutions at EMV 2026 Rohde & Schwarz will participate in EMV 2026, Europe's premier trade fair and c...

12/03/2026

Blue Lucy's 6 Key Tenets

Modern media operations demand a platform that unites automation, orchestration, and human oversight without compromise. In this post, we explore the six key te...

12/03/2026

Blue Lucy Technology

A deep dive into the platform Architecture The Blue Lucy platform follows a distributed microservices architecture, meaning the overall operational capability...

12/03/2026

Blue Lucy Brings Order to the AI Wild West at NAB 2026

Orchestration platform enables broadcasters to deploy multiple AI models safely with full auditability, rights protection, and regulatory oversight. LONDON, En...

12/03/2026

Riedel Expands Managed Technology Division in the Americas, Taps Jan Schaffner to Lead Regional Growth

Wuppertal March 12, 2026 Riedel Expands Managed Technology Division in the Ame...

12/03/2026

Harmonic Redefines the Economics of Video Playout with New Spectrum X Plus Media Server

Advanced Media Server Delivers Double the Channel Density at Half the Cost per C...

12/03/2026

Jam-packed weekend of Irish entertainment, sport and music across RT for St Patrick's Day

The Late Late Show Show St Patrick's Day special Dancing with the Stars f...

11/03/2026

SES Brings Satellite Connectivity to Refugees in Chad

First Medium-Earth Orbit (MEO) deployment of the emergency.lu platform for refugees and their host communities' use provides dependable broadband for humani...

11/03/2026

Reign extended for CLASSIC CAR KINGS with two more series ordered for U and U&YESTERDAY

Following a successful first series, UKTV today announces the commission of two ...

11/03/2026

Sky and CANAL+ launch new partnership to develop English-language drama

Wednesday 11 March 2026 Sky and CANAL launch new partnership to develop English-language drama Sky and CANAL are today announcing a strategic co commissioni...

11/03/2026

NTCA, Cartesian Release New Report on the Business Case for USF

NTCA, Cartesian Release New Report on the Business Case for USF March 11, 2026 Network Economics News NTCA - March 11, 2026 - As the FCC and Congr...

11/03/2026

The 2026 RT Short Story Competition is now open for entries

TELL US YOUR (SHORT) STORIES The 2026 RT Short Story Competition is now open for entries Recognising and rewarding the best new Irish fiction writing for...

11/03/2026

Celtic Media Festival 2026 Nominees Announced

RT 's The Traitors Ireland is among the nominees for the 2026 Celtic Media Festival Torc Awards for Excellence, announced today....

10/03/2026

VEON's Largest Market Pakistan Almost Triples Mobile Spectrum in Reform Push; Jazz Secures Largest Allocation with 190 MHz

10 Mar 2026 VEON's Largest Market Pakistan Almost Triples Mobile Spectrum i...

09/03/2026

Duality Strings Bundle from VSL

Contains all six dual-ensemble libraries VSL's Duality Strings series offers an intriguing alternative to your average string library, capturing two str...

09/03/2026

The 1975 to receive MPG Award

Outstanding Contribution To UK Music Photo: Samuel Bradley Ahead of their upcoming MPG Awards, the Music Producers Guild (MPG) have revealed the latest win...

09/03/2026

Strymon reveal the PCH X1 & X2

Two new high-quality DI boxes announced Boasting some impressive technical specifications and versatile routing options, Strymon's latest active DI boxe...

09/03/2026

Sonora Cinematic introduce Pure Steel String

Latest MPE-capable Soundbox library released The follow-up release for Sonora Cinematic's Pure Nylon has arrived, and becomes the latest addition to the...