Sony Pixel Power calrec Sony

The future of video quality has AI written all over it

30/11/2023

Yoann Hinard, COO at Witbe, looks at how AI has the potential to transform the video industry in various ways, including real-time video quality evaluation and third-party app performance testing, ensuring that users enjoy uninterrupted and flawless streaming experiences

By Contributor

Published: November 30, 2023

Yoann Hinard, COO at Witbe, looks at how AI has the potential to transform the video industry in various ways, including real-time video quality evaluation and third-party app performance testing, ensuring that users enjoy uninterrupted and flawless streaming experiences

target=_blank title=Share on LinkedIn class=share-linkedin>

In today's digital media landscape, audiences have come to expect nothing less than flawless streaming experiences. As a result, the highest priority for content and service providers is the delivery of pristine video quality. To meet their customers' discerning expectations, it's imperative to conduct regular testing to assess and enhance the quality of video streams. Artificial intelligence (AI) has emerged as a powerful tool in delivering this capability.

However, while AI has already made significant strides in ensuring exceptional video quality for content providers like Netflix and Hulu, its full potential has yet to be fully harnessed for service providers that deliver linear TV and offer over-the-top apps on their set-top boxes (STBs).

The role of machine learning neural networks Currently, the predominant AI technology being employed for assessing video quality is machine learning (ML) neural networks. These neural networks play a pivotal role in identifying defects that emerge during the content compression process by measuring the degradation in quality between the source content and its compressed counterpart. This method, in its various iterations, is rapidly gaining traction among content providers. They have been harnessing AI tools to enhance their encoding processes, particularly for premium, high-demand content.

Neural networks allow for the fine-tuning of encoding parameters and enable per-title encoding. They find extensive use in the realm of video-on-demand content, which requires experimenting with various encoding parameters and making iterative adjustments to obtain the highest video quality at the lowest bit rate, ultimately resulting in lower distribution costs. This methodology has evolved into an industry-standard exemplified by VMAF, an algorithm pioneered by Netflix and widely adopted throughout the industry in the initial stages of encoding.

Taking a device-based approach While the use of neural networks in assessing video quality is helpful for content providers, it comes with a notable limitation for service providers - it's unsuitable for any content that lacks a reference stream to compare against. Consequently, it cannot be employed for testing live content due to the inherent nature of live streams, which cannot be preprocessed. So, for service providers delivering live linear content like sporting events, the primary hurdle in harnessing AI lies in the ability to evaluate content quality in real-time, including ad breaks.

A promising solution currently under development involves evaluating video quality from the perspective of an end-user after the stream has been decoded by a viewing device. This approach requires a higher level of AI sophistication, since it entails evaluating content without prior knowledge and assessing it in a manner akin to how a human would. It also mandates the utilisation of real physical devices with distinct operating systems, which introduces its own set of complexities.

Navigating the interface of physical devices necessitates an approach that mirrors human interaction. This is a capability best achieved through AI, as scripting every conceivable action to access every piece of content is unfeasible. Therefore, the process of content retrieval becomes dynamic, calling for adaptable AI solutions capable of handling diverse scenarios.

Once the content is reached, a further challenge arises in distinguishing between genuine defects and non-defective scenarios. AI must differentiate between blurriness resulting from compression and deliberate artistic choices, or between a black screen indicative of a defect and one that occurs during a transition. The ability to accurately identify true defects is paramount to improve the provider's service and enhance the user experience.

Ensuring the functionality of third-party apps For service providers offering third-party apps like Disney+ or Amazon Prime Video on their STBs, ensuring their proper functionality presents a unique challenge. The responsibility for these apps and their configuration doesn't fall squarely on service providers' shoulders, and they may be reluctant to take it on since it falls outside their core services of linear TV, DVR functionality, and on-demand portals. However, neglecting to ensure the proper performance of third-party apps, which account for a substantial portion of customer viewing time on their platform, is not in their best interests.

If an app fails to perform satisfactorily on a service provider's STB, there's a good chance viewers will opt for an alternative device. At this point, there's no shortage of options: from Smart TVs to streaming boxes, gaming consoles, mobile devices, and more. At best, this results in a reduction in viewership on the service provider's platform, with viewers eventually returning to their STBs to consume other content. At worst, viewers don't return at all and decide to cancel their subscription with the service provider. This issue is of particular concern in the United States, where the high cost of cable subscriptions frequently leads to cord-cutting, where viewers abandon traditional service providers an
LINK: https://www.tvbeurope.com/artificial-intelligence/the-future-of-video-...
See more stories from tvb

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

09/09/2026

Celemony Tonalic gains additional Paul Kleber upright bass

New parts aimed at hip-hop and pop productions The latest update to Celemony's innovative virtual session musician expands the collection of built-in in...

09/09/2026

Sonarworks Autumn Sale

Save up to 40% until 21 September 2026 Sonarworks are currently running their Autumn Sale, with discounts of up to 40% currently available across their rang...

09/09/2026

Bjooks Beat Gems to begin shipping

Upcoming title officially launches in September 2026 Bjooks' celebrations for this year's 909 Day will be welcome news amongst drum machine lovers, ...

09/09/2026

Tom Daley adds final stitch to giant Baa-Ewe tapestry celebrating Shaun the Sheep: The Beast of Mossy Bottom

Wednesday 9 September 2026 Tom Daley adds final stitch to giant Baa-Ewe' t...

09/09/2026

Red Seat Ventures Integrates Barometer into Speakeasy to Maximize Podcast Revenue Across Audio Portfolio

Red Seat Ventures Integrates Barometer into Speakeasy to Maximize Podcast Revenu...

09/09/2026

Avid and FilmLight announce strategic partnership to reimagine the color pipeline for post production

Baselight-powered color comes natively to Media Composer, connecting creative de...

09/09/2026

Rain, hay or shine, RT is heading to The Ploughing

RT brings three packed days of live radio, entertainment, news, weather and fun Join RT Radio 1: Morning Ireland, Oliver Callan, Today with David McCullagh,...

08/09/2026

Sauceware Audio release Scorch 2

Built for rap producers, by rap producers Sauceware Audio, the independent plug-in company founded by Grammy-nominated producer Jacob (Travis Scott, 21 Sava...

08/09/2026

Warm Audio unveil the Jude preamps

Classic Sound Techniques design revived Warm Audio's latest release delivers a meticulous recreation of the preamp circuitry employed by the Sound Techn...

08/09/2026

XILS Lab introduce MemoryTone

Latest soft synth inspired by the Memorymoog XILS Lab have just launched a software instrument that draws its inspiration from Moog's iconic Memorymoog,...

08/09/2026

Soundcraft Introduces Signature Plus Series Analog Connected Mixing Consoles

September 08, 2026 NORTHRIDGE, Calif. - Soundcraft today announced the launch of its Signature Plus Series Analog Connected Mixing Consoles. As the next genera...

08/09/2026

Sky Go gets a major upgrade for Sky Glass and Sky Stream customers

Tuesday 8 September 2026 Sky Go gets a major upgrade for Sky Glass and Sky Stream customers Today, Sky launches a new version of the Sky Go app for Sky Glass ...

08/09/2026

Trailer released for The Wargame, launching on Sky from 21 September

Documentary thriller simulating a Russian attack on UK soil will culminate in a live final episode reuniting the playersTuesday 8 September 2026 Trailer releas...

08/09/2026

Riedel Introduces New OnAir Headset Platform

Wuppertal September 8, 2026 Riedel Introduces New OnAir Headset PlatformRiedel Communications today announced the launch of its new OnAir headset platform, a...

08/09/2026

flexAI Adds Autonomous Mixing, 12G-SDI, NDI, and TVU MediaMesh Integration

BERLIN, September 8, 2026 - J nger Audio will introduce a major expansion of its flexAI audio processing platform at IBC 2026. The flexAI system adds autonomous...

08/09/2026

Harmonic Unveils cOS SensAI Intelligence Fabric for Broadband Operations

New Vendor-Agnostic Broadband Intelligence Fabric Reduces Operational Complexity and Improves Service Quality for Broadband Service Providers SAN JOSE, Calif. -...

08/09/2026

Arvato Systems Brings TI Expertise to the Stage

Arvato Systems Brings TI Expertise to the Stage Panels, workshops, and real-world examples at the TI-SUMMIT 2026 Arvato Systems, a partner of the TI-SUMMIT 2...

08/09/2026

The internet\u2019s favourite cat comes to Apple\u00A0Arcade with Pusheen\u2019s Place - UPDATE - Posted on 08 September 2026

On October 1, Apple Arcade is rolling out a lineup of fun new games for players ...

07/09/2026

HeadRush launch the FRFR Cab Series

Two new full-range, flat-response cabinets introduced HeadRush have recently introduced a pair of new full-range, flat-response cabinets designed for player...

07/09/2026

GameSoundCon 2026

Answering questions about AI in game audio GameSoundCon, the largest professional conference for video game music and sound design, have announced that they...

07/09/2026

DPA to launch the 6388 Core+

New directional headset mic on show at IBC Just ahead of this week's IBC show, DPA have announced the launch of a new directional headset that's bee...

07/09/2026

Accurate.Video rallies Iyuno to rework 35,000 media assets ahead of schedule

We are not building systems to replace human decision-making; we are building systems that execute our decisions at machine speed. The media companies that win ...

07/09/2026

Freddie Meredith joins cast of SNL UK ahead of start of Season 2

Monday 7 September 2026 Freddie Meredith joins cast of SNL UK ahead of start of Season 2 Freddie Meredith Images ZIP (3MB) Saturday Night Live UK announces ...

07/09/2026

Sky and NFTS team up to launch new routes into screen careers

Monday 7 September 2026 Sky and NFTS team up to launch new routes into screen careers Sky has today announced a new apprenticeship programme, with application...

07/09/2026

Sky Sports announces most comprehensive NFL coverage to date for the 2026/27 season

Monday 7 September 2026 Sky Sports announces most comprehensive NFL coverage to...

07/09/2026

Jnger Audio Showcases Industry-First S-ADM Cloud Workflow at IBC 2026

Dolby, MainConcept, Techex and J nger Audio will showcase the industry's first demonstration of Serial Audio Definition Model (S-ADM) in a cloud-based produ...

07/09/2026

dB Broadcast to Showcase APIS Hive at IBC 2026

dB Broadcast will showcase APIS Hive, its software platform for designing, deploying and managing modern broadcast infrastructures, at IBC 2026. Developed from...

07/09/2026

A KNOCKOUT 1.6 MILLION VIEWERS WATCHED KATIE TAYLOR'S FINAL BOUT FREE -TO -AIR ON RT2

552,000 streams on RT Player The historic fight, which saw Katie Taylor become...

06/09/2026

BS-203 MacroAcidizer from Born Second

Recreates Rolands TB-303 & MC-202 BS-203 MacroAcidizer is the first virtual instrument from Born Second, and it offers a recreation of two Roland classics -...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

05/09/2026

HEDD Audio update CTRL software

MK2 & Bass system control app improved HEDD Audio have just launched a new and improved version of the control software that pairs with their MK2 and Bass m...

04/09/2026

Business Innovation Synergizer FAQ: What applicants need to know

Media organisations interested in the Media Innovation Europe 3.0 Business Innovation Synergizer (BIS) can now consult a new FAQ document providing additional a...

04/09/2026

KeySolutions Sounds release Traveler

Powerful new soft synth announced Traveler is the first software instrument to be released by KeySolutions Sounds, and it's an ambitious one! Said to co...

04/09/2026

e-instruments launch Velvet Guitars Fragment

Free virtual instrument range expanded The latest expansion of e-instruments' free Fragments series introduces a packed-down version of the company'...

04/09/2026

Accentize Chameleon wins Emmy Award

Company recognised for second time Two years after winning an Engineering, Science & Technology Emmy Award for dxRevive Pro, Accentize have been recognised ...

04/09/2026

AgileTV and Friend MTS Complete CDN Watermarking Integration to Fast-Track Anti-Piracy Protection for Operators

Bilbao - 3rd September 2026 -AgileTV, a leading provider of end-to-end TV and vi...

04/09/2026

RT ANNOUNCE NEW DRAMA THE MURDER OF MR. MOONLIGHT BASED ON THE DISAPPEARANCE AND MURDER OF BOBBY RYAN

RT ANNOUNCE NEW DRAMA THE MURDER OF MR. MOONLIGHT BASED ON THE DISAPPEARANCE...

03/09/2026

Yospace releases new Ad Presentation solution, unlocking revenue opportunities with non-linear ad formats

Yospace will be at IBC from 11th - 14th September (booth 5.C78). For more inform...

03/09/2026

Anthony Marinelli launches Bass DNA course

Create musical synth bass sounds from scratch Anthony Marinelli Music have recently announced the launch of Bass DNA, a new online course that teaches music...

03/09/2026

IK Multimedia unveil the Tonex Board

Most powerful Tonex hardware to date IK Multimedia's latest release introduces their most advanced Tonex hardware unit to date, combining their AI Machi...

03/09/2026

Penteo Audio Plugins announce Penteo 8

Upmix & downmix software upgraded Penteo Audio Plugins have announced that the latest version of their powerful upmix and downmix software is now available....

03/09/2026

Young talents begin their training at SGL Carbon in Germany

With the start of the new apprenticeship year, young talent has once again begun their professional careers at SGL Carbon's sites in Germany. Recently, the ...

03/09/2026

Calrec advances EBU's Dynamic Media Facility vision at IBC 2026

With the industry increasingly embracing hybrid, software-defined production models, Calrec will preview a series of Argo and ImPulseV software enhancements at ...

03/09/2026

SES Strengthens Peruvian Navy Operations with New Multi-Orbit Satellite Solution

Luxembourg, 03 September 2026 - SES, a space solutions company, extends its collaboration with the Peruvian Navy (Marina de Guerra del Per ) to deliver sovereig...

03/09/2026

Jeff Goldblum announced as host of Saturday Night Live UK series 2 premiere, joined by musical guest CMAT

Thursday 3 September 2026 Jeff Goldblum announced as host of Saturday Night Liv...

03/09/2026

Gonshiro Strengthens Collaboration With Riedel, ARRI, to Advance Cinematic Live Production

Wuppertal September 3, 2026 Gonshiro Strengthens Collaboration With Riedel, AR...