Sony Pixel Power calrec Sony

The future of video quality has AI written all over it

30/11/2023

Yoann Hinard, COO at Witbe, looks at how AI has the potential to transform the video industry in various ways, including real-time video quality evaluation and third-party app performance testing, ensuring that users enjoy uninterrupted and flawless streaming experiences

By Contributor

Published: November 30, 2023

Yoann Hinard, COO at Witbe, looks at how AI has the potential to transform the video industry in various ways, including real-time video quality evaluation and third-party app performance testing, ensuring that users enjoy uninterrupted and flawless streaming experiences

target=_blank title=Share on LinkedIn class=share-linkedin>

In today's digital media landscape, audiences have come to expect nothing less than flawless streaming experiences. As a result, the highest priority for content and service providers is the delivery of pristine video quality. To meet their customers' discerning expectations, it's imperative to conduct regular testing to assess and enhance the quality of video streams. Artificial intelligence (AI) has emerged as a powerful tool in delivering this capability.

However, while AI has already made significant strides in ensuring exceptional video quality for content providers like Netflix and Hulu, its full potential has yet to be fully harnessed for service providers that deliver linear TV and offer over-the-top apps on their set-top boxes (STBs).

The role of machine learning neural networks Currently, the predominant AI technology being employed for assessing video quality is machine learning (ML) neural networks. These neural networks play a pivotal role in identifying defects that emerge during the content compression process by measuring the degradation in quality between the source content and its compressed counterpart. This method, in its various iterations, is rapidly gaining traction among content providers. They have been harnessing AI tools to enhance their encoding processes, particularly for premium, high-demand content.

Neural networks allow for the fine-tuning of encoding parameters and enable per-title encoding. They find extensive use in the realm of video-on-demand content, which requires experimenting with various encoding parameters and making iterative adjustments to obtain the highest video quality at the lowest bit rate, ultimately resulting in lower distribution costs. This methodology has evolved into an industry-standard exemplified by VMAF, an algorithm pioneered by Netflix and widely adopted throughout the industry in the initial stages of encoding.

Taking a device-based approach While the use of neural networks in assessing video quality is helpful for content providers, it comes with a notable limitation for service providers - it's unsuitable for any content that lacks a reference stream to compare against. Consequently, it cannot be employed for testing live content due to the inherent nature of live streams, which cannot be preprocessed. So, for service providers delivering live linear content like sporting events, the primary hurdle in harnessing AI lies in the ability to evaluate content quality in real-time, including ad breaks.

A promising solution currently under development involves evaluating video quality from the perspective of an end-user after the stream has been decoded by a viewing device. This approach requires a higher level of AI sophistication, since it entails evaluating content without prior knowledge and assessing it in a manner akin to how a human would. It also mandates the utilisation of real physical devices with distinct operating systems, which introduces its own set of complexities.

Navigating the interface of physical devices necessitates an approach that mirrors human interaction. This is a capability best achieved through AI, as scripting every conceivable action to access every piece of content is unfeasible. Therefore, the process of content retrieval becomes dynamic, calling for adaptable AI solutions capable of handling diverse scenarios.

Once the content is reached, a further challenge arises in distinguishing between genuine defects and non-defective scenarios. AI must differentiate between blurriness resulting from compression and deliberate artistic choices, or between a black screen indicative of a defect and one that occurs during a transition. The ability to accurately identify true defects is paramount to improve the provider's service and enhance the user experience.

Ensuring the functionality of third-party apps For service providers offering third-party apps like Disney+ or Amazon Prime Video on their STBs, ensuring their proper functionality presents a unique challenge. The responsibility for these apps and their configuration doesn't fall squarely on service providers' shoulders, and they may be reluctant to take it on since it falls outside their core services of linear TV, DVR functionality, and on-demand portals. However, neglecting to ensure the proper performance of third-party apps, which account for a substantial portion of customer viewing time on their platform, is not in their best interests.

If an app fails to perform satisfactorily on a service provider's STB, there's a good chance viewers will opt for an alternative device. At this point, there's no shortage of options: from Smart TVs to streaming boxes, gaming consoles, mobile devices, and more. At best, this results in a reduction in viewership on the service provider's platform, with viewers eventually returning to their STBs to consume other content. At worst, viewers don't return at all and decide to cancel their subscription with the service provider. This issue is of particular concern in the United States, where the high cost of cable subscriptions frequently leads to cord-cutting, where viewers abandon traditional service providers an
LINK: https://www.tvbeurope.com/artificial-intelligence/the-future-of-video-...
See more stories from tvb

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

30/09/2026

Sync Audio release MegaMorph

Add an envelope generator to any plug-in Sync Audio's latest creation is a handy utility plug-in that can be used to combine and modulate other effects ...

30/09/2026

Strymon launch the La Brea

All-analogue tape-style drive joins Series A Strymon's reputation was built on their digital knowhow, so many were surprised (and intrigued) when they a...

30/09/2026

Sonuscore The Pulse: Synth Wave & Epic Atmospheres

Two new expansion packs released Sonuscore have just introduced two new expansion packs for The Pulse, its production engine instrument for modern cinematic...

30/09/2026

Clear-Com's Arcadia Central Station Brings Professional Production Communications to...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

30/09/2026

Harmonic Launches Recon Product Family Developed in Partnership with Comcast

New Solution Expands Harmonic's Network Intelligence Portfolio and Brings Comcast-Developed Fiber Monitoring Technology to Broadband Operators, Providing Re...

30/09/2026

Claire Brock and Sophie Morris discover how consumers can shop smarter in new RT documentary series

How to Shop Well Now starts Monday at 9.35pm on RT One and RT Player On the...

29/09/2026

Zynaptiq introduce Loud & Wide

Two new plug-ins launch alongside updated bundles Zynaptiq have just announced the launch of two new plug-ins, alongside new and improved versions of two of...

29/09/2026

Wes Audio unveil the ngOmniBox

All-in-one bus processor revealed Wes Audio's ng product range has come a long way since it was first introduced, and now includes a tasty selection of ...

29/09/2026

First Baptist Nashville Drastically Upgrades Production Communications with...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

29/09/2026

SES Successfully Prices 500 million Eurobond

NOT FOR RELEASE, PUBLICATION OR DISTRIBUTION IN OR INTO OR TO ANY PERSON LOCATED OR RESIDENT IN, OR AT ANY ADDRESS IN, THE UNITED STATES OF AMERICA, ITS TERRITO...

29/09/2026

The energy transition will only succeed if it lasts

We tend to think we live in a digital world, with hopes and fears around artificial intelligence (AI), quantum computing, data centres and the next big technolo...

29/09/2026

Apple releases new guide to help families build healthy digital habits - UPDATE - Posted on 29 September 2026

Today, in partnership with the American Academy of Pediatrics (AAP), Apple relea...

29/09/2026

Final Cut Camera now supports variable aperture on iPhone\u00A018\u00A0Pro - UPDATE - Posted on 29 September 2026

Final Cut Camera, the professional filming app for iPhone, receives a major upda...

29/09/2026

RT lyric fm launch the hunt for Choirs for Christmas

RT lyric fm is proud to announce the annual Choirs for Christmas competition callout. Warm up those vocal chords and join us on RT lyric fm for a celebration ...

28/09/2026

Scaler Music introduce Scaler EQ Pro

EQ plug-in can now be played via MIDI Scaler Music have recently released a new and improved version of their patented musical EQ plug-in, kitting it out wi...

28/09/2026

The Asura from Animal Factory Amps

New synth developed in collaboration with philterSoup Boutique effects pedal and Eurorack manufacturer Animal Factory Amps have announced that the new compa...

28/09/2026

Rohde & Schwarz adds an integrated multi-channel pulse analysis option to its FSWX signal and spectrum analyzer

Rohde & Schwarz adds an integrated multi-channel pulse analysis option to its FS...

28/09/2026

Sky launches Full Fibre 1.6 Gbps for millions of homes

Monday 28 September 2026 Sky launches Full Fibre 1.6 Gbps for millions of homes Sky has launched a new Full Fibre 1.6 Gbps product, rolling out from today, gi...

28/09/2026

Arvato Systems Highlights Its Role for Automakers and Suppliers

Arvato Systems Highlights It's Role for Automotive Manufacturers and Suppliers TISAX Arvato Systems has successfully completed the TISAX Level 3 assess...

28/09/2026

Crimecall returns for a brand-new series

Crimecall, presented by Carla O'Brien, returns tonight for a brand new series at 9.35pm on RT One and RT Player. In tonight's episode, alongside appe...

28/09/2026

RT SHORT STORY COMPETITION 2026 - SHORTLISTED STORIES ANNOUNCED

CELEBRATING 40 YEARS AT THE HEART OF NEW IRISH WRITING LIVE FROM POETRY IRELAND, DUBLIN AND ON RT RADIO 1 FROM 7PM DETAILS: www.rte.ie/writing | FOLLOW: #r...

27/09/2026

Boss launch the EX-4 Effects Expander

New compact pedal packs in 120 effects The latest multi-effects pedal from Boss is a compact unit that promises to give any pedalboard a massive boost in s...

26/09/2026

Native Instruments update Maschine

Launched alongside three new expansion packs In celebration of their 30th anniversary, Native Instruments have released a major update for their Maschine 3 ...

25/09/2026

Antares release AutoTune Advanced

Algorithm update & new DVA vibrato-detection engine A new flagship version of Antares' iconic pitch-correction software has arrived, and along with a co...

25/09/2026

Two notes to launch the Captor X Pro

New flagship unit to arrive in early 2027 Two notes Audio Engineering have revealed that a new and improved version of their hugely popular reactive load bo...

25/09/2026

Finalist 2 from Tim Exile

AI-free mixing tool gets an upgrade Launched in October 2025, Tim Exiles Finalist is an algorithmic mixing tool that's been designed for those who don&#...

25/09/2026

Rohde & Schwarz Mobile Test Summit 2026 puts the spotlight on 6G - registrations open

Rohde & Schwarz Mobile Test Summit 2026 puts the spotlight on 6G - registrations...

25/09/2026

IBC 2026: When Intelligence Became the Industry's New Competitive Advantage

In our latest blog, Tim Pearson reflects on IBC 2026 and considers the main learnings against an industry that saw AI finally coming out of the labs and into pr...

25/09/2026

How to watch an unmissable weekend of womens football on Sky Sports and NOW

Friday 25 September 2026 How to watch an unmissable weekend of women's football on Sky Sports and NOW Sky Sports and NOW will broadcast seven live games f...

25/09/2026

YAGA trailer released, coming exclusively to Sky and NOW on 31 October in the UK and Ireland

Friday 25 September 2026 YAGA trailer released, coming exclusively to Sky and N...

25/09/2026

'Watch this space: a new strategic direction for UK media'.

Watch this space: a new strategic direction for UK media. Arqiva has submitted its response to the Governments Green Paper on the future of television distribut...

25/09/2026

Last chance to apply to be part of this year's Late Late Toy Show

Want to be part of this year's Late Late Toy Show? Final call for applications in search for this year's stars The most wonderful night of the year is...

24/09/2026

Waves introduce Tracks Live 2.0

The next generation of multitrack recording for live sound The latest version of Waves' dedicated live multitrack recording software delivers an array ...

24/09/2026

Polyend introduce the Loop

An idea machine for musicians Described as an idea machine for musicians , the latest addition to Polyend's growing collection of guitar pedals combin...

24/09/2026

Synchro Arts unveil VocAlign 7

Alignment tool gains multitrack layout Synchro Arts have just launched the latest version of their renowned time-alignment plug-in, and it's said to be ...

24/09/2026

Expressive E update the Osmose

Synth gains DAW Control & Ctrl-e integration Expressive E have just released a major firmware update that brings some interesting new features to the Osmose...

24/09/2026

Rohde & Schwarz expands its system amplifier portfolio with the R&SSAM200 for applications up to 53 GHz

Rohde & Schwarz expands its system amplifier portfolio with the R&S SAM200 for a...

24/09/2026

Hitachi Launches Startup Challenge, Calling on Innovators Worldwide to Shape the Future of Mobility and Manufacturing Solutions

September 24, 2026 The Hitachi Startup Challenge FY26 invites innovative startu...

24/09/2026

NHK Technologies, Inc. Chooses Calrec for Sports Production

Download Now! To receive a short case study showcasing NHK Technologies, Inc. (NT) s audio setup, please enter the following details: -- First Name* Fir...

24/09/2026

SES Advances Satellite Manufacturing Facility in Luxembourg

LUXEMBOURG, September 24, 2026 - SES, a space solutions company, has commenced construction of a new satellite manufacturing facility in Kockelscheuer, Luxembou...

24/09/2026

Sky Mobile named Best MVNO at the Mobile Industry Awards 2026 for third consecutive year

Thursday 24 September 2026 Sky Mobile named Best MVNO at the Mobile Industry Aw...

24/09/2026

UKTV COMMISSIONS EIGHTH SERIES OF CANAL BOAT DIARIES

London, 24th September 2026: UKTV has commissioned an eighth series of Canal Boat Diaries (8x60') for U (u.co.uk) and U&YESTERDAY, with waterways explorer R...

24/09/2026

Why touch matters in the digital age

From the buzz of your phone when a message arrives to surgeons being able to feel' the patients they are examining from hundreds of kilometres away, these ...

24/09/2026

Maximising the golden quarter for retail

As Q4 approaches, retailers enter the most critical sales window of the year the golden quarter. Stretching from October through December, this period encomp...

24/09/2026

Lightcurve Teams Up with Harmonic to Deliver Multi-Gigabit Broadband Services to MDUs over Coax

Key Takeaways Harmonic's cOS virtualized platform enables Lightcurve to de...