Sony Pixel Power calrec Sony

Why Vidispine becomes cognitive

04/05/2020

Vision and hearing are your main senses when experiencing a movie. You recognize the actors, you understand the spoken language even if it is not your native language. You follow the story and enjoy the amazing film photo of the different environments - and by sharing all these experiences you can not only relate to the movie itself but also convince your friend to see the movie.

Wouldn't it be great if your Media Asset Management system could possess similar capabilities when managing your media? Being able to understand the language? Recognize actors, detect and define parts of the image - maybe also differentiate between genres? But how?

In order to do this you need a system that can actually see and listen what's inside your media - you need a system that has cognitive capabilities like yourself and can store that info in - yes, you guessed right - metadata.

But how do we navigate our vastly growing archives of file-based media?

Media files themselves today includes a lot of metadata already in a descriptive format. In here, there is room for all general metadata as well as technical metadata describing the actual file structures. MAM (Media Asset Management) systems make use of this existing metadata along with additional layers of metadata frameworks to help you navigate, find and tag not only media files themselves but also the time-based intervals of the media.

Because of this, you can argue that the true definition of a media file must include an audio-visual asset AND an associated metadata description. Without one or the other - the asset is not complete.

Cognitive Metadata to boldly go where no MAM has gone before Traditionally, the common notion is that while a machine can read and act on the associated text-based metadata of a media file, a human can understand the storyline. We can detect lipsync, recognize actors, emotions, and all the visual objects inside a frame. We can also listen to the language spoken, understand the story and do a translation into a new language.

Because of this common view on the differences between machine capabilities and human capabilities, it is still also quite common that production companies and similar, divide many tasks in a media supply chain between man and machine this way.

But times are changing, and they are changing fast. For any Content Owner, CTO or technical strategist building a modern media workflow, it is vital to challenge this traditional view on what machines can and cannot do.

Interview with Ralf Jansen Product Manager and Software Architect at Arvato / Vidispine To find out more on this subject, we talked to Ralf Jansen, Product Manager and Software Architect at Arvato / Vidispine AB. Ralf Jansen has a strong technical background, finished computer science degree with a Thesis Diploma at Fraunhofer Institute and has since worked as a developer and software architect in the industry for nearly the last 20 years. Today Ralf Jansen is managing the development of the new Vidinet Cognitive Services (VCS) and is part of the Vidinet partner success team.

So, Ralf, why is cognitive services important? Cognitive services allow the machine to find information inside the video and audio frame itself, very much like we humans can interpret the same content. This of course opens up important new possibilities depending on what type of workflow you are managing. A channel distributor can use cognitive services to automatically find (new) types of information in a huge amount of media content that could not be processed manually before - and thus use or present that insights to the viewer as a program, highlights, suggested shows or even as autogenerated trailers. Cognitive services carry this new information as metadata and give your MAM system new and much more granular methods of managing your media files. This is very important in the process of optimizing the performance and capabilities of your evolving media supply chain.

Revenue and how we can improve revenue are, of course, a driver for the advancement and adaption of cognitive services like for most other technology. And once you are getting familiar with the idea of challenging your common view on what machines can do - the subject of revenue by technology gets even more interesting.

In what areas could cognitive services improve existing revenue streams? Knowing and understanding the inside of your media opens many new opportunities that can improve revenue and help customers to monetize their owned media assets. The first one that comes to mind is of course speech to text - where cognitive services can in best case reach or even exceed the magical benchmark of human understanding (which is roughly at 5% error rate) depending on how purely spoken and what known vocabulary was used with automatic transcribe functionality already today. Automatic speech to text at this level not only free up human resources and saves money otherwise spent on external subtitling services, but also enables a new layer of time based metadata where you actually can navigate in time to find deep linked subjects, names and topics by simply searching the contents of your subtitling in your MAM systems accurate search capabilities and in our case powered by Elastic Search. And this is of course just one of many examples.

It is important to understand the value of temporal metadata since captured reality stored into the video (and audio) file changes every 30-60 frames per second or more - and because of temporal metadata we are able to define accurate time spans for different video and audio content detected by cognitive services. A post house ingesting reality content normally uses human resources for logging and preparing projects for the editors. In these and similar production workflows, the challenge is the huge amount of incoming raw footage that needs to be sorted a
LINK: https://www.vidispine.com/blog/why-vidispine-becomes-cognitive...
See more stories from vidispine

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

20/11/2026

ESPN's Jimmy Pitaro on Super Bowl LXI: A Yearlong Story That Features a Game'

The sports broadcaster's chairman sees the upcoming game as an opportunity t...

20/11/2026

SVG GameDay, Ep. 40: New York Mets Brendan McKeon - Firing Up Fans in Flushing

In-venue and creative video staffers at the professional and collegiate level have one major thing in common: the intensity and attention to detail ramps up dur...

20/11/2026

Back at Belmont Park, Part 1: Historic Venue's Renovation Puts a Premium on the Fan Experience

A variety of LED displays, integrated broadcast infrastructure covers every angl...

20/11/2026

RAF Partners with Migu Video to Bring RAF15 Main Event to China

Real American Freestyle (RAF) has announced a distribution partnership with Migu Video, a Chinese digital sports platform, to carry the RAF15 main event between...

20/11/2026

Apple TV Becomes U.S. Home of F1 Academy Beginning in 2027

Apple and F1 Academy have announced that the all-female racing series will stream on Apple TV in the U.S. beginning in 2027. Fans will be able to watch every qu...

20/11/2026

mnchen.tv Relies on Riedel Technology for New Production Center

Regional broadcaster m nchen.tv has modernized its production infrastructure at a new location in northern Munich. Riedel MediorNet provides decentralized signa...

20/11/2026

Eutelsat Announces Three Executive Committee Appointments

Eutelsat has announced three appointments to its Executive Committee, effective November 2026, under CEO Jean-Fran ois Fallacher. Jean-Hubert Lenotte is appoin...

20/11/2026

Seven Melbourne Selects RTS and Magna Systems for Comms Upgrade at New Facility

After more than two decades at Harbour Esplanade in Docklands, the Seven Network has relocated its Melbourne headquarters to a new, custom-built ST 2110 facilit...

20/11/2026

Brazil's TV 3.0 Rollout Shows VVC Moving from Standards Work to Commercial Deployment

Brazil is among the first markets deploying Versatile Video Coding (VVC) as part...

20/11/2026

NBC Sports and The Soccer Tournament Agree to Two-Year Extension for TST 2027 and 2028

The Soccer Tournament (TST), the $1 million winner-take-all 7v7 world championsh...

20/11/2026

Back at Belmont Park, Part 2: NYRA Reaps Benefits of Reimagined Track With Expanded Broadcast Capabilities

Enhancements include a larger compound, an elevated camera count, and a whole lo...

20/11/2026

With Women's Sports Programming Skyrocketing, Content and Production Strategy Are Evolving

Leaders from ESPN, iHeartMedia, and Just Women's Sports explore creating new...

20/11/2026

Lemur Audio release Dorothe

New EQ plug-in aimed at mastering duties Lemur Audio's latest plug-in has just arrived, delivering a characterful EQ that's aimed primarily at maste...

20/11/2026

Soundtoys Black Friday Sale

Discounts of up to 75% now available Soundtoys' annual Black Friday sale is now live, with discounts of up to 75% applied across the company's range...

20/11/2026

SoundGhost release Fragment

New creative looping tool revealed Described as a cycling audio fragmenter , the latest addition to the SoundGhost range draws its inspiration from tape ph...

20/11/2026

Heritage Audio's Herchild 670 goes virtual

Fairchild recreation gets plug-in counterpart Heritage Audio's Herchild 670 offers a meticulous hardware recreations of the much-loved Fairchild 670 and...

20/11/2026

BONDI: 7 Minutes That Changed Australia

BONDI: 7 Minutes That Changed Australia 16 November, 2026 Media releases A landmark documentary chronicling the worst terror attack in modern Australian hi...

20/11/2026

Statement regarding SBS non-Executive Director Aaron Fa'Aoso

Statement regarding SBS non-Executive Director Aaron Fa'Aoso 20 November, 2026 Media releases Aaron Fa'Aoso has advised that he is stepping down a...

20/11/2026

PUBLIC NOTICE FROM THE DEPARTMENT OF SPORT, ARTS AND CULTURE

INVITATION FOR PUBLIC COMMENTS AND OBJECTIONS ON NOMINEES FOR APPOINTMENT TO THE COUNCIL OF THE NATIONAL FILM AND VIDEO FOUNDATION (NFVF) The Department of Spor...

20/11/2026

TVP Claims Top Spot in Poland's Content Distributor Rankings

UEFA Nations League football and autumn premieres propel TVP to number one as YouTube grows its TV screen share Warsaw, Poland, November 19, 2026 - Nielsen, a...

20/11/2026

The Gauge: Poland | October 2026

October's autumn weather clearly encouraged Poles to spend more time in front of their screens, resulting in both longer viewing times and a higher overall ...

20/11/2026

FIFA Finds Few U.S. Networks Interested in 2030 World Cup Broadcast Rights

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

DigitalGlue releases creative.space Pulse, a free Mac app that shows creatives what is slowing them down

DigitalGlue releases creative.space Pulse, a free Mac app that shows creatives w...

20/11/2026

How NBCUniversal Telemundo Used Virtual Production for its FIFA World Cup 2026 Coverage

How NBCUniversal Telemundo Used Virtual Production for its FIFA World Cup 2026 C...

20/11/2026

What Film School Pays and What it Costs: The Federal Numbers

What Film School Pays and What it Costs: The Federal Numbers Mark Santos November 20, 2026 0 Comments Every editor has had the argument about film sch...

20/11/2026

3D Sound Specialist Turns to Nugen Halo Upmix

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

World's First Hybrid Film Production Platform Debuts

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

NBC Adds New Stats Feature for Premier League

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

Hearst TV Names Shawnda Adams to Lead KOCO-TV Oklahoma City

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

FCC Modernizes Drone Communications, Detection Rules

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

OBSBOT Unveils 2 New PTZR Cameras

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

New DigitalGlue Mac App Identifies Media Production Hurdles

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

Beam Dynamics Introduces MCP for Faster, Smarter Technolo...

Beam Dynamics has introduced new Model Context Protocol (MCP) support, expanding how customers can work with the live operational data held in Beam. The new cap...

20/11/2026

Re:Vision Effects Cyber Week Sale Nov 24 to Nov 30

Re:Vision Effects Cyber Week Sale Nov 24 to Nov 30 Pierre Jasmin November 19, 2026 0 Comments Long time friends of the COW are up with a big sale! Us...

20/11/2026

Avid is offering up to 33% off annual subscriptions!

Avid is offering up to 33% off annual subscriptions! Brie Clayton November 19, 2026 0 Comments Hero image courtesy Deposit Photos Pro Tools Pro To...

19/11/2026

Live From the UFL Draft: League's First Live Draft Broadcast Is Set To Innovate, Bring Viewers Close to the Action

With a sports-bar vibe and all the teams onsite in a huge atrium in Ballpark Vil...

19/11/2026

SVG Students To Watch: Niamh Campbell, Seton Hall University

The senior from Phoenix and England is balancing life as a Division I tennis player with a growing career behind the microphone The future of live sports produ...

19/11/2026

RED Connect Adds Native Colorfront Color Management for Live RED Camera Feeds

RED Digital Cinema and Colorfront have partnered to integrate native Colorfront color management into RED Connect, letting productions apply Colorfront's co...

19/11/2026

SMPTE Publishes Engineering Report on Content Provenance and Authenticity

SMPTE has published an engineering report summarizing an industry survey by its Study Group on Content Provenance and Authenticity in Media. The findings point ...

19/11/2026

CTech and Skyline Communications Partner on Integrated SATCOM Operations for Defense

CTech and Skyline Communications have announced a partnership to deliver integra...

19/11/2026

EITB Deploys SMPTE ST 2110 Infrastructure with Lawo HOME mc DSP Processing

Euskal Irrati Telebista (EITB), the Basque Country's public media group, has completed Phase 1 of a five-studio renewal with the commissioning of a Lawo IP ...

19/11/2026

Esports Foundation Expands Road to Esports Nations Cup 2027 with New Qualifiers, Larger Rosters and National Rankings

The Esports Foundation (EF) has announced an expanded Road to ENC 2027 for the E...

19/11/2026

AWSN Holds First Women's Sports Awards Show, VEON: Women Who Win, in New York City

All Women's Sports Network (AWSN) held its first awards show, VEON: Women W...

19/11/2026

Gracenote Extends DIRECTV Partnership for Sports Hubs

Gracenote, the content intelligence business unit of Nielsen, has extended its relationship with DIRECTV. Gracenote will continue to supply visual imagery and p...

19/11/2026

AES Technical Committee Expands Loudness Website with Dialogue Intelligibility Content

The Audio Engineering Society (AES) Technical Committee on Broadcast and Online ...

19/11/2026

NDI 6.4 Adds Recording and Playback APIs, HEVC 4:4:4 and Wi-Fi Receiver Buffer

NDI has released NDI 6.4, which adds Recording and Playback APIs, support for HEVC 4:4:4 and a configurable receiver buffer for Wi-Fi. The update also includes ...

19/11/2026

Lemonlight Announces Hero, an AI Production Operating System for Video

Lemonlight, the video production company behind more than 50,000 brand videos, has announced Hero, an AI production operating system, along with a new AI agent ...

19/11/2026

FanConnect Brings JPEG XS Beyond the Control Room, Cuts In-Venue IPTV Latency 89% for University of Maryland Athletics

In a first-of-its-kind deployment at XFINITY Center, the digital signage/display...

19/11/2026

NBCU Intros Peacock Performance View for Premier League Coverage

For the first time on a US streaming service, real-time player identification, contextual stats, and visual insights appear right in the live stream, available ...