Sony Pixel Power calrec Sony

Why Vidispine becomes cognitive

04/05/2020

Vision and hearing are your main senses when experiencing a movie. You recognize the actors, you understand the spoken language even if it is not your native language. You follow the story and enjoy the amazing film photo of the different environments - and by sharing all these experiences you can not only relate to the movie itself but also convince your friend to see the movie.

Wouldn't it be great if your Media Asset Management system could possess similar capabilities when managing your media? Being able to understand the language? Recognize actors, detect and define parts of the image - maybe also differentiate between genres? But how?

In order to do this you need a system that can actually see and listen what's inside your media - you need a system that has cognitive capabilities like yourself and can store that info in - yes, you guessed right - metadata.

But how do we navigate our vastly growing archives of file-based media?

Media files themselves today includes a lot of metadata already in a descriptive format. In here, there is room for all general metadata as well as technical metadata describing the actual file structures. MAM (Media Asset Management) systems make use of this existing metadata along with additional layers of metadata frameworks to help you navigate, find and tag not only media files themselves but also the time-based intervals of the media.

Because of this, you can argue that the true definition of a media file must include an audio-visual asset AND an associated metadata description. Without one or the other - the asset is not complete.

Cognitive Metadata to boldly go where no MAM has gone before Traditionally, the common notion is that while a machine can read and act on the associated text-based metadata of a media file, a human can understand the storyline. We can detect lipsync, recognize actors, emotions, and all the visual objects inside a frame. We can also listen to the language spoken, understand the story and do a translation into a new language.

Because of this common view on the differences between machine capabilities and human capabilities, it is still also quite common that production companies and similar, divide many tasks in a media supply chain between man and machine this way.

But times are changing, and they are changing fast. For any Content Owner, CTO or technical strategist building a modern media workflow, it is vital to challenge this traditional view on what machines can and cannot do.

Interview with Ralf Jansen Product Manager and Software Architect at Arvato / Vidispine To find out more on this subject, we talked to Ralf Jansen, Product Manager and Software Architect at Arvato / Vidispine AB. Ralf Jansen has a strong technical background, finished computer science degree with a Thesis Diploma at Fraunhofer Institute and has since worked as a developer and software architect in the industry for nearly the last 20 years. Today Ralf Jansen is managing the development of the new Vidinet Cognitive Services (VCS) and is part of the Vidinet partner success team.

So, Ralf, why is cognitive services important? Cognitive services allow the machine to find information inside the video and audio frame itself, very much like we humans can interpret the same content. This of course opens up important new possibilities depending on what type of workflow you are managing. A channel distributor can use cognitive services to automatically find (new) types of information in a huge amount of media content that could not be processed manually before - and thus use or present that insights to the viewer as a program, highlights, suggested shows or even as autogenerated trailers. Cognitive services carry this new information as metadata and give your MAM system new and much more granular methods of managing your media files. This is very important in the process of optimizing the performance and capabilities of your evolving media supply chain.

Revenue and how we can improve revenue are, of course, a driver for the advancement and adaption of cognitive services like for most other technology. And once you are getting familiar with the idea of challenging your common view on what machines can do - the subject of revenue by technology gets even more interesting.

In what areas could cognitive services improve existing revenue streams? Knowing and understanding the inside of your media opens many new opportunities that can improve revenue and help customers to monetize their owned media assets. The first one that comes to mind is of course speech to text - where cognitive services can in best case reach or even exceed the magical benchmark of human understanding (which is roughly at 5% error rate) depending on how purely spoken and what known vocabulary was used with automatic transcribe functionality already today. Automatic speech to text at this level not only free up human resources and saves money otherwise spent on external subtitling services, but also enables a new layer of time based metadata where you actually can navigate in time to find deep linked subjects, names and topics by simply searching the contents of your subtitling in your MAM systems accurate search capabilities and in our case powered by Elastic Search. And this is of course just one of many examples.

It is important to understand the value of temporal metadata since captured reality stored into the video (and audio) file changes every 30-60 frames per second or more - and because of temporal metadata we are able to define accurate time spans for different video and audio content detected by cognitive services. A post house ingesting reality content normally uses human resources for logging and preparing projects for the editors. In these and similar production workflows, the challenge is the huge amount of incoming raw footage that needs to be sorted a
LINK: https://www.vidispine.com/blog/why-vidispine-becomes-cognitive...
See more stories from vidispine

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

02/06/2026

Case Study: Tennis Channel Transitions From Satellite to IP Distribution With LTN

Tennis Channel has completed a transition from satellite-based distribution to a...

02/06/2026

Daktronics Announces 2026 High School Video Summit for June 23-24

Daktronics has announced the 2026 High School Video Summit, a two-day educational event for high school educators and student production teams, taking place Jun...

02/06/2026

Fandango to Screen Telemundos FIFA World Cup 2026 Coverage at 160 Theaters Nationwide

Fandango will bring Telemundo's live Spanish-language coverage of the FIFA W...

02/06/2026

AWSN Announces Broadcast Schedule for Inaugural Professional Softball League Season

All Women's Sports Network (AWSN) has announced the live television schedule...

02/06/2026

Spalk Announces Partnerships with Ligue 1, Euroleague, and LNB

Spalk, a cloud-based multilingual commentary and production platform, has announced three new partnerships: Ligue 1 (English and Portuguese highlights), Eurolea...

02/06/2026

NHL Network Announces Stanley Cup Final Programming Schedule

NHL Network's 2026 Stanley Cup Final coverage began June 1 with NHL Tonight: Stanley Cup Final Media Day from the Carolina Hurricanes' Lenovo Center at ...

02/06/2026

Matrox Video Launches Maevex MGX Series IPMX-Ready AV-over-IP Encoders and Decoders

Matrox Video has announced the Maevex MGX Series, a lineup of IPMX-ready video e...

02/06/2026

Marshall Electronics to Exhibit IP Camera Lineup at InfoComm 2026

Marshall Electronics will exhibit at InfoComm 2026 (Booth C7521), showcasing a lineup of 4K and HD compact POV cameras for corporate, education, hospitality, wo...

02/06/2026

PAMA and Shure Extend Deadline for Mark Brunner Professional Audio Scholarship to June 15

The Professional Audio Manufacturers Alliance (PAMA) and Shure Incorporated have...

02/06/2026

MultiDyne To Debut FiberSaver-10G and New VersaBrix Frame Options at InfoComm 2026

MultiDyne Video and Fiber Optic Systems will exhibit at InfoComm 2026 (Booth C50...

02/06/2026

Advanced Systems Group Promotes Joe Marchitto to Western Regional CTO

Advanced Systems Group (ASG) has announced the promotion of Joe Marchitto to Western Regional CTO. In his new role, Marchitto will oversee system design across ...

02/06/2026

Brothers Osborne To Perform Free Concert Outside Lenovo Center Before Stanley Cup Final Game 1

The NHL has announced that Brothers Osborne will headline a free outdoor concert...

02/06/2026

CP Communications Names First Female Executives in Company History

CP Communications has announced the appointment of its first two female executives in the company's 40-year history. Tabitha Coleman has been named Vice Pre...

02/06/2026

Lighting Design Group Designs Broadcast Studio for Yahoo at 770 Broadway

The Lighting Design Group (LDG) has announced the completion of Studio C at Yahoo's headquarters at 770 Broadway in Manhattan. The studio launched April 24 ...

02/06/2026

Zee Entertainment Acquires FIFA Media Rights for India Through 2034

Zee Entertainment Enterprises Ltd. (Z) has announced a partnership with FIFA to broadcast FIFA World Cup 2026, FIFA World Cup 2030, FIFA Women's World Cup 2...

02/06/2026

Behind The Mic: Prime Sports UK Shares On Air Roster for NBA Finals; and More

Behind The Mic provides a roundup of recent news regarding on-air talent, including new deals, departures, and assignments compiled from press releases and repo...

02/06/2026

Auburn Universitys Parker Leppien on the Nonstop Growth of War Eagle Productions

The department is broadcasting NCAA Baseball Super Regionals at Plainsman Park this weekend Broadcast and production crews at Division I institutions are busy ...

02/06/2026

With Stanley Cup Final Set To Begin, NHL and Honeywell Lay Foundation for Energy-Efficient Venues

The initiative is extends beyond the league's arenas to team training rinks,...

02/06/2026

Release Rundown: What to Watch in June, From Leviticus to The Invite

Olivia Wilde, Seth Rogen, Pen lope Cruz, and Edward Norton appear in The Invite by Olivia Wilde, an official selection of the 2026 Sundance Film Festival. (Co...

02/06/2026

Scaler Music launch Carbon Electra 2

Musically intelligent soft synth gets upgraded Scaler Music will be probably be best known to many for their music theory tools, but their product range al...

02/06/2026

Klevgrand introduce Altitude

Powerful new vocal-production tool announced Described as a vocal performance station , Klevgrand's latest plug-in combines pitch-correction with harmo...

02/06/2026

McDSP introduce DC-2 Dual Compressor for APB

Launched alongside Go Green sale extension McDSP have just released the latest addition to their APB line-up, DC-2 Dual Compressor, and have also announced ...

02/06/2026

Ableton announce Extensions SDK

Create custom tools for Ableton Live 12 Suite Ableton have just introduced a new open JavaScript toolkit that allows anyone to create their own custom tools...

02/06/2026

Eventide unveil the H9 Harmonizer Gen 2

Now features full H90 algorithm library Eventide have announced the upcoming launch of the H9 Harmonizer Gen 2, a new and improved version of their hugely p...

02/06/2026

Universal Audio release UAD Topline Vocal Tune

Plus UAD Half Yearly Sale now live The latest arrival to the Universal Audio range delivers a new native pitch-correction plug-in that's capable of deli...

02/06/2026

BTL Laboratory becomes Taiwan's first test house with a CTIA Certification compliant OTA test system by Rohde & Schwarz

BTL Laboratory becomes Taiwan's first test house with a CTIA Certification c...

02/06/2026

Cobalt Digital to Showcase End-to-End IPMX Ecosystem at InfoComm 2026, Making ST 2110 Easy for Pro AV

blueCORE standalone processors headline solutions designed to simplify the trans...

02/06/2026

Monetizing the Archive: How Cantemo's JIT Playback Eliminates the Proxy Bottleneck

If you've kept up with this article series, you know by now where to start w...

02/06/2026

Calrec Scales ImPulseV for Greater Choice in Virtualised Workflows

With new DSP configurations and flexible licensing options, Calrec is removing the barriers to virtualised audio, giving broadcasters the freedom to scale produ...

02/06/2026

Marketing Architects Expands Relationship With Nielsen To Include Integration of Media Data Engine on a National Level

The TV agency was one of the earliest adopters of Nielsen's local television...

02/06/2026

Riedel Networks Taps Gudrun Scharler as CEO

Share Copy link Facebook X Linkedin Bluesky Email...

02/06/2026

Grass Valley Enables Sky News Australia s Cloud-First New...

Grass Valley today announced that Australian News Channel (ANC), operator of Sky News Australia, has deployed Grass Valley AMPP to transform its newsroom produc...

02/06/2026

STUDIO TECHNOLOGIES INTRODUCES NEW MODEL 385 MIC INTERCOM...

Studio Technologies, a leading manufacturer of high-quality audio, video, and fiber-optic solutions, announces its new Model 385 Mic/Intercom Beltpack. The Mode...

02/06/2026

Gudrun Scharler Appointed CEO of Riedel Networks

The Riedel Group today announced the appointment of Gudrun Scharler as CEO of Riedel Networks. She succeeds Michael Martens, who has led Riedel Networks since 2...

02/06/2026

Magewell Levels-Up All-in-One Content Production with Lau...

More signals, higher quality, and outstanding ingest and streaming flexibility deliver professional results in a small, all-in-one footprint...

02/06/2026

Modena Showcases farmerswife at Mediatech 2026

farmerswife will be featured on the Modena Media & Entertainment stand at this year's Mediatech Africa 2026, giving visitors an opportunity to explore the l...

02/06/2026

PTZOptics showcases intelligent video ecosystem at InfoCo...

PTZOptics will showcase a new generation of intelligent video workflows at InfoComm 2026, June 17 19, Las Vegas. Visitors to booth N8227 will see how PTZOptics ...

02/06/2026

Roku Launches the Roku Soccer Zone

Share Copy link Facebook X Linkedin Bluesky Email...

02/06/2026

FCC Sets Deadlines for Comments in ABC License Renewals

Share Copy link Facebook X Linkedin Bluesky Email...

02/06/2026

Studio Technologies Introduces Model 385 Beltpack

Share Copy link Facebook X Linkedin Bluesky Email...

02/06/2026

Gerald Jerry Pierce, Architect of Modern Digital Cinema, Dies at 73

Share Copy link Facebook X Linkedin Bluesky Email...

02/06/2026

VEON Closes USD 1.4 Billion Bond Offering, Refinancing 2027 Notes Ahead of Schedule

02 Jun 2026 VEON Closes USD 1.4 Billion Bond Offering, Refinancing 2027 Notes A...

02/06/2026

The Marlow Murder Club returns for a fourth series on U

Praise for series three: The Times - sun-dappled pleasure The Daily Mail - The Homes Counties' Charlie's Angels The Sun - 4* this [is an] enjoya...

02/06/2026

Gudrun Scharler Appointed CEO of Riedel Networks

Wuppertal June 2, 2026 Gudrun Scharler Appointed CEO of Riedel Networks The Riedel Group today announced the appointment of Gudrun Scharler as CEO of Riedel N...

02/06/2026

Discover Your Next Book-to-Screen Obsession With Our New Dedicated Hub

Back to All News Discover Your Next Book-to-Screen Obsession With Our New Dedicated Hub Product 02 June 2026 Global Link copied to clipboard Dear most vor...

02/06/2026

New LinkedIn Data: 90% of C-Suite Leaders are Continuously ...

New LinkedIn Data: 90% of C-Suite Leaders are Continuously Building Skills to Lead in the AI Era Published on Jun 2, 2026 Categories: Data and insights Lin...