Sony Pixel Power calrec Sony

Why Vidispine becomes cognitive

04/05/2020

Vision and hearing are your main senses when experiencing a movie. You recognize the actors, you understand the spoken language even if it is not your native language. You follow the story and enjoy the amazing film photo of the different environments - and by sharing all these experiences you can not only relate to the movie itself but also convince your friend to see the movie.

Wouldn't it be great if your Media Asset Management system could possess similar capabilities when managing your media? Being able to understand the language? Recognize actors, detect and define parts of the image - maybe also differentiate between genres? But how?

In order to do this you need a system that can actually see and listen what's inside your media - you need a system that has cognitive capabilities like yourself and can store that info in - yes, you guessed right - metadata.

But how do we navigate our vastly growing archives of file-based media?

Media files themselves today includes a lot of metadata already in a descriptive format. In here, there is room for all general metadata as well as technical metadata describing the actual file structures. MAM (Media Asset Management) systems make use of this existing metadata along with additional layers of metadata frameworks to help you navigate, find and tag not only media files themselves but also the time-based intervals of the media.

Because of this, you can argue that the true definition of a media file must include an audio-visual asset AND an associated metadata description. Without one or the other - the asset is not complete.

Cognitive Metadata to boldly go where no MAM has gone before Traditionally, the common notion is that while a machine can read and act on the associated text-based metadata of a media file, a human can understand the storyline. We can detect lipsync, recognize actors, emotions, and all the visual objects inside a frame. We can also listen to the language spoken, understand the story and do a translation into a new language.

Because of this common view on the differences between machine capabilities and human capabilities, it is still also quite common that production companies and similar, divide many tasks in a media supply chain between man and machine this way.

But times are changing, and they are changing fast. For any Content Owner, CTO or technical strategist building a modern media workflow, it is vital to challenge this traditional view on what machines can and cannot do.

Interview with Ralf Jansen Product Manager and Software Architect at Arvato / Vidispine To find out more on this subject, we talked to Ralf Jansen, Product Manager and Software Architect at Arvato / Vidispine AB. Ralf Jansen has a strong technical background, finished computer science degree with a Thesis Diploma at Fraunhofer Institute and has since worked as a developer and software architect in the industry for nearly the last 20 years. Today Ralf Jansen is managing the development of the new Vidinet Cognitive Services (VCS) and is part of the Vidinet partner success team.

So, Ralf, why is cognitive services important? Cognitive services allow the machine to find information inside the video and audio frame itself, very much like we humans can interpret the same content. This of course opens up important new possibilities depending on what type of workflow you are managing. A channel distributor can use cognitive services to automatically find (new) types of information in a huge amount of media content that could not be processed manually before - and thus use or present that insights to the viewer as a program, highlights, suggested shows or even as autogenerated trailers. Cognitive services carry this new information as metadata and give your MAM system new and much more granular methods of managing your media files. This is very important in the process of optimizing the performance and capabilities of your evolving media supply chain.

Revenue and how we can improve revenue are, of course, a driver for the advancement and adaption of cognitive services like for most other technology. And once you are getting familiar with the idea of challenging your common view on what machines can do - the subject of revenue by technology gets even more interesting.

In what areas could cognitive services improve existing revenue streams? Knowing and understanding the inside of your media opens many new opportunities that can improve revenue and help customers to monetize their owned media assets. The first one that comes to mind is of course speech to text - where cognitive services can in best case reach or even exceed the magical benchmark of human understanding (which is roughly at 5% error rate) depending on how purely spoken and what known vocabulary was used with automatic transcribe functionality already today. Automatic speech to text at this level not only free up human resources and saves money otherwise spent on external subtitling services, but also enables a new layer of time based metadata where you actually can navigate in time to find deep linked subjects, names and topics by simply searching the contents of your subtitling in your MAM systems accurate search capabilities and in our case powered by Elastic Search. And this is of course just one of many examples.

It is important to understand the value of temporal metadata since captured reality stored into the video (and audio) file changes every 30-60 frames per second or more - and because of temporal metadata we are able to define accurate time spans for different video and audio content detected by cognitive services. A post house ingesting reality content normally uses human resources for logging and preparing projects for the editors. In these and similar production workflows, the challenge is the huge amount of incoming raw footage that needs to be sorted a
LINK: https://www.vidispine.com/blog/why-vidispine-becomes-cognitive...
See more stories from vidispine

Most recent headlines

06/10/2025

France Tlvisions Wins Prestigious 2025 EBU Technology & Innovation Award in Groundbreaking Collaboration with Dalet

France T l visions, France's leading broadcaster, has received the 2025 EBU ...

04/09/2025

Monumental Sports & Entertainment and Dalet Win Prestigious 2025 NAB Show Project of the Year Award

Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...

30/06/2025

Discover Weekly Turns 10: Celebrating 100 Billion+ Tracks Streamed and a Decade of Personalized Discovery

There's nothing quite like the magic of finding music that feels made just f...

30/06/2025

Spotify's Editors Pick Their Best Songs of the Year (So Far)

When it comes to new music, Spotify's team of editors across North America is always on the hunt for songs that make them feel, think, and move. They're...

30/06/2025

SBS On Demand boosts global news offering with launch of France 24 FAST Channel

SBS On Demand boosts global news offering with launch of France 24 FAST Channel 30 June, 2025 Media releases SBS is expanding its international news offeri...

30/06/2025

The Forsytes Season 2 Commissioned by MASTERPIECE on PBS

Star Studded Ensemble Cast Are Joined by Richard Rankin as Filming Begins on the Second Season [June 12, 2025 - Boston, MA]: The Forsytes, Debbie Horsfield...

30/06/2025

Artemis II Mission Advances with Successful RS-25 Engine Checkout Tests

The Artemis II Space Launch System core stage is integrated with the solid rocket boosters inside High Bay 3 of the Vehicle Assembly Building at NASAs Kennedy S...

30/06/2025

WRAL-WRAZ Raleigh Names Heather Gray as VP and GM

RALEIGH, N.C. Capitol Broadcasting Co. has named Heather Gray vice president and general manager of WRAL-TV and WRAZ-TV here....

30/06/2025

VAB Awards JJ Freeman Engineering Award to Bill Sewell of WTKR/WGNT

The Virginia Association of Broadcasters has recognized Bill Sewell, Director of Engineering at WTKR & WGNT in Norfolk, Va. as the recipient of the 2025 J.J. Fr...

30/06/2025

SBE Recruits 49 New Members

The Society of Broadcast Engineers said its annual member drive resulted in the recruitment of 49 individual members....

30/06/2025

Avid Releases Full Integration of MediaCentral, Wolftech News

BURLINGTON, Mass. Avid today released its fully integrated news platform, uniting MediaCentral and Wolftech News in a single newsroom solution, and will demonst...

30/06/2025

FCC Fines Sinclair $500,000

WASHINGTON The Federal Communication's Enforcement and Media Bureaus have entered into a Consent Decree with Sinclair Broadcast Group to resolve a variety o...

30/06/2025

Qu-Bit announce the Bloom v2

Eurorack sequencer module reimagined California-based modular synth innovators Qu-Bit have announced the launch of a new module that offers a fresh new take...

30/06/2025

Berklee at Umbria Jazz Clinics to Host 40th Anniversary Concert

Berklee at Umbria Jazz Clinics to Host 40th Anniversary Concert The celebration will be held on July 10 in Perugia, Italy. By Colette Greenstein June 30, 202...

30/06/2025

PremiumBeat Tips and Tricks

PremiumBeat Tips and Tricks Brie Clayton June 30, 2025 0 Comments When editing to impress, you'll need quality music, and if your studio happens t...

30/06/2025

Techivation launch T-De-Esser Pro Mk2

Improved dynamic behaviour, improved audio quality & more Techivation have announced the release of an upgraded edition of their very first premium plug-in,...

30/06/2025

German premiere with live flight demonstration: German industry team showcases electromagnetic combat from the air

German premiere with live flight demonstration: German industry team showcases e...

30/06/2025

Beln Cuesta and Karra Elejalde Star in 'El nio', the New Film by Mariano Barroso

Back to All News Bel n Cuesta and Karra Elejalde Star in El ni o, the New Film ...

30/06/2025

A New Dangerous Troll Awakens: Netflix Unleashes Teaser for 'Troll 2'

Back to All News A New Dangerous Troll Awakens: Netflix Unleashes Teaser for Troll 2Play Video Play Video Entertainment 30 June 2025 GlobalNorwayDenmarkSwe...

30/06/2025

The Focusrite Summer Sale is now on

The Focusrite Summer Sale is now on Don't miss unbeatable deals on Scarlett, Vocaster, and more. Whether you're an artist, a producer, or a podcaste...

30/06/2025

Yellowstone origin story 1923 starring Harrison Ford and Helen Mirren comes to RT One and RT Player

All 8 episodes of Season 1 of 1923 will be available on RT Player from Tuesday ...

30/06/2025

Thales 2025 Global Cloud Security Study Reveals Organizations Struggle to Secure Expanding, AI-Driven Cloud Environments

Facebook Twitter LinkedIn 52% report AI security spending is displacing tr...

30/06/2025

Thales Alenia Space to develop SOLiS very-high-throughput laser communications demonstrator

Facebook Twitter LinkedIn Cannes, June 30th, 2025 - Thales Alenia Space, t...

29/06/2025

Roland introduce the Mood Pan

Handpan-inspired instrument announced Roland have announced the launch of the Mood Pan, a unique electronic hand percussion instrument that has been designe...

29/06/2025

A Secret Society, Ritualistic Killings, and a Century-Old Curse Netflix and YRF Entertainment's 'Mandala Murders' Premieres July 25

Back to All News A Secret Society, Ritualistic Killings, and a Century-Old Curs...

28/06/2025

Press Release: NFVF Marks Youth Month by Empowering Future Creatives Through Film & TV Bursaries

Johannesburg, 27 June 2025 - As the nation commemorates Youth Month 2025, the N...

28/06/2025

FCC Chair Brendan Carr Promises Very, Very Busy, Productive Summer

WASHINGTON In a press conference following the Federal Communications Commission's May Open Meeting, Chair Brendan Carr promised the agency would move rapid...

28/06/2025

Spectrum Awards $1.1 Million in 2025 Spectrum Digital Education Grants

STAMFORD, Conn. Charter Communications has awarded $1.1 million in Spectrum Digital Education grants to 55 nonprofit organizations that work to expand access to...

28/06/2025

Sonnet Announces Echo 20 Thunderbolt 4 SuperDock Now Veri...

LAKE FOREST, Calif. June 19, 2025 What's New: Sonnet Technologies today announced the certification of its Echo 20 Thunderbolt 4 SuperDock as an Engin...

28/06/2025

IDC Names MASV One of Three Most Innovative Companies in...

MASV (massive.io), the fastest and most reliable large file transfer platform for media professionals, has been named an IDC Innovator in the IDC Innovators: Me...

28/06/2025

TV SKYLINE Expands Live Production Capabilities with Late...

Grass Valley today announced that TV SKYLINE GmbH, one of Europe's top mobile production providers, has expanded its camera inventory with 30 LDX 135 UHD/HD...

28/06/2025

AgileTV has been selected to develop and implement LIWEST...

AgileTV, a European leader in TV and video technology solutions, signed an agreement with Austrian telco LIWEST to develop and implement its TV service in Austr...

28/06/2025

Scaler 3.1 update from Scaler Music

Music theory plug-in updated Three months on from the release of the latest version of their renowned music theory plug in, Scaler Music have launched an up...

28/06/2025

The 48th Annual Indian National Finals Rodeo Shot with Blackmagic PYXIS 6K

The 48th Annual Indian National Finals Rodeo Shot with Blackmagic PYXIS 6K Brie Clayton June 27, 2025 0 Comments Filmmaker Cameron Mackey relied on Bl...

28/06/2025

Social, Streaming Don't Compete, They Compliment

Social, Streaming Don't Compete, They Compliment Andy Marken June 27, 2025 0 Comments I think we've all arrived at a very special place. Spir...

28/06/2025

Blackmagic Design Captures Filipino Rock Band Drama Singtala

Blackmagic Design Captures Filipino Rock Band Drama Singtala Brie Clayton June 27, 2025 0 Comments Blackmagic URSA Mini Pro 12K and DaVinci Resolve St...

28/06/2025

Enhance Videos Faster with Aiarty Video Enhancer - Offline, Sharp, and Natural

Enhance Videos Faster with Aiarty Video Enhancer - Offline, Sharp, and Natural Brie Clayton June 27, 2025 0 Comments If you've used AI video tools...

27/06/2025

Give Me the Backstory: Get to Know Eva Victor, the Writer-Director Behind Sorry, Baby

By Jessica Herndon One of the most exciting things about the Sundance Film Fest...

27/06/2025

Spotify Launches K-Pop Performance Video Series . . . Next Up, TWS

K-Pop remains one of the biggest genres globally, and many fans just can't get enough of it. That's why Spotify has launched a new series of K-Pop perf...

27/06/2025

Family Cybersecurity CEO: Protecting Kids, Parents, and My Sanity From Scams

In our latest blog post, Rafael Rivera highlights the rising threat of online scams, and the important role cybersecurity plays in protecting families across ge...

27/06/2025

FCC Sets Comment Deadlines on Proposed Foreign Ownership Rules

WASHINGTON The Federal Communications Commission has set deadlines for comments to a notice of proposed rulemaking (NPRM) to codify certain foreign ownership re...

27/06/2025

FCC Chair Brendan Carr Promises Very, Very Busy, Productive Summer'

WASHINGTON In a press conference following the Federal Communications Commission's May Open Meeting, Chair Brendan Carr promised the agency would move rapid...

27/06/2025

Klevgrand introduce Walls reverb plug-in

From grounded realism to bending, impossible geometries Klevgrand have announced the release of a new algorithmic reverb plug-in which they say deconstruct...

27/06/2025

GIK Acoustics: Room EQ Wizard Tutorial

Learn to use REW for room analysis Acoustic treatment is one of the most important factors in any studio, and with the extensive range of products available...

27/06/2025

HDMI Forum Introduces v2.2 of the HDMI Specification

SAN JOSE, Calif. The HDMI Forum has released Version 2.2. of the HDMI Specification with 96Gbps bandwidth and next-gen HDMI Fixed Rate Link technology to provid...

27/06/2025

TV Skyline Expands Live Production Capabilities with Grass Valley Cameras

MONTREAL Grass Valley has announced that TV Skyline GmbH, one of Europe's top mobile production providers, has expanded its camera inventory with the acquis...

27/06/2025

Fubo Adds Weigel Broadcasting's Networks

NEW YORK & CHICAGO FuboTV Inc. and Weigel Broadcasting Co. have announced a multi-year agreement for distribution of seven networks including MeTV, H&I, Movies!...

27/06/2025

Americans' Favorite Pastime is Watching TV

NEW YORK A national survey of U.S. consumers shows 66% of us watch TV all or most of the time and also multitask while doing it....

27/06/2025

Sunbeam, Findal Media Ink Deal to Broadcast ABC Miami

MIAMI Sunbeam Television has reached a multiyear agreement with Findal Media & Technology Group to broadcast the new ABC Miami beginning Aug. 4....

27/06/2025

AccuWeather Signs Weather Data Deal with AI Search Provider Perplexity

STATE COLLEGE, Pa. AccuWeather has announced a deal with Perplexity, a AI-powered search and answer engine, that will bring AccuWeathers weather data and severe...