Sony Pixel Power calrec Sony

Why Vidispine becomes cognitive

04/05/2020

Vision and hearing are your main senses when experiencing a movie. You recognize the actors, you understand the spoken language even if it is not your native language. You follow the story and enjoy the amazing film photo of the different environments - and by sharing all these experiences you can not only relate to the movie itself but also convince your friend to see the movie.

Wouldn't it be great if your Media Asset Management system could possess similar capabilities when managing your media? Being able to understand the language? Recognize actors, detect and define parts of the image - maybe also differentiate between genres? But how?

In order to do this you need a system that can actually see and listen what's inside your media - you need a system that has cognitive capabilities like yourself and can store that info in - yes, you guessed right - metadata.

But how do we navigate our vastly growing archives of file-based media?

Media files themselves today includes a lot of metadata already in a descriptive format. In here, there is room for all general metadata as well as technical metadata describing the actual file structures. MAM (Media Asset Management) systems make use of this existing metadata along with additional layers of metadata frameworks to help you navigate, find and tag not only media files themselves but also the time-based intervals of the media.

Because of this, you can argue that the true definition of a media file must include an audio-visual asset AND an associated metadata description. Without one or the other - the asset is not complete.

Cognitive Metadata to boldly go where no MAM has gone before Traditionally, the common notion is that while a machine can read and act on the associated text-based metadata of a media file, a human can understand the storyline. We can detect lipsync, recognize actors, emotions, and all the visual objects inside a frame. We can also listen to the language spoken, understand the story and do a translation into a new language.

Because of this common view on the differences between machine capabilities and human capabilities, it is still also quite common that production companies and similar, divide many tasks in a media supply chain between man and machine this way.

But times are changing, and they are changing fast. For any Content Owner, CTO or technical strategist building a modern media workflow, it is vital to challenge this traditional view on what machines can and cannot do.

Interview with Ralf Jansen Product Manager and Software Architect at Arvato / Vidispine To find out more on this subject, we talked to Ralf Jansen, Product Manager and Software Architect at Arvato / Vidispine AB. Ralf Jansen has a strong technical background, finished computer science degree with a Thesis Diploma at Fraunhofer Institute and has since worked as a developer and software architect in the industry for nearly the last 20 years. Today Ralf Jansen is managing the development of the new Vidinet Cognitive Services (VCS) and is part of the Vidinet partner success team.

So, Ralf, why is cognitive services important? Cognitive services allow the machine to find information inside the video and audio frame itself, very much like we humans can interpret the same content. This of course opens up important new possibilities depending on what type of workflow you are managing. A channel distributor can use cognitive services to automatically find (new) types of information in a huge amount of media content that could not be processed manually before - and thus use or present that insights to the viewer as a program, highlights, suggested shows or even as autogenerated trailers. Cognitive services carry this new information as metadata and give your MAM system new and much more granular methods of managing your media files. This is very important in the process of optimizing the performance and capabilities of your evolving media supply chain.

Revenue and how we can improve revenue are, of course, a driver for the advancement and adaption of cognitive services like for most other technology. And once you are getting familiar with the idea of challenging your common view on what machines can do - the subject of revenue by technology gets even more interesting.

In what areas could cognitive services improve existing revenue streams? Knowing and understanding the inside of your media opens many new opportunities that can improve revenue and help customers to monetize their owned media assets. The first one that comes to mind is of course speech to text - where cognitive services can in best case reach or even exceed the magical benchmark of human understanding (which is roughly at 5% error rate) depending on how purely spoken and what known vocabulary was used with automatic transcribe functionality already today. Automatic speech to text at this level not only free up human resources and saves money otherwise spent on external subtitling services, but also enables a new layer of time based metadata where you actually can navigate in time to find deep linked subjects, names and topics by simply searching the contents of your subtitling in your MAM systems accurate search capabilities and in our case powered by Elastic Search. And this is of course just one of many examples.

It is important to understand the value of temporal metadata since captured reality stored into the video (and audio) file changes every 30-60 frames per second or more - and because of temporal metadata we are able to define accurate time spans for different video and audio content detected by cognitive services. A post house ingesting reality content normally uses human resources for logging and preparing projects for the editors. In these and similar production workflows, the challenge is the huge amount of incoming raw footage that needs to be sorted a
LINK: https://www.vidispine.com/blog/why-vidispine-becomes-cognitive...
See more stories from vidispine

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

22/07/2026

Clear-Com Delivers Integrated Communications for Fryderyk Awards Gala in Krakw

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

22/07/2026

IAB Tech Lab Updates Podcast Technical Measurement Guidelines

Share Copy link Facebook X Linkedin Bluesky Email...

22/07/2026

FCC Adopts Plan for C-Band Auction in July 2027

Share Copy link Facebook X Linkedin Bluesky Email...

22/07/2026

LTN surpasses 3000 satellite-to-IP migrations as FCC vote...

Proven managed IP solution helps broadcasters confidently navigate the future of broadcast distribution LTN announces it has completed successful satellite-to-...

22/07/2026

Chaos Releases V-Ray 7 Update 4 Connecting Real-Time Work...

Today, Chaos announced V-Ray 7, update 4, eliminating the need for asset conversions and tool switching, which slow down media and entertainment pipelines. Arti...

22/07/2026

An AI playground for the Project Indigo camera app

An AI playground for the Project Indigo camera app Marc Levoy July 22, 2026 0 Comments At left is the user interface of our Playground, running on an ...

22/07/2026

RTS Chooses Custom Consoles Desks and MediaWalls for Stud...

Custom Consoles announces the completion of a large technical furniture project for Radio T l vision Suisse (RTS) at the networks recently inaugurated productio...

22/07/2026

Graham Media's WDIV Opens Satellite Newsroom/Coffee Shop

Share Copy link Facebook X Linkedin Bluesky Email...

22/07/2026

FCC Approves License Transfer of WTVQ-DT to Scripps

Share Copy link Facebook X Linkedin Bluesky Email...

22/07/2026

Spectrum Reach Expands Operations in N.Y.

Share Copy link Facebook X Linkedin Bluesky Email...

22/07/2026

Miris spatial streaming platform adds support for glTF in...

Culver City, CA, July 21, 2026 3D streaming infrastructure provider Miris today announced glTF intake, including the binary .glb form, to its spatial streamin...

22/07/2026

Documentary Lo Invisible Captured with Blackmagic PYXIS 6K

Documentary Lo Invisible Captured with Blackmagic PYXIS 6K Brie Clayton July 21, 2026 0 Comments Camera's versatile design allowed filmmakers to c...

22/07/2026

AAF Bridge converts AAF and XML Timelines to Ableton Live - and back

AAF Bridge converts AAF and XML Timelines to Ableton Live - and back Jerome Gardier July 21, 2026 0 Comments A two-way converter for macOS and Windows...

22/07/2026

From Class to Concert: Explore a Student-Led Production of David Bowies Work Through Photos

From Class to Concert: Explore a Student-Led Production of David Bowies Work Thr...

22/07/2026

Audio at Parity: Comscore Launches Transcript-Level Targeting and Measurement with Spotify, SiriusXM, Triton Digital, Acast, and Libysn

Audio at Parity: Comscore Launches Transcript-Level Targeting and Measurement wi...

22/07/2026

Arvato Systems and Lobster Enter into a Partnership

Arvato Systems and Lobster Enter into a Partnership and Combine the Integration Platform and Managed Services Flexible integration solutions for cloud, hybrid...

22/07/2026

RT PUBLISHES 2025 ANNUAL REPORT

RT REPORTS NET SURPLUS OF 22.5 MILLION IN 2025...

22/07/2026

Documentary on film censorship in Ireland coming to RT

In the Opinion of the Censor airs Monday 27 July at 9.35pm on RT One and RT Player In the Opinion of the Censor looks at how films for theatrical release wer...

22/07/2026

NVIDIA Open Sources First GPU-Accelerated Medical Physics Simulation Framework

Before a healthcare robot can be useful in the real world, it has to learn how the physical world pushes back. Anatomy varies. Instruments bend, press, slip and...

21/07/2026

High Interest, limited resources: AI in Mongolia's newsrooms

New research involving a cross-section of Mongolias independent media landscape finds enthusiasm for AI as a tool to improve efficiency, sustainability and resi...

21/07/2026

FIFA World Cup 2026: The Firsts, Breakthroughs, and Lasting Legacies

With winners Spain having already paraded the World Cup trophy through Madrid in front of millions of fans and the dust now settling on an epic tournament of th...

21/07/2026

NHL Launches Centralized Production Operation for Regional Broadcasts; Four Teams Aboard To Start

In a time of disarray in regional sports broadcasting, the league will provide c...

21/07/2026

With Boland Monitors, NEPs PGA TOUR Unit Ready for Future

When NEP designed one of its largest recurring mobile production unit fleets for PGA TOUR coverage, the leading media services provider faced a familiar challe...

21/07/2026

elysia Channex Studio now available

High-end analogue channel strip boasts plug-in recall Originally revealed as a prototype back at NAMM 2024, the Channex Studio channel strip represented a b...

21/07/2026

Musik Hack announce HyFi mastering platform

Relies on same DSP as plug-in range Musik Hack's line-up has been influenced heavily by founder Stan Greene's work as a mixing engineer, and their M...

21/07/2026

Dirty Boy Jr. Series from Warm Audio

Official collaboration with boutique builder Dirty Boy Pedals Warm Audio have just announced the launch of a new guitar pedal range created in collaboration...

21/07/2026

SBS scores biggest ever FIFA World Cup Reach as Spain triumph in the final

SBS scores biggest ever FIFA World Cup Reach as Spain triumph in the final 21 July, 2026 Media releases Spain v Argentina attracted a Total TV reach of al...

21/07/2026

Rohde & Schwarz showcases broad range of EMC test solutions at EMC+SIPI 2026 in Dallas, Texas

Rohde & Schwarz showcases broad range of EMC test solutions at EMC SIPI 2026 in ...

21/07/2026

TVP Claims Top Spot as the World Cup and the Opole Music Festival Drive June Viewership in Poland

Warner Bros. Discovery's unbroken lead is interrupted as sports and live mus...

21/07/2026

Savannah Bananas Tap Calrec to Expand Banana Ball TV Coverage

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

Where Growth Takes Root Viaccess-Orca Showcases the Found...

Across the TV and streaming ecosystem, industry players face mounting pressure to do more with less. They must simplify operations, protect premium content and ...

21/07/2026

Tuxera breaks performance ceilings and brings SMB/NFS mul...

Tuxera, a leading prover of quality-assured file systems and networking technologies, is bringing its latest advances in connectivity performance to the media w...

21/07/2026

COW Jobs: Apple Motion Expert for Custom FCP Rigged Graphics Package

COW Jobs: Apple Motion Expert for Custom FCP Rigged Graphics Package Brie Clayton July 21, 2026 0 Comments HIRING: Apple Motion Expert for Custom FCP ...

21/07/2026

Cinegy directly addresses the real issues of software-def...

Cinegy GmbH, the premier provider of software-defined television technology, will use its presence at IBC2026 (stand 7.A01, Amsterdam RAI, 11 14 September) to...

21/07/2026

Calrec brings leading audio solutions and long term busin...

Calrec will be located in Hall 8, on Stand C47 Beyond bigger For years, broadcast facilities were built around one assumption: provision for the biggest pro...

21/07/2026

Pebble takes the next step towards the future of media de...

Pebble, the leading automation, content management and integrated channel specialist, will discuss its future-facing developments for the new generation of medi...

21/07/2026

nxtedition Brings Production, AI and Automation Together...

nxtedition returns to IBC2026 with its consolidated production platform, showing how scripting, editing, graphics, AI-assisted tools and automation can work wit...

21/07/2026

Big Blue Marble brings C2PA Content Credentials to Cloud...

C2PA content signing helps broadcasters, public institutions, and publishers give audiences a verifiable record of where their video content came from and how i...

21/07/2026

HDHomeRun Enables Operation During Internet Outages

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

Calif. Federal Judge Pauses Paramount-WBD Merger

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

AWARN Rebuts Weigel Claims of 3.0 EAS Problems

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

FCC Announces Tentative Agenda for August Open Meeting

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

VIDA Introduces QC Manager for Collaborative Quality Cont...

New capability centralizes collaboration, feedback, security and status tracking within VIDA, providing a structured, auditable approach to master quality contr...

21/07/2026

Lightcraft Launches Exclusive Spark Story Beta for Filmmakers and Creators at SIGGRAPH 2026

Lightcraft Launches Exclusive Spark Story Beta for Filmmakers and Creators at SI...

21/07/2026

Indie Road Movie Where in the Hell Shot with Pocket Cinema Camera 4K

Indie Road Movie Where in the Hell Shot with Pocket Cinema Camera 4K Brie Clayton July 20, 2026 0 Comments Colorist blends vintage film looks to shape...