
Vision and hearing are your main senses when experiencing a movie. You recognize the actors, you understand the spoken language even if it is not your native language. You follow the story and enjoy the amazing film photo of the different environments - and by sharing all these experiences you can not only relate to the movie itself but also convince your friend to see the movie.
Wouldn't it be great if your Media Asset Management system could possess similar capabilities when managing your media? Being able to understand the language? Recognize actors, detect and define parts of the image - maybe also differentiate between genres? But how?
In order to do this you need a system that can actually see and listen what's inside your media - you need a system that has cognitive capabilities like yourself and can store that info in - yes, you guessed right - metadata.
But how do we navigate our vastly growing archives of file-based media?
Media files themselves today includes a lot of metadata already in a descriptive format. In here, there is room for all general metadata as well as technical metadata describing the actual file structures. MAM (Media Asset Management) systems make use of this existing metadata along with additional layers of metadata frameworks to help you navigate, find and tag not only media files themselves but also the time-based intervals of the media.
Because of this, you can argue that the true definition of a media file must include an audio-visual asset AND an associated metadata description. Without one or the other - the asset is not complete.
Cognitive Metadata to boldly go where no MAM has gone before Traditionally, the common notion is that while a machine can read and act on the associated text-based metadata of a media file, a human can understand the storyline. We can detect lipsync, recognize actors, emotions, and all the visual objects inside a frame. We can also listen to the language spoken, understand the story and do a translation into a new language.
Because of this common view on the differences between machine capabilities and human capabilities, it is still also quite common that production companies and similar, divide many tasks in a media supply chain between man and machine this way.
But times are changing, and they are changing fast. For any Content Owner, CTO or technical strategist building a modern media workflow, it is vital to challenge this traditional view on what machines can and cannot do.
Interview with Ralf Jansen Product Manager and Software Architect at Arvato / Vidispine To find out more on this subject, we talked to Ralf Jansen, Product Manager and Software Architect at Arvato / Vidispine AB. Ralf Jansen has a strong technical background, finished computer science degree with a Thesis Diploma at Fraunhofer Institute and has since worked as a developer and software architect in the industry for nearly the last 20 years. Today Ralf Jansen is managing the development of the new Vidinet Cognitive Services (VCS) and is part of the Vidinet partner success team.
So, Ralf, why is cognitive services important? Cognitive services allow the machine to find information inside the video and audio frame itself, very much like we humans can interpret the same content. This of course opens up important new possibilities depending on what type of workflow you are managing. A channel distributor can use cognitive services to automatically find (new) types of information in a huge amount of media content that could not be processed manually before - and thus use or present that insights to the viewer as a program, highlights, suggested shows or even as autogenerated trailers. Cognitive services carry this new information as metadata and give your MAM system new and much more granular methods of managing your media files. This is very important in the process of optimizing the performance and capabilities of your evolving media supply chain.
Revenue and how we can improve revenue are, of course, a driver for the advancement and adaption of cognitive services like for most other technology. And once you are getting familiar with the idea of challenging your common view on what machines can do - the subject of revenue by technology gets even more interesting.
In what areas could cognitive services improve existing revenue streams? Knowing and understanding the inside of your media opens many new opportunities that can improve revenue and help customers to monetize their owned media assets. The first one that comes to mind is of course speech to text - where cognitive services can in best case reach or even exceed the magical benchmark of human understanding (which is roughly at 5% error rate) depending on how purely spoken and what known vocabulary was used with automatic transcribe functionality already today. Automatic speech to text at this level not only free up human resources and saves money otherwise spent on external subtitling services, but also enables a new layer of time based metadata where you actually can navigate in time to find deep linked subjects, names and topics by simply searching the contents of your subtitling in your MAM systems accurate search capabilities and in our case powered by Elastic Search. And this is of course just one of many examples.
It is important to understand the value of temporal metadata since captured reality stored into the video (and audio) file changes every 30-60 frames per second or more - and because of temporal metadata we are able to define accurate time spans for different video and audio content detected by cognitive services. A post house ingesting reality content normally uses human resources for logging and preparing projects for the editors. In these and similar production workflows, the challenge is the huge amount of incoming raw footage that needs to be sorted a
Most recent headlines
06/10/2025
France T l visions, France's leading broadcaster, has received the 2025 EBU ...
04/09/2025
Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...
30/06/2025
There's nothing quite like the magic of finding music that feels made just f...
30/06/2025
When it comes to new music, Spotify's team of editors across North America is always on the hunt for songs that make them feel, think, and move. They're...
30/06/2025
SBS On Demand boosts global news offering with launch of France 24 FAST Channel
30 June, 2025
Media releases
SBS is expanding its international news offeri...
30/06/2025
Star Studded Ensemble Cast Are Joined by Richard Rankin as Filming Begins on the Second Season
[June 12, 2025 - Boston, MA]: The Forsytes, Debbie Horsfield...
30/06/2025
The Artemis II Space Launch System core stage is integrated with the solid rocket boosters inside High Bay 3 of the Vehicle Assembly Building at NASAs Kennedy S...
30/06/2025
RALEIGH, N.C. Capitol Broadcasting Co. has named Heather Gray vice president and general manager of WRAL-TV and WRAZ-TV here....
30/06/2025
The Virginia Association of Broadcasters has recognized Bill Sewell, Director of Engineering at WTKR & WGNT in Norfolk, Va. as the recipient of the 2025 J.J. Fr...
30/06/2025
The Society of Broadcast Engineers said its annual member drive resulted in the recruitment of 49 individual members....
30/06/2025
BURLINGTON, Mass. Avid today released its fully integrated news platform, uniting MediaCentral and Wolftech News in a single newsroom solution, and will demonst...
30/06/2025
WASHINGTON The Federal Communication's Enforcement and Media Bureaus have entered into a Consent Decree with Sinclair Broadcast Group to resolve a variety o...
30/06/2025
Eurorack sequencer module reimagined
California-based modular synth innovators Qu-Bit have announced the launch of a new module that offers a fresh new take...
30/06/2025
Berklee at Umbria Jazz Clinics to Host 40th Anniversary Concert The celebration will be held on July 10 in Perugia, Italy.
By
Colette Greenstein
June 30, 202...
30/06/2025
PremiumBeat Tips and Tricks
Brie Clayton June 30, 2025
0 Comments
When editing to impress, you'll need quality music, and if your studio happens t...
30/06/2025
Improved dynamic behaviour, improved audio quality & more
Techivation have announced the release of an upgraded edition of their very first premium plug-in,...
30/06/2025
German premiere with live flight demonstration: German industry team showcases e...
30/06/2025
Back to All News
Bel n Cuesta and Karra Elejalde Star in El ni o, the New Film ...
30/06/2025
Back to All News
A New Dangerous Troll Awakens: Netflix Unleashes Teaser for Troll 2Play Video
Play Video
Entertainment
30 June 2025
GlobalNorwayDenmarkSwe...
30/06/2025
The Focusrite Summer Sale is now on Don't miss unbeatable deals on Scarlett, Vocaster, and more.
Whether you're an artist, a producer, or a podcaste...
30/06/2025
All 8 episodes of Season 1 of 1923 will be available on RT Player from Tuesday ...
30/06/2025
Facebook
Twitter
LinkedIn
52% report AI security spending is displacing tr...
30/06/2025
Facebook
Twitter
LinkedIn
Cannes, June 30th, 2025 - Thales Alenia Space, t...
29/06/2025
Handpan-inspired instrument announced
Roland have announced the launch of the Mood Pan, a unique electronic hand percussion instrument that has been designe...
29/06/2025
Back to All News
A Secret Society, Ritualistic Killings, and a Century-Old Curs...
28/06/2025
Johannesburg, 27 June 2025 - As the nation commemorates Youth Month
2025, the N...
28/06/2025
WASHINGTON In a press conference following the Federal Communications Commission's May Open Meeting, Chair Brendan Carr promised the agency would move rapid...
28/06/2025
STAMFORD, Conn. Charter Communications has awarded $1.1 million in Spectrum Digital Education grants to 55 nonprofit organizations that work to expand access to...
28/06/2025
LAKE FOREST, Calif. June 19, 2025
What's New:
Sonnet Technologies today announced the certification of its Echo 20 Thunderbolt 4 SuperDock as an Engin...
28/06/2025
MASV (massive.io), the fastest and most reliable large file transfer platform for media professionals, has been named an IDC Innovator in the IDC Innovators: Me...
28/06/2025
Grass Valley today announced that TV SKYLINE GmbH, one of Europe's top mobile production providers, has expanded its camera inventory with 30 LDX 135 UHD/HD...
28/06/2025
AgileTV, a European leader in TV and video technology solutions, signed an agreement with Austrian telco LIWEST to develop and implement its TV service in Austr...
28/06/2025
Music theory plug-in updated
Three months on from the release of the latest version of their renowned music theory plug in, Scaler Music have launched an up...
28/06/2025
The 48th Annual Indian National Finals Rodeo Shot with Blackmagic PYXIS 6K
Brie Clayton June 27, 2025
0 Comments
Filmmaker Cameron Mackey relied on Bl...
28/06/2025
Social, Streaming Don't Compete, They Compliment
Andy Marken June 27, 2025
0 Comments
I think we've all arrived at a very special place. Spir...
28/06/2025
Blackmagic Design Captures Filipino Rock Band Drama Singtala
Brie Clayton June 27, 2025
0 Comments
Blackmagic URSA Mini Pro 12K and DaVinci Resolve St...
28/06/2025
Enhance Videos Faster with Aiarty Video Enhancer - Offline, Sharp, and Natural
Brie Clayton June 27, 2025
0 Comments
If you've used AI video tools...
27/06/2025
By Jessica Herndon
One of the most exciting things about the Sundance Film Fest...
27/06/2025
K-Pop remains one of the biggest genres globally, and many fans just can't get enough of it. That's why Spotify has launched a new series of K-Pop perf...
27/06/2025
In our latest blog post, Rafael Rivera highlights the rising threat of online scams, and the important role cybersecurity plays in protecting families across ge...
27/06/2025
WASHINGTON The Federal Communications Commission has set deadlines for comments to a notice of proposed rulemaking (NPRM) to codify certain foreign ownership re...
27/06/2025
WASHINGTON In a press conference following the Federal Communications Commission's May Open Meeting, Chair Brendan Carr promised the agency would move rapid...
27/06/2025
From grounded realism to bending, impossible geometries
Klevgrand have announced the release of a new algorithmic reverb plug-in which they say deconstruct...
27/06/2025
Learn to use REW for room analysis
Acoustic treatment is one of the most important factors in any studio, and with the extensive range of products available...
27/06/2025
SAN JOSE, Calif. The HDMI Forum has released Version 2.2. of the HDMI Specification with 96Gbps bandwidth and next-gen HDMI Fixed Rate Link technology to provid...
27/06/2025
MONTREAL Grass Valley has announced that TV Skyline GmbH, one of Europe's top mobile production providers, has expanded its camera inventory with the acquis...
27/06/2025
NEW YORK & CHICAGO FuboTV Inc. and Weigel Broadcasting Co. have announced a multi-year agreement for distribution of seven networks including MeTV, H&I, Movies!...
27/06/2025
NEW YORK A national survey of U.S. consumers shows 66% of us watch TV all or most of the time and also multitask while doing it....
27/06/2025
MIAMI Sunbeam Television has reached a multiyear agreement with Findal Media & Technology Group to broadcast the new ABC Miami beginning Aug. 4....
27/06/2025
STATE COLLEGE, Pa. AccuWeather has announced a deal with Perplexity, a AI-powered search and answer engine, that will bring AccuWeathers weather data and severe...