Sony Pixel Power calrec Sony

Why Vidispine becomes cognitive

04/05/2020

Vision and hearing are your main senses when experiencing a movie. You recognize the actors, you understand the spoken language even if it is not your native language. You follow the story and enjoy the amazing film photo of the different environments - and by sharing all these experiences you can not only relate to the movie itself but also convince your friend to see the movie.

Wouldn't it be great if your Media Asset Management system could possess similar capabilities when managing your media? Being able to understand the language? Recognize actors, detect and define parts of the image - maybe also differentiate between genres? But how?

In order to do this you need a system that can actually see and listen what's inside your media - you need a system that has cognitive capabilities like yourself and can store that info in - yes, you guessed right - metadata.

But how do we navigate our vastly growing archives of file-based media?

Media files themselves today includes a lot of metadata already in a descriptive format. In here, there is room for all general metadata as well as technical metadata describing the actual file structures. MAM (Media Asset Management) systems make use of this existing metadata along with additional layers of metadata frameworks to help you navigate, find and tag not only media files themselves but also the time-based intervals of the media.

Because of this, you can argue that the true definition of a media file must include an audio-visual asset AND an associated metadata description. Without one or the other - the asset is not complete.

Cognitive Metadata to boldly go where no MAM has gone before Traditionally, the common notion is that while a machine can read and act on the associated text-based metadata of a media file, a human can understand the storyline. We can detect lipsync, recognize actors, emotions, and all the visual objects inside a frame. We can also listen to the language spoken, understand the story and do a translation into a new language.

Because of this common view on the differences between machine capabilities and human capabilities, it is still also quite common that production companies and similar, divide many tasks in a media supply chain between man and machine this way.

But times are changing, and they are changing fast. For any Content Owner, CTO or technical strategist building a modern media workflow, it is vital to challenge this traditional view on what machines can and cannot do.

Interview with Ralf Jansen Product Manager and Software Architect at Arvato / Vidispine To find out more on this subject, we talked to Ralf Jansen, Product Manager and Software Architect at Arvato / Vidispine AB. Ralf Jansen has a strong technical background, finished computer science degree with a Thesis Diploma at Fraunhofer Institute and has since worked as a developer and software architect in the industry for nearly the last 20 years. Today Ralf Jansen is managing the development of the new Vidinet Cognitive Services (VCS) and is part of the Vidinet partner success team.

So, Ralf, why is cognitive services important? Cognitive services allow the machine to find information inside the video and audio frame itself, very much like we humans can interpret the same content. This of course opens up important new possibilities depending on what type of workflow you are managing. A channel distributor can use cognitive services to automatically find (new) types of information in a huge amount of media content that could not be processed manually before - and thus use or present that insights to the viewer as a program, highlights, suggested shows or even as autogenerated trailers. Cognitive services carry this new information as metadata and give your MAM system new and much more granular methods of managing your media files. This is very important in the process of optimizing the performance and capabilities of your evolving media supply chain.

Revenue and how we can improve revenue are, of course, a driver for the advancement and adaption of cognitive services like for most other technology. And once you are getting familiar with the idea of challenging your common view on what machines can do - the subject of revenue by technology gets even more interesting.

In what areas could cognitive services improve existing revenue streams? Knowing and understanding the inside of your media opens many new opportunities that can improve revenue and help customers to monetize their owned media assets. The first one that comes to mind is of course speech to text - where cognitive services can in best case reach or even exceed the magical benchmark of human understanding (which is roughly at 5% error rate) depending on how purely spoken and what known vocabulary was used with automatic transcribe functionality already today. Automatic speech to text at this level not only free up human resources and saves money otherwise spent on external subtitling services, but also enables a new layer of time based metadata where you actually can navigate in time to find deep linked subjects, names and topics by simply searching the contents of your subtitling in your MAM systems accurate search capabilities and in our case powered by Elastic Search. And this is of course just one of many examples.

It is important to understand the value of temporal metadata since captured reality stored into the video (and audio) file changes every 30-60 frames per second or more - and because of temporal metadata we are able to define accurate time spans for different video and audio content detected by cognitive services. A post house ingesting reality content normally uses human resources for logging and preparing projects for the editors. In these and similar production workflows, the challenge is the huge amount of incoming raw footage that needs to be sorted a
LINK: https://www.vidispine.com/blog/why-vidispine-becomes-cognitive...
See more stories from vidispine

Most recent headlines

04/08/2024

Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation

Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....

21/07/2024

Intesis by HMS Networks achieves the prestigious Great Place to Work Spain Certification with top rankings

Intesis by HMS Networks achieves the prestigious Great Place to Work Spain Certi...

20/07/2024

Comcast NBCU to Provide Service Members with Free Streaming of Olympics

DALLAS Comcast NBCUniversal has announced that once again, service members and honorably discharged Veterans worldwide will enjoy free access to NBCUniversal...

20/07/2024

SES Expands Partnership with Ateme for Sports and Live Events

PARIS Ateme, a global provider of video compression, delivery, and streaming solutions, says longtime partner SES is integrating its technology to improve and s...

20/07/2024

Google Named the Official Search AI Partner of Team USA

NEW YORK Google, Team USA and NBCUniversal have announced a sponsorship agreement naming Google as the Official Search AI Partner of Team USA....

20/07/2024

LiveU, Pente Networks Launch LiveU Private Connectivity

HACKENSACK, N.J. As broadcasters and news organizations look for more reliable connectivity for their coverage of this year's elections, LiveU is reporting ...

20/07/2024

CBS Sports and Serie A Renew U.S. Media Rights Agreement

NEW YORK Following a recent deal for English Football League rights, CBS Sports continues to bulk up on international soccer rights, with a multi-platform, two-...

20/07/2024

Optimum Reaches Multi-Year Extension with Gray Media

NEW YORK Altice USA's Optimum pay TV operations and Gray Media have agreed to a multi-year extension of their retransmission consent agreement....

20/07/2024

FOR-A to Spotlight Software-Defined IP Solutions At IBC Show

BRUGHERIO, Italy FOR-A will show spotlight software-defined IP solutions and hybrid production at the IBC Show, Sept. 13-16, at the RAI Amsterdam Convention Cen...

20/07/2024

Perifery Introduces AI+ 2.0 Suite of Tools

FT. LAUDERDALE, Fla. Perifery has launched AI+ 2.0, an AI-powered suite for media professionals to revitalize their existing content libraries with AI-generated...

20/07/2024

nxtedition unveils XR mixed reality studio control and ne...

Innovator in live production environments, nxtedition, will showcase its agile microservices-based approach to storytelling on stand 7.A02 at IBC2024 from 13-16...

20/07/2024

Viaccess-Orca IBC 2024 Exhibitor Preview

In today s competitive landscape, the diverse needs and distinct value-chain challenges within the video delivery ecosystem demand effective, flexible solutions...

20/07/2024

Broadpeak Brings Dynamic Ad Insertion Innovations and New...

Broadpeak , a global expert in video delivery with more than 150 customers serving more than 200 million end users worldwide, will highlight how it is elevating...

20/07/2024

Interra Systems to Present Companys Cutting-Edge Media QC...

Interra Systems, the leading provider of end-to-end quality assurance solutions to the digital media industry, will showcase its latest innovations in content-a...

20/07/2024

WRC Promoter Chooses Moments Lab to Drive Innovation in M...

Leading AI and video search company Moments Lab (formerly Newsbridge), is pleased to announce its partnership with WRC Promoter GmbH, the organization responsib...

20/07/2024

LiveU and Pente Networks Democratize Private Cellular Net...

The race to the US Presidential Election continues to heat up further this summer with the recent Republican National Convention this week in Wisconsin and the ...

20/07/2024

Cinegy Brings Cloud Monetization and Delivery and AI-powe...

Launch of new Air playout, automation and delivery platform bundles, Air Pack and Air Infinity; new AI-powered automatic subtitling; first IBC showing of Cinegy...

20/07/2024

Cine Gear Expo Names 2024 Tech Award and Film Competition...

Nearly one-hundred companies submitted and presented their newest technologies for the Cine Gear Expo 2024 Technical Awards. Cine Gear's team of expert judg...

20/07/2024

Matthews Studio Equipment Debuts Patriot Wrench

Matthews Studio Equipment announces new Patriot Wrench, a breakthrough tool for on set efficiency. The versatile wrench features the seven most common, industry...

20/07/2024

ViewNexa powers AZA Group and BlaCon Medias content portf...

Bitcentral, the leading provider of professional media solutions for broadcast and digital video, today announces that AZA Group, a specialist in broadcast engi...

20/07/2024

Perifery Launches AI solution to Revitalize and Monetize...

Perifery , a division of DataCore, has today announced the launch of AI 2.0, a transformational AI-powered solution suite designed to enable media professional...

20/07/2024

CVP Showcases New Production Solutions at Summer Kit Fest

Happening on 24-25 July, the Summer Kit Fest is the perfect event to get hands-on with the newest kit from over 50 top brands CVP, one of Europe's leading...

20/07/2024

FOR-A Showcases Software-Defined IP Solutions and Hybrid...

FOR-A, a leading manufacturer of broadcast and production technology, will present its latest innovations in IP-based and hybrid workflows at IBC2024. The compa...

20/07/2024

Cine Gear Expo Names 2024 Tech Award & Film Competition Winners

Cine Gear Expo Names 2024 Tech Award & Film Competition Winners Brie Clayton July 19, 2024 0 Comments Nearly one-hundred companies submitted and prese...

19/07/2024

Sundance Institute Announces Finalists in RFP Process

Six cities selected to move forward in the next phase of the process...

19/07/2024

Partnering With Industry To Create a Safer Online Environment for Young People

By Marcelina Slota - Head of Platform Integrity, Spotify Safety is a top priority for Spotify, which is why we want to make it easier for young people and pare...

19/07/2024

L3Harris launches PilotApp - redefining flight data intelligence for aviation safety and efficiency

L3Harris Commercial Aviation has launched PilotApp, designed to empower pilots w...

19/07/2024

L3Harris Secures Avionics Contract with Air India for Next-Generation Voice and Data Recorders

L3Harris Technologies announce a landmark agreement with Air India to become lea...

19/07/2024

Comcast to Offer 'Enhanced 4K Coverage of Paris Olympics on USA Network

PHILADELPHIA Comcast has unveiled new details of its plans for offering enhanced 4K from Xfinity and said that its first enhanced 4K feeds will be available as...

19/07/2024

Sky News UK Among Global Broadcasters Hit by IT Outage

Sky News UK and Sky Sports News have been taken off air by what's being described as the biggest IT outage of all time'....

19/07/2024

FCC Adopts R&O To Make Closed Captioning Settings Easy To Access

WASHINGTON, D.C. Watching television for those with hearing-impairments will become a bit easier following adoption July 18 of a Federal Communications Commissi...

19/07/2024

Perifery Launches AI+ 2.0 to Revitalize and Monetize Media Content

Perifery Launches AI 2.0 to Revitalize and Monetize Media Content Brie Clayton July 19, 2024 0 Comments Advanced AI Software Suite Enables Users to L...

19/07/2024

Comcast NBCU Will Provide Free Olympics Stream for Military Community

Comcast NBCUniversal said it is working with the Army & Air Force Exchange Service to provide military community members with free streaming of NBCU's cover...

19/07/2024

Tom Fenton, Dean of American Foreign Correspondents,' Has Died

Tom Fenton, former CBS News correspondent, died July 16 in Novato, California. He was 94....

19/07/2024

Local News Close-Up: Capital Gains in Albany, New York

The lawmakers who make up the state legislature in Albany, New York, headed home at the end of June, but there's still plenty going on in the Capital Region...

19/07/2024

Access Hollywood' Heads to Paris

Access Hollywood and Access Daily with Mario & Kit will start previewing the 2024 Paris Summer Olympics starting Monday, July 22 with a week of special programm...

19/07/2024

NBCU Transforms Rockefeller Center Into Paris-Themed Olympic Hub

NBCUniversal is turning Rockefeller Center, its base in midtown Manhattan, into what it calls a hub for Team USA fans during the Olympics. That includes Parisia...

19/07/2024

Anchor Tom Garris Jumps From WTAE Pittsburgh to WMUR Manchester (NH)

Tom Garris, weekend morning anchor and weekday reporter at WTAE Pittsburgh, is moving to WMUR in Manchester, New Hampshire. Both are part of Hearst Television a...

19/07/2024

Comcast to Offer Enhanced 4K Coverage of Paris Olympics on USA Network

PHILADELPHIA Comcast has unveiled new details of its plans for offering enhanced 4K from Xfinity and said that its first enhanced 4K feeds will be available as...

19/07/2024

Opinion: Powering digital linear channel creation in the FAST era

Rick Young, SVP head of global products at LTN, explains the importance of innovation in driving audience growth strategies By Contributor Published: July 17...

19/07/2024

Arena Television liquidators launch 285 million claim against Lloyds Bank'

According to court documents, of the 8,196 assets that had loans outstanding against them when Arena collapsed, only 66 existed By Jenny Priestley Publishe...

19/07/2024

A Smart Z-Finder Review: Transforming the small screen of a smartphone into a powerful tool

The Zacuto Smart Z-Finder is an innovative viewfinder designed for smartphone fi...

19/07/2024

Altice USA Launches $30 a Month 'Entertainment TV'

NEW YORK Altice USA's Optimum is launching Entertainment TV, a new internet TV package of 80 plus channels for $30 a month that is available exclusively on ...

19/07/2024

Calrec Celebrates Diamond Jubilee with New Audio Tech at IBC 2024

As it celebrates its diamond jubilee this year, Calrec has announced that it will be pushing the boundaries of audio broadcasting at IBC 2024 with a full range ...

19/07/2024

CBS Sports Inks Multi-Platform Rights Deal with English Football League

NEW YORK CBS Sports and the English Football League (EFL) have announced an exclusive, multi-year, multi-platform rights agreement that will see CBS Sports offe...

19/07/2024

Netflix Subs Hit 277.6M as Revenue and Profits Spike

LOS GATOS, Calif. Netflix posted very strong Q2 2024 financials, with global Netflix subs growing 16.5% to 277.65 million, revenue up 17% and operating income s...

19/07/2024

ALIBI Music Sets the Tone for True Crime with New Underscores and Drones

ALIBI Music Sets the Tone for True Crime with New Underscores and Drones Brie Clayton July 18, 2024 0 Comments These seven production music albums rat...

19/07/2024

Christmas is Coming to Ting Park and Guy Stadium This Weekend

Only a Few More Chances to see the Salamanders and Yard Gnomes This Year The Holly Springs Salamanders have another big weekend coming up at Ting Park! Join t...

19/07/2024

Paramount Advertising Launches Self-Service Platform for Smaller Businesses

Paramount Advertising said it launched its self-serve ad buying platform, designed to attract more ad dollars from small and mid-sized businesses and other mark...

19/07/2024

Brian Lesser Returns To GroupM as Global CEO

Brian Lesser was named Global CEO of GroupM, the big media buying company that is part of WPP....