Why Vidispine becomes cognitive
04/05/2020
Wouldn't it be great if your Media Asset Management system could possess similar capabilities when managing your media? Being able to understand the language? Recognize actors, detect and define parts of the image - maybe also differentiate between genres? But how?
In order to do this you need a system that can actually see and listen what's inside your media - you need a system that has cognitive capabilities like yourself and can store that info in - yes, you guessed right - metadata.
But how do we navigate our vastly growing archives of file-based media?
Media files themselves today includes a lot of metadata already in a descriptive format. In here, there is room for all general metadata as well as technical metadata describing the actual file structures. MAM (Media Asset Management) systems make use of this existing metadata along with additional layers of metadata frameworks to help you navigate, find and tag not only media files themselves but also the time-based intervals of the media.
Because of this, you can argue that the true definition of a media file must include an audio-visual asset AND an associated metadata description. Without one or the other - the asset is not complete.
Cognitive Metadata to boldly go where no MAM has gone before Traditionally, the common notion is that while a machine can read and act on the associated text-based metadata of a media file, a human can understand the storyline. We can detect lipsync, recognize actors, emotions, and all the visual objects inside a frame. We can also listen to the language spoken, understand the story and do a translation into a new language.
Because of this common view on the differences between machine capabilities and human capabilities, it is still also quite common that production companies and similar, divide many tasks in a media supply chain between man and machine this way.
But times are changing, and they are changing fast. For any Content Owner, CTO or technical strategist building a modern media workflow, it is vital to challenge this traditional view on what machines can and cannot do.
Interview with Ralf Jansen Product Manager and Software Architect at Arvato / Vidispine To find out more on this subject, we talked to Ralf Jansen, Product Manager and Software Architect at Arvato / Vidispine AB. Ralf Jansen has a strong technical background, finished computer science degree with a Thesis Diploma at Fraunhofer Institute and has since worked as a developer and software architect in the industry for nearly the last 20 years. Today Ralf Jansen is managing the development of the new Vidinet Cognitive Services (VCS) and is part of the Vidinet partner success team.
So, Ralf, why is cognitive services important? Cognitive services allow the machine to find information inside the video and audio frame itself, very much like we humans can interpret the same content. This of course opens up important new possibilities depending on what type of workflow you are managing. A channel distributor can use cognitive services to automatically find (new) types of information in a huge amount of media content that could not be processed manually before - and thus use or present that insights to the viewer as a program, highlights, suggested shows or even as autogenerated trailers. Cognitive services carry this new information as metadata and give your MAM system new and much more granular methods of managing your media files. This is very important in the process of optimizing the performance and capabilities of your evolving media supply chain.
Revenue and how we can improve revenue are, of course, a driver for the advancement and adaption of cognitive services like for most other technology. And once you are getting familiar with the idea of challenging your common view on what machines can do - the subject of revenue by technology gets even more interesting.
In what areas could cognitive services improve existing revenue streams? Knowing and understanding the inside of your media opens many new opportunities that can improve revenue and help customers to monetize their owned media assets. The first one that comes to mind is of course speech to text - where cognitive services can in best case reach or even exceed the magical benchmark of human understanding (which is roughly at 5% error rate) depending on how purely spoken and what known vocabulary was used with automatic transcribe functionality already today. Automatic speech to text at this level not only free up human resources and saves money otherwise spent on external subtitling services, but also enables a new layer of time based metadata where you actually can navigate in time to find deep linked subjects, names and topics by simply searching the contents of your subtitling in your MAM systems accurate search capabilities and in our case powered by Elastic Search. And this is of course just one of many examples.
It is important to understand the value of temporal metadata since captured reality stored into the video (and audio) file changes every 30-60 frames per second or more - and because of temporal metadata we are able to define accurate time spans for different video and audio content detected by cognitive services. A post house ingesting reality content normally uses human resources for logging and preparing projects for the editors. In these and similar production workflows, the challenge is the huge amount of incoming raw footage that needs to be sorted a
LINK: | https://www.vidispine.com/blog/why-vidispine-becomes-cognitive... |
See more stories from vidispine |
Most recent headlines
09/12/2024
Dalet Named an IDC Innovator in Media and Entertainment
Dalet, a leading technology and service provider for media-rich organizations, today announced that it has been named an IDC Innovator in the IDC Innovators: ...
09/11/2024
Dalet Expands Leadership Team to Fuel Next Stage of Growth
Dalet, a leading technology and service provider for media-rich organizations, today announced three new members of its executive team. Tara Bryant joins as Chi...
30/10/2024
Drone detection just got a whole lot smarter with ARDRONIS Detect from Rohde & Schwarz
Drone detection just got a whole lot smarter with ARDRONIS Detect from Rohde & S...
26/10/2024
Kelsea Ballerini and Spotify Host Intimate Listening Party To Celebrate Her New Album, PATTERNS'
I love New York City, but I can't stay at the Carlyle anymore, sings Kelsea...
26/10/2024
USA Cheer Adopts NBC Sports Next's SportsEngine Motion
MINNEAPOLIS NBC Sports Next has announced a multiyear technology agreement with USA Cheer, the governing body for sport cheering in the U.S. The organization an...
26/10/2024
Canada's MSCTV Chooses Witbe Virtual NOC for Monitoring
NEW YORK Witbe has announced that Mitchell Seaforth Cable TV (MSCTV), a Dublin, Ontario, Canada-based provider of solutions to telecommunications companies, is ...
26/10/2024
IAB Tech Lab Launches Ad Format Idol' Initiative
NEW YORK The IAB Tech Lab has launched Ad Format Idol, an initiative to standardize emerging connected TV ad formats....
26/10/2024
T-Mobile Pledges Up to $1 Million for Ongoing Hurricane Recovery Efforts
BELLEVUE, Wash. T Mobile has announced a Rally for Relief effort to help those impacted by recent hurricanes. As part of the campaign, the cellphone carrier sai...
26/10/2024
Comercio TV Taps Broadpeak for OTT Video Delivery and Monetization
CESSON-SEVIGNE, France Broadpeak said Comercio TV, the Spanish-language OTT financial-news channel, has adopted its's software-as-a-service (SaaS) platform ...
26/10/2024
Africana Studies at Berklee to Induct Kid 'n Play into Berklee's Hip-Hop Hall of Fame
Africana Studies at Berklee to Induct Kid 'n Play into Berklee's Hip-Hop...
25/10/2024
What to Watch: These 7 DFP-Supported Films From 2024 Will Inspire You to Organize for Change
It's easy to become overwhelmed when thinking about the current state of the...
25/10/2024
Fall in Love With Your Monster
PARK CITY, UTAH - JANUARY 18: (L-R) Tommy Dewey, Melissa Barrera, Kayla Foster, Meghann Fahy, and Edmund Donovan attend the 2024 Sundance Film Festival Your Mo...
25/10/2024
How Matthew Belloni Preps for a Live Recording of His Hit Ringer Podcast, The Town'
Curious about what's going on behind the scenes in Hollywood? Odds are Matth...
25/10/2024
SBS celebrates the Festivals of Lights with distinctive content to entertain all Australians
SBS celebrates the Festivals of Lights with distinctive content to entertain all...
25/10/2024
L3Harris Technologies Reports Strong Third Quarter 2024 Results, Increases 2024 Guidance
Highlights* Orders of $7.2 billion; book-to-bill of 1.4x Revenue of $5.3 billi...
25/10/2024
L3Harris, Palantir CEOs Discuss Strategic Partnership on CNBC's "Closing Bell: Overtime"
On Oct. 24, Chris Kubasik and Alex Karp sat down with CNBC's Morgan Brennan ...
25/10/2024
Meta Quest to Offer 52 NBA Games in VR for 2024-2025 Season
Meta Quest, a division of Facebook owner Meta, has announced it will continue its virtual reality broadcasts of regular-season NBA games for the fourth consecut...
25/10/2024
Disney Expected to Announce Major AI Initiative'
Disney one of the world's largest owners of intellectual property is getting ready to unveil a major AI initiative that will focus primarily on post-produ...
25/10/2024
Broadcast Solutions establishes CTO Office to drive innov...
Broadcast Solutions, one of Europe's largest media systems integration groups, has extended its technical leadership with two key appointments. Pierre Mestr...
25/10/2024
Unified Streaming fortifies customer ties with two new hi...
Unified Streaming, a leading streaming software company, has hired Valentijn Siebrands, an industry veteran, as its new streaming solutions manager. The company...
25/10/2024
Imagine Communications John Mailhot Receives 2024 David S...
Imagine Communications' John Mailhot was awarded the prestigious 2024 David Sarnoff Medal during SMPTE's annual Awards Gala, held on October 24 at the R...
25/10/2024
Independent Midwest Broadcaster selects Rohde & Schwarz TE1 liquid-cooled transmitter to expand audience reach
Independent Midwest Broadcaster selects Rohde & Schwarz TE1 liquid-cooled transm...
25/10/2024
Mexico's First Virtual Production Game Show Produced with Blackmagic Design
Mexico's First Virtual Production Game Show Produced with Blackmagic Design Brie Clayton October 25, 2024 0 Comments Club Cin polis Desaf o India...
25/10/2024
Using invisible effects to hide a stage light in Adobe After Effects
Using invisible effects to hide a stage light in Adobe After Effects Graham Quince October 25, 2024 0 Comments Lasers, dinosaurs and space VFX are coo...
25/10/2024
Improve your Color Grading using these simple steps in DaVinci Resolve 19
Improve your Color Grading using these simple steps in DaVinci Resolve 19 Kasia Jarco October 25, 2024 0 Comments Do you truly understand how to color...
25/10/2024
Brighter Eyes
Jenny Priestley talks to the BFI's Douglas Weir who oversaw the restoration of a much-loved animated classic, which returns to UK and Ireland cinemas today ...
25/10/2024
Comercio TV Chooses Broadpeak to Optimize OTT Video Deliv...
Broadpeak , a leading provider of content delivery network (CDN) and video streaming solutions for content providers and pay-TV operators worldwide, announced t...
25/10/2024
Amagi Partners With Allrites to Expand the Global Distrib...
Amagi, the global leader in cloud-based SaaS technology for broadcast and connected TV (CTV), has announced a strategic partnership with Allrites, a premium con...
25/10/2024
Studio Technologies Enhances ST 2110 Integration with Mer...
Studio Technologies, Inc., a pioneer in high-performance audio, video, and fibre-optic solutions, has long been at the forefront of the professional broadcast a...
25/10/2024
QuickLink Improves Remote Production for Saturday Night T...
QuickLink, empowering creatives to exceed modern-day standards of production, has been instrumental in easing the remote production challenges of ITV Studios...
25/10/2024
stYpe AI Glue and StypeCentral Advance the Art of TV Tale...
stYpe, a globally active innovator of virtual studio production resources, reports strong interest in the latest additions to its wide range of broadcast-qualit...
25/10/2024
Top Argentine Music Facility Casa Frida Estudio Chooses P...
Casa Frida Estudio, one of the most prestigious music facilities in Argentina, has upgraded its main control room to Dolby Atmos specifications and installed a ...
25/10/2024
Frequency expands Managed Channel Services to Europe at M...
Frequency, the engine behind many of the world's best-known streaming television channels, announces the European expansion of its Managed Channel Services ...
25/10/2024
InnovateUK and EU Approve Funding for Immersive Technolog...
Disguise, an HPA-Award-winning immersive experience company, has received £1.2 Million in funding from Innovate UK and the EU as part of a larger investment int...
25/10/2024
MASORANGE AND AGILE CONTENT RENEW THEIR COLLABORATION AGR...
Through this agreement, MASORANGE will incorporate new AGILE CONTENT technologies into its television service, enhancing customer experience with optimum servic...
25/10/2024
Swiss Indoors Basel 2024 delivered with Appear X Platform
Appear, a global leader in live production technology, is proud to announce its role as an official provider of cutting-edge broadcast transmission solutions fo...
25/10/2024
MSCTV Chooses Witbes Virtual NOC for Proactive Live TV Mo...
Witbe (Euronext Growth FR0013143872 ALWIT), a global leader in test automation and monitoring technology for video service providers, today announced that M...
25/10/2024
Unified Streaming fortifies customer ties with two hires
Unified Streaming, a leading streaming software company, has hired Valentijn Siebrands, an industry veteran, as its new streaming solutions manager. The company...
25/10/2024
Independent Midwest Broadcaster selects Rohde and Schwarz...
Competitive search leads Toledo's WLMB-TV 40 to TE1 based on energy efficiency and durability As part of its effort to reach a wider audience, the Toledo-b...
25/10/2024
IBC Accelerator Programme 2025 - Call For Industry Challe...
IBC announces the Call for Challenges for the 2025 Accelerator Media Innovation Programme, inviting proposals for transformative, fast-track innovation projects...
25/10/2024
TVN Deploys Lawo AoIP Technology in New OB Truck
HANNOVER, Germany TVN Live Production is using a variety of solutions and technologies from Lawo in its new TVN- 8UHD OB truck, which it unveiled at this year...
25/10/2024
LG Ad Solutions Joins Innovid's Harmony Initiative
NEW YORK Innovid, a software platform for the creation, delivery, measurement and optimization of connected TV (CTV), linear and digital advertising, said LG Ad...
25/10/2024
Hightouch Launches New CTV Advertising Offering
SAN FRANCISCO Consumer data platform provider Hightouch has announced a new solution it said will streamline and accelerate connected TV (CTV) advertising....
25/10/2024
Max Adds DAZN's Sports Offering in Spain
MADRID Warner Bros. Discovery's streaming service Max has reached a new agreement with DAZN that will give Max customers in Spain access to the premium spor...
25/10/2024
Beloved Genre-Benders Karate Make a Fitting Comeback
Beloved Genre-Benders Karate Make a Fitting Comeback Its one of the decades feel-good music stories: How the legendary alumni acts rediscovery led to rereleas...
25/10/2024
Berklee Presents Holiday Extravaganza: Duke Ellingtons Nutcracker Suite and Christmas Vibes Featuring Warren Wolf
Berklee Presents Holiday Extravaganza: Duke Ellingtons Nutcracker Suite and Chri...
25/10/2024
Canadian engineer Elias Ghannoum wins 2024 Lord Kelvin Award
The IEC has awarded its annual Lord Kelvin Award to the Canadian engineer, Elias Ghannoum. The award recognizes exceptional and long-term contributions to globa...
25/10/2024
Dolby and Jin from BTS Celebrate His New Single I'll Be There in Dolby Atmos
25 October 2024, 16:00 (PDT) Dolby and Jin from BTS Celebrate His New Single I'll Be There in Dolby Atmos Love Jin More In Dolby | #LoveMoreInDolby F...
25/10/2024
JazzCash and Dgpays Join Forces to Enhance Marketplace Payments in Pakistan
25 Oct 2024 JazzCash and Dgpays Join Forces to Enhance Marketplace Payments in Pakistan Amsterdam and Dubai, 25 October 2024: VEON Ltd. (Nasdaq: VEON, Euronext...
25/10/2024
Monthly Rewind: Groundbreaking Colour Innovation, Unreal Engine, The Academy Museum, and more.
October has been a wicked month across Technicolor Group! So much so, we introdu...