Sony Pixel Power calrec Sony

How broadcasters can use local technology to build an international animation pipeline

26/01/2022

TVBEurope talks to the team behind a proof of concept looking at a standardised data pipeline allowing content makers to create 3D animated content quickly and collaboratively

By Jenny Priestley

Published: January 26, 2022 Updated: January 27, 2022

TVBEurope talks to the team behind a proof of concept looking at a standardised data pipeline allowing content makers to create 3D animated content quickly and collaboratively

target=_blank title=Share on LinkedIn class=share-linkedin>

During its upcoming Production Technology Seminar, the European Broadcasting Union will be revealing more details of its proof of concept around using remote production for real-time animation.

As part of the IBC Accelerators programme, the proof of concept team developed a solution that explores a standardised pipeline that enables users to employ everyday technology such as smartphones and web cams as well as real-time render engines to create 3D animated content quickly and collaboratively.

The project has been led by the EBU's senior project manager Paola Sunna alongside RT motion graphics designer Ultan Courtney. Early last year they came up with the idea of building and designing a low-cost pipeline for computer generated characters, leveraging game engines, AI tools and off the shelf equipment.

We got in touch with other broadcasters, including RAI, YLE, and VRT and told them about the project and what we wanted to try and test, explains Sunna. They came on board and then we submitted a proposal to the IBC Accelerator programme, it was accepted and so we started working with other champions and participants.

Just before the team submitted their PoC, Nvidia launched Omniverse, a scalable, multi-GPU, real time reference development platform for 3D content creation. So we agreed with the other broadcasters to develop two pipelines, continues Sunna, one based on the beta version of Omniverse, and the other based on Unreal Engine. The team at RAI focused mostly on the Omniverse platform, which includes a solution called Machinima that is for cinematics, so animation, manipulation of the CG characters using high-fidelity renders. They also used Audio2Face, which allows you to generate facial animation from just an audio source. You record the audio clip and it's used to animate the face of the CG characters.

data-src=https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-726x408.jpg alt= width=445 height=250 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-726x408.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-353x199.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-768x432.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-1536x864.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-241x136.jpg 241w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1.jpg 1920w data-sizes=(max-width: 445px) 100vw, 445px />The team wanted to decentralise the production pipeline by relying on what audiences had already in their homes or have access to. A lot of our project, believe it or not, involves saying no to potentially better and more expensive technology, states Courtney. By sort of building on the model of almost having a connected series of home offices, we were able to connect all of the artists who were working internationally on the project. Often you're expected to have a kind of generalist skill set when you work with a broadcaster and some of this required some specialist knowledge. *But at the same time, we also needed almost to have access to a few specialists and when we came together we realised we had everything we needed to form a very well educated team.

The focus on collaboration and remote workflow meant the team was spread right across Europe, with 3D modellers in Belgium, an FX artist and vocal performer in Finland, innovators in Italy, and a sound designer in Ireland. One of the team at the EBU set up a live working mechanism for cloud based workflow through a system called Perforce, adds Courtney, RT were directing and doing performances as well and then RAI were testing tools and refining and cleaning motion capture data.

Even though we all had a generalist skill set, each one was able to kind of push it slightly enough towards a specialisation without it turning into a full Hollywood pipeline. It was essentially trying to find a way to create a usable pipeline within the skill sets of broadcasters and also making it as accessible as possible to talent who would be digitally captured and then perform using their voices.

data-src=https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-726x408.jpg alt= width=461 height=259 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-726x408.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-353x199.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-768x432.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-1536x864.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-241x136.jpg 241w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1.jpg 1920w data-sizes=(max-width: 461px) 100vw, 461px />Once recorded, the voices were entered into a solution called Audio2Face which was employed in the Omniverse pipeline. We were able to take in people's voice data, it would animate the face and then we were also able to use a participating company called Resepeec
LINK: https://www.tvbeurope.com/production-post/using-local-technology-to-bu...
See more stories from tvb

Europe Stories

04/11/2022

Game better with DTS Headphone:X

The best gamers know DTS Headphone:X technology ups their play. Now major magazines have caught on, too. DTS Headphone:X technology creates immersive soundsc...

26/05/2022

Fujifilm announces agreement with Color-Logic Inc to sell the world's leading software solution for printed metallic effects

Fujifilm announces agreement with Color-Logic Inc to sell the world's leadin...

25/05/2022

Sounds of Africa: Creators Bring the Continent to Life on Spotify

May 25 marks Africa Day, which recognizes the creation of the African Union and offers a chance to reflect on the progress that has been made across the contine...

25/05/2022

EditShare Showcases Latest Cloud Innovations at Broadcast Asia 2022

EditShare Showcases Latest Cloud Innovations at Broadcast Asia 2022 Flexible, cloud-enabled workflows facilitate remote working and transform creative story te...

25/05/2022

disguise enters the metaverse

disguise intends to build capability to offer virtual production workflows custom-designed for the metaverse By Jenny Priestley Published: May 25, 2022 dis...

25/05/2022

Synamedia acquires content discovery platform provider Utelly

Utelly aggregates data in real-time from multiple metadata providers - pre-integrated with Gracenote, TiVo, IMDB, Netflix and 50 others By Jenny Priestley Pub...

25/05/2022

VEON announces 2022 AGM and board nominees

Amsterdam, 25 May 2022 - VEON Ltd. (NASDAQ: VEON, Euronext Amsterdam: VEON), a global digital operator that provides mobile connectivity and services, has today...

25/05/2022

Sky Documentaries announces 500,000 fund for documentary shorts

Sky Documentaries, the home of world-class, real-life stories from award-winning and emerging filmmakers, has today launched its first documentary shorts fund i...

25/05/2022

Tom Heap to present new weekend editions of Sky News Daily Climate Show

From Saturday 2nd July, Tom Heap will host new weekend editions of The Daily Climate Show on Sky News. The 30 minute programmes will be broadcast on TV and acro...

25/05/2022

Sky Sports to pay tribute to Shane Warne during England's Test match against New Zealand at Lord's

Sky's main commentary box at Lord's to be renamed after leg-spin great ...

25/05/2022

Nokia and UScellular ink mid-band 5G network expansion deal

Nokia and UScellular ink mid-band 5G network expansion deal Multi-year 5G network expansion deal in C-Band and 3.45 GHz mid-band spectrum will provide additi...

25/05/2022

Correction: Changes in Nokia Corporations own shares

Correction: Changes in Nokia Corporations own shares Nokia Corporation Stock Exchange Release 25 May 2022 at 20:20 EEST Correction: Changes in Nokia Corpo...

25/05/2022

Nokia Corporation: Repurchase of own shares on 25.05.2022

Nokia Corporation: Repurchase of own shares on 25.05.2022 Nokia Corporation Stock Exchange Release 25 May 2022 at 21:00 EEST Nokia Corporation: Repurchase...

25/05/2022

Backing Up your Brain with MatrixStore Object Storage

During most creative workflows there is a brain-like entity controlling what goes where and when. Be that a MAM, DAM, or PAM, it holds the keys to all the secre...

25/05/2022

Premium content meets cutting-edge technology - Banijay Rights collaborates with Amagi to go FAST

Amagi, a global leader in cloud-based SaaS technology for broadcast and connecte...

25/05/2022

Video Platform Observability using Agama AWE SDK - Part 2: Layout & Style

25 May, 2022 Blog By Anders Svensson In our previous article Par1 of this series, we presented the Agama AWE SDK, the requirements needed to create a simp...

25/05/2022

Thales Helps Customers Secure SAP Applications in the Cloud

Facebook Twitter LinkedIn SAP-certified Tokenization solution from Thales enables organizations to seamlessly protect data in numerous SAP applications S...

24/05/2022

Take a Tour of Spotify Island's New K-Park on Roblox

Just a few short weeks ago, we unveiled Spotify Island on Roblox and invited fans to explore our new, otherworldly digital destination for audio. Today, we'...

24/05/2022

After Moody's, Standard & Poor's also upgrades SGL Carbon's rating

Standard & Poors Global Ratings (S&P) raises its long-term rating for SGL Carbon to B- and its issue rating on its financial instruments to B. The outlook for t...

24/05/2022

Great approval at this year's Annual General Meeting of SGL Carbon

Due to Corona, our Annual General Meeting (AGM) was again held virtually in the head office in Wiesbaden on May 17, 2022. Registered shareholders were able to v...

24/05/2022

Colorful Combination of Characters

The latest installment into the family friendly Cheaper by the Dozen franchise depicts how a blended multiracial family can grow together despite the challenges...

24/05/2022

Meet the development and production executive

Shayna Waldman started out working in a legal firm before finding her way in to the media industry By Jenny Priestley Published: May 24, 2022 Updated: May 2...

24/05/2022

Report: Sports broadcasters plan to increase investment in technology following pandemic lull

New report looks at the way sports broadcasters investment priorities have chang...

24/05/2022

De RF Wolk van Broadcast Rental in het Zuiderpark

Overal draadloze ontvangst tijdens de Invictus Games Het Haagse Zuiderpark staat tussen 16 en 22 april 2022 in het teken van de Invictus Games. Ruim vijfhonde...

24/05/2022

How to integrate web based video editing in your MAM System program

Discover in this new episode of VSN Shortcuts how to integrate web based video editing tool in your MAM system using Wedit, VSN's professional video editing...

24/05/2022

Nokia announces shipment of 1.5 millionth Quillion-powered PON port for broadband fiber nodes

Nokia announces shipment of 1.5 millionth Quillion-powered PON port for broadban...

24/05/2022

Nokia Corporation: Repurchase of own shares on 24.05.2022

Nokia Corporation: Repurchase of own shares on 24.05.2022 Nokia Corporation Stock Exchange Release 24 May 2022 at 21:00 EEST Nokia Corporation: Repurchase...

24/05/2022

TV5MONDE Expands Global Reach with Harmonic Cloud Streaming

SAN JOSE, Calif. - May 24, 2022 - Harmonic (NASDAQ: HLIT) today announced that leading French-language entertainment provider TV5MONDE is streaming its channels...

24/05/2022

FOX Television Stations Digital Properties are #1 in Total Minutes Against Other O&O Station Groups for 18th Month in a Row

FOX Television Stations Digital Properties are #1 in Total Minutes Against Other...

24/05/2022

Dalet Helps Australian Football League

Dalet, a leading technology and service provider for media-rich organizations, today announced that the Australian Football League (AFL) is using Dalet Flex to ...

24/05/2022

Tencent Video Pounce on All-New CGI Animation, Shasha & Milo

Banijay Kids and Family today announces Zodiak Kids and Family France, and South Korean studio, Pingo Entertainment, are co-producing a new high-quality CGI act...

24/05/2022

AI in Media Asset Management - Vidispine adds to on-demand services available in VidiNet with DeepVA AI software

AI in Media Asset Management - Vidispine adds to on-demand services available in...

24/05/2022

Mario Lawson, the first winner of the Michle Lridon scholarship for diversity in the media

The winner will soon join the AFP editorial staff on a three-month contract, whi...

24/05/2022

161 million viewers watch 2022 Eurovision Song Contest as online engagement soars

161 million viewers watch 2022 Eurovision Song Contest as online engagement soar...

24/05/2022

Thales continues its commitment to Egypt National Railways and delivers three key stations Tanta, Al Ousayrat and Sedfa

Facebook Twitter LinkedIn The transformation implemented by Thales means a...

24/05/2022

Sony's new BRAVIA XR Master Series A90K and BRAVIA XR A75K OLED TVs are available to pre-order in Europe

Sony has announced the UK pricing and availability for two new TV series: BRAVIA...

24/05/2022

DataCore Software and Atempo Combine Forces in New Active Archive Solution

DataCore Software and Atempo Combine Forces in New Active Archive Solution posted: 24/05/2022 The joint solution enables customers to cost-effectively store...

24/05/2022

In the Digital Age, Thales and triPica Support Mobile Operators in Their Digital Transformation

Facebook Twitter LinkedIn Thales joins forces with triPica to address the ...

24/05/2022

Vietnam chooses innovative R&S Series5200 ATC radios and CERTIUM VCS from Rohde & Schwarz

Vietnam chooses innovative R&S Series5200 ATC radios and CERTIUM VCS from Rohde ...

23/05/2022

Test Your Knowledge of Ancient Mythology With Spotify's Myths & Legends' Podcast-And Our Quiz

-- -- Legend has it that the first story ever told was the Epic of Gilgamesh,...

23/05/2022

Viaplay wins EFL Championship and Carabao Cup rights across 10 countries

The long-term agreement will see more than 180 live matches from Englands second tier broadcast on Viaplay every season, including the semi-finals and finals B...

23/05/2022

Nokia and MCCA announce new global survey to measure and promote equity, inclusion and diversity in the legal field

Nokia and MCCA announce new global survey to measure and promote equity, inclusi...

23/05/2022

T-Mobile and Nokia Collaborate on Building Flexible and Scalable 5G Networks

T-Mobile and Nokia Collaborate on Building Flexible and Scalable 5G Networks DALLAS, Texas and BELLEVUE, Wash. - May 23, 2022 - Today, Nokia (NYSE: NOK) and ...

23/05/2022

Nokia Corporation: Repurchase of own shares on 23.05.2022

Nokia Corporation: Repurchase of own shares on 23.05.2022 Nokia Corporation Stock Exchange Release 23 May 2022 at 21:00 EEST Nokia Corporation: Repurchase...

23/05/2022

Fujifilm announces partnership with Papyrus Viscom to sell and distribute Acuity Prime flatbeds in Benelux

Fujifilm announces partnership with Papyrus Viscom to sell and distribute Acuity...

23/05/2022

Free training and colour workshops at Baselight Week London. June 27-29

Join us for free training and colour workshops at Baselight Week London June 27-29, 2022 Dolby Screening Room London FilmLight invites you to a special week o...

23/05/2022

Banijay Brands Strengthens Peaky Blinders Licensing Portfolio

Banijay Brands today announces new licensing deals for global hit drama Peaky Blinders, in collaboration with series owner and producer Caryn Mandabach Producti...

23/05/2022

Leading experts make case for accelerated adoption of always-on connected water metering

Water companies and the water sector face huge challenges over the coming decade...

23/05/2022

Rohde & Schwarz announces unique 56 GHz and 67 GHz frequency options for R&S SMW200A vector signal generator

Rohde & Schwarz announces unique 56 GHz and 67 GHz frequency options for R&S SMW...