Sony Pixel Power calrec Sony

How broadcasters can use local technology to build an international animation pipeline

26/01/2022

TVBEurope talks to the team behind a proof of concept looking at a standardised data pipeline allowing content makers to create 3D animated content quickly and collaboratively

By Jenny Priestley

Published: January 26, 2022 Updated: January 27, 2022

TVBEurope talks to the team behind a proof of concept looking at a standardised data pipeline allowing content makers to create 3D animated content quickly and collaboratively

target=_blank title=Share on LinkedIn class=share-linkedin>

During its upcoming Production Technology Seminar, the European Broadcasting Union will be revealing more details of its proof of concept around using remote production for real-time animation.

As part of the IBC Accelerators programme, the proof of concept team developed a solution that explores a standardised pipeline that enables users to employ everyday technology such as smartphones and web cams as well as real-time render engines to create 3D animated content quickly and collaboratively.

The project has been led by the EBU's senior project manager Paola Sunna alongside RT motion graphics designer Ultan Courtney. Early last year they came up with the idea of building and designing a low-cost pipeline for computer generated characters, leveraging game engines, AI tools and off the shelf equipment.

We got in touch with other broadcasters, including RAI, YLE, and VRT and told them about the project and what we wanted to try and test, explains Sunna. They came on board and then we submitted a proposal to the IBC Accelerator programme, it was accepted and so we started working with other champions and participants.

Just before the team submitted their PoC, Nvidia launched Omniverse, a scalable, multi-GPU, real time reference development platform for 3D content creation. So we agreed with the other broadcasters to develop two pipelines, continues Sunna, one based on the beta version of Omniverse, and the other based on Unreal Engine. The team at RAI focused mostly on the Omniverse platform, which includes a solution called Machinima that is for cinematics, so animation, manipulation of the CG characters using high-fidelity renders. They also used Audio2Face, which allows you to generate facial animation from just an audio source. You record the audio clip and it's used to animate the face of the CG characters.

data-src=https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-726x408.jpg alt= width=445 height=250 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-726x408.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-353x199.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-768x432.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-1536x864.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-241x136.jpg 241w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1.jpg 1920w data-sizes=(max-width: 445px) 100vw, 445px />The team wanted to decentralise the production pipeline by relying on what audiences had already in their homes or have access to. A lot of our project, believe it or not, involves saying no to potentially better and more expensive technology, states Courtney. By sort of building on the model of almost having a connected series of home offices, we were able to connect all of the artists who were working internationally on the project. Often you're expected to have a kind of generalist skill set when you work with a broadcaster and some of this required some specialist knowledge. *But at the same time, we also needed almost to have access to a few specialists and when we came together we realised we had everything we needed to form a very well educated team.

The focus on collaboration and remote workflow meant the team was spread right across Europe, with 3D modellers in Belgium, an FX artist and vocal performer in Finland, innovators in Italy, and a sound designer in Ireland. One of the team at the EBU set up a live working mechanism for cloud based workflow through a system called Perforce, adds Courtney, RT were directing and doing performances as well and then RAI were testing tools and refining and cleaning motion capture data.

Even though we all had a generalist skill set, each one was able to kind of push it slightly enough towards a specialisation without it turning into a full Hollywood pipeline. It was essentially trying to find a way to create a usable pipeline within the skill sets of broadcasters and also making it as accessible as possible to talent who would be digitally captured and then perform using their voices.

data-src=https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-726x408.jpg alt= width=461 height=259 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-726x408.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-353x199.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-768x432.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-1536x864.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-241x136.jpg 241w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1.jpg 1920w data-sizes=(max-width: 461px) 100vw, 461px />Once recorded, the voices were entered into a solution called Audio2Face which was employed in the Omniverse pipeline. We were able to take in people's voice data, it would animate the face and then we were also able to use a participating company called Resepeec
LINK: https://www.tvbeurope.com/production-post/using-local-technology-to-bu...
See more stories from tvb

Europe Stories

03/06/2024

Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives

Dalet, a leading technology and service provider for media-rich organizations, a...

28/04/2024

Mediahaus delivers the first SRT live-streaming sports production over 5G with URSA Broadcast G2

Mediahaus delivers the first SRT live-streaming sports production over 5G with U...

28/03/2024

The 4K cameras giving audiences an astronaut's view of Earth

TVBEurope meets Charles Black, founder and CEO of Sen, which has sent a payload of 4K cameras to the ISS to livestream images of Earth to audiences around the w...

28/03/2024

Thales speeds up its development of AI for defence

Facebook Twitter LinkedIn Thales, Europe's leading high-tech company in the civil and defence fields, has announced the creation of cortAIx, which bri...

27/03/2024

UKTV sets up second series of Dream Car Fixers for Yesterday and UKTV Play

Wednesday 27 March 2024 - UKTV has commissioned a second series of Dream Car Fixers (6x60) for leading factual channel Yesterday and free streaming service UKTV...

27/03/2024

Paving the Way' for Spotify's NextGen Scholarship Recipients

Spotify is committed to amplifying the voices of underrepresented groups, and that starts with empowering the creators who will shape our industry's future....

27/03/2024

I knew there were cameras, lighting, some buttons and microphones involved': How Crew Room Academy is inspiring the next generation

TVBEurope hears from some of the students who took part in Crew Room Academys Sc...

27/03/2024

Adobe reveals Gen AI solutions for content supply chain

Elsewhere, Adobe revealed a new feature in Adobe Firefly, which uses the companys generative AI to easily apply the structure of an existing image to newly gene...

27/03/2024

Best of Show Awards for 2024 NAB Show entries close soon

The awards, from industry-leading brands of Future plc, provide a great opportunity for companies to stand out at one the most attended shows in the industry B...

27/03/2024

Meet the director of IT and operations

By TVBEurope Staff Published: March 27, 2024 Updated: March 28, 2024 CueScript's director of IT and operations, Meghan Tyler, tells TVBEurope about h...

27/03/2024

2023 Annual Report Publication

Ad hoc announcement pursuant to Art. 53 LR Cheseaux-sur-Lausanne, Switzerland, and Phoenix (AZ), USA, March 27 2024 - The Kudelski Group has published its 2023...

27/03/2024

Publication of Annual Report 2023

Annual Report 2023...

27/03/2024

ALOFT AeroArchitects equips private Boeing Business Jet aircraft with Eutelsat OneWeb's LEO satellite connectivity service

Photo credit: ALOFT AeroArchitects Press release - 27 March 2024 12:27 ALOFT...

27/03/2024

Dalet Showcases AI-Enabled Production, Automation and Monetization at NAB 2024

Dalet, a leading technology and service provider for media-rich organizations, today announced its 2024 NAB showcase (booth #W1713). Attendees can experience fi...

27/03/2024

Cinegy Multiviewer 24.2 - Scales of Efficiency

SL6031, NAB Show, Las Vegas, 14-17 April 2024: Cinegy, the premier provider of software defined television technology for digital video capture, processing, ass...

27/03/2024

PERCEVAL: Thales and partners reshape the future of airline pilot training

Facebook Twitter LinkedIn Thales has formed a consortium with ENAC, lENS Paris-Saclay, Simaero, AviaSim and Corsair to develop a tooled methodology for ev...

27/03/2024

Advocacy in Action: Creating a future where public service media thrive

Advocacy in Action: Creating a future where public service media thrive...

27/03/2024

EBU calls on MEP candidates to Do the next right thing for media and democracy!'

EBU calls on MEP candidates to Do the next right thing for media and democracy!...

27/03/2024

The media industry gave away the keys to the kingdom once - that shouldn't happen again

The media industry gave away the keys to the kingdom once - that shouldn't h...

26/03/2024

Sube la temperatura con las canciones del verano 2024 en Argentina y Brasil

De diciembre a marzo, cuando los ciudadanos del hemisferio sur disfrutan del verano, la m sica se convierte en una poderosa representaci n de las culturas y cos...

26/03/2024

Aumente o Som com as Msicas do Vero de 2024 da Argentina e do Brasil

De dezembro a mar o, medida que as pessoas em todo o Hemisf rio Sul aproveitam o ver o, a m sica surge frequentemente como uma representa o poderosa das cult...

26/03/2024

Turn Up the Heat With Argentina's and Brazil's 2024 Songs of Summer

From December to March, as people across the Southern Hemisphere soak up the summer, music often emerges as a powerful representation of a region's cultures...

26/03/2024

A Collaboration With Panavision: Pedro Luque, SCU

Cinematographer Pedro Luque, SCU's credits include the features Body Cam, Antebellum and director J.A. Bayona's Best International Feature Oscar-nominat...

26/03/2024

China's Leading Mobile Operators First To Commercially Launch New Fraud Reducing Password Service, After Receiving GSMA Open Gateway Certification

GSMA welcomes CITIC Telecom, Huawei and ZTE as Channel Partners 26 March 2024, Beijing: China's three leading mobile operators - China Mobile, China Telec...

26/03/2024

China's 5G market is set to add almost $260 billion to the Chinese economy in 2030 with connections set to top 1 billion this year

At the Post-MWC Sharing Event in Beijing, leaders from the GSMA contextualised t...

26/03/2024

Crown Works Studios moves forward following council approval

The studios are expected to be one of the largest in Europe, with 20 premium sound stages suitable for major feature film and high-end TV (HETV) productions By...

26/03/2024

The Slovak democracy must not be dismantled in silence

The Slovak democracy must not be dismantled in silence...

26/03/2024

VEON announces sale of stake in Beeline Kyrgyzstan, increasing the focus on its large markets

26 Mar 2024 VEON announces sale of stake in Beeline Kyrgyzstan, increasing the ...

26/03/2024

embedded world 2024: Rohde & Schwarz presents its cutting-edge test solutions for embedded systems

embedded world 2024: Rohde & Schwarz presents its cutting-edge test solutions fo...

26/03/2024

Riedel and TSL Provide Cost-Effective, High-Quality Video Routing and Control for Leading Financial Corporation

Wuppertal March 26, 2024 Riedel and TSL Provide Cost-Effective, High-Quality V...

26/03/2024

IBM Announces EMEA Geography Winners of the 2024 IBM Partner Plus Awards

London, UK, March 26, 2024 Today, IBM (NYSE: IBM) announced the EMEA geography winners of the 2024 IBM Partner Plus Awards, which celebrate IBM partners who a...

26/03/2024

Eutelsat OneWeb services activated for enterprise and maritime in Australia and New Zealand through Sat One partnership

Photo credit: GETTY IMAGES Press release - 26 March 2024 11:29 Eutelsat OneW...

26/03/2024

2024-03-26

CUPERTINO, CALIFORNIA Apple today announced it will host its annual Worldwide Developers Conference (WWDC) online from June 10 through 14, 2024. Developers and ...

25/03/2024

Spotify Tests Video-Based Learning Courses in the UK

Today we're launching a test for video-based courses on Spotify in the U.K. We've partnered with educational tech companies including BBC Maestro, PLAYv...

25/03/2024

NEP Australia expands IP and remote production with Calrec Argo

NEP Australia expands its IP and remote production capabilities with first install of Calrec Argo consoles NEP Australia, a division of NEP Group and a prominen...

25/03/2024

NAB 2024 Preview | Why attend NAB 24?

NAB 2024 Preview | April 14 -17 | Booth C6307 | Las Vegas Convention Center We're looking forward to meeting up with customers and partners at the 2024 NAB ...

25/03/2024

Blackbird adds indexing and AI auto sequencing to video editing platform

Twelve Labs AI will enable editors to locate specific storytelling moments within their video content using natural language, said the companies By Jenny Pries...

25/03/2024

Meet the director of strategic marketing

By TVBEurope Staff Published: March 25, 2024 Updated: March 26, 2024 Bruno Fran on, director of strategic marketing at Backlight, talks to TVBEurope abou...

25/03/2024

With the EMFA, the EU has a new toolbox to prevent governments from taking over the media

With the EMFA, the EU has a new toolbox to prevent governments from taking over ...

22/03/2024

SGL Carbon achieves annual targets for 2023 and invests more in growth markets

In fiscal year 2023, SGL Carbon achieved the sales and earnings targets set at the beginning of the year despite the drop in demand from the important wind mark...

22/03/2024

Grass Valley secures $220 million in strategic refinancing

The company said it intends to accelerate innovation across its entire portfolio, most notably in the AMPP ecosystem following the refinancing By Jenny Priestl...

22/03/2024

RT kicks off Guinness Women's Six Nations coverage with France v Ireland

Watch all the games live across RT and Virgin Media Television from Saturday 23rd March All Ireland games live on RT Radio The Guinness Women's Six Nat...

22/03/2024

Telenor releases its Annual report for 2023

1 minute read Share alt=Alternative descriptive text class=lazyload main main-lazyloaded responsive-image data-v-1a5ebb10> Our digital lives are becomi...

21/03/2024

Spotify Celebrates Ramadan With Listening Trends From Around the World

March marks the beginning of Ramadan, a cherished cultural event celebrated by Muslims worldwide. As families and communities come together to observe, contempl...

21/03/2024

Adhoc notification: SGL Carbon: CEO Dr. Torsten Derr will not extend his contract

(10:15 AM) Wiesbaden, March 21, 2024. The CEO of SGL Carbon SE, Dr. Torsten Derr...

21/03/2024

SGL Carbon CEO Dr. Torsten Derr will not extend his contract

The CEO of SGL Carbon SE, Dr. Torsten Derr, informed the Chairman of the Supervisory Board today that he will not extend his contract, which expires on May 31, ...

21/03/2024

Women Making History, Part 4

In Part 4 of Panavision's Women Making History interview series, the conversation turns toward career highlights. Prompted by Panavision President and CEO K...