Sony Pixel Power calrec Sony

How broadcasters can use local technology to build an international animation pipeline

26/01/2022

TVBEurope talks to the team behind a proof of concept looking at a standardised data pipeline allowing content makers to create 3D animated content quickly and collaboratively

By Jenny Priestley

Published: January 26, 2022 Updated: January 27, 2022

TVBEurope talks to the team behind a proof of concept looking at a standardised data pipeline allowing content makers to create 3D animated content quickly and collaboratively

target=_blank title=Share on LinkedIn class=share-linkedin>

During its upcoming Production Technology Seminar, the European Broadcasting Union will be revealing more details of its proof of concept around using remote production for real-time animation.

As part of the IBC Accelerators programme, the proof of concept team developed a solution that explores a standardised pipeline that enables users to employ everyday technology such as smartphones and web cams as well as real-time render engines to create 3D animated content quickly and collaboratively.

The project has been led by the EBU's senior project manager Paola Sunna alongside RT motion graphics designer Ultan Courtney. Early last year they came up with the idea of building and designing a low-cost pipeline for computer generated characters, leveraging game engines, AI tools and off the shelf equipment.

We got in touch with other broadcasters, including RAI, YLE, and VRT and told them about the project and what we wanted to try and test, explains Sunna. They came on board and then we submitted a proposal to the IBC Accelerator programme, it was accepted and so we started working with other champions and participants.

Just before the team submitted their PoC, Nvidia launched Omniverse, a scalable, multi-GPU, real time reference development platform for 3D content creation. So we agreed with the other broadcasters to develop two pipelines, continues Sunna, one based on the beta version of Omniverse, and the other based on Unreal Engine. The team at RAI focused mostly on the Omniverse platform, which includes a solution called Machinima that is for cinematics, so animation, manipulation of the CG characters using high-fidelity renders. They also used Audio2Face, which allows you to generate facial animation from just an audio source. You record the audio clip and it's used to animate the face of the CG characters.

data-src=https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-726x408.jpg alt= width=445 height=250 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-726x408.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-353x199.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-768x432.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-1536x864.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-241x136.jpg 241w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1.jpg 1920w data-sizes=(max-width: 445px) 100vw, 445px />The team wanted to decentralise the production pipeline by relying on what audiences had already in their homes or have access to. A lot of our project, believe it or not, involves saying no to potentially better and more expensive technology, states Courtney. By sort of building on the model of almost having a connected series of home offices, we were able to connect all of the artists who were working internationally on the project. Often you're expected to have a kind of generalist skill set when you work with a broadcaster and some of this required some specialist knowledge. *But at the same time, we also needed almost to have access to a few specialists and when we came together we realised we had everything we needed to form a very well educated team.

The focus on collaboration and remote workflow meant the team was spread right across Europe, with 3D modellers in Belgium, an FX artist and vocal performer in Finland, innovators in Italy, and a sound designer in Ireland. One of the team at the EBU set up a live working mechanism for cloud based workflow through a system called Perforce, adds Courtney, RT were directing and doing performances as well and then RAI were testing tools and refining and cleaning motion capture data.

Even though we all had a generalist skill set, each one was able to kind of push it slightly enough towards a specialisation without it turning into a full Hollywood pipeline. It was essentially trying to find a way to create a usable pipeline within the skill sets of broadcasters and also making it as accessible as possible to talent who would be digitally captured and then perform using their voices.

data-src=https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-726x408.jpg alt= width=461 height=259 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-726x408.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-353x199.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-768x432.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-1536x864.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-241x136.jpg 241w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1.jpg 1920w data-sizes=(max-width: 461px) 100vw, 461px />Once recorded, the voices were entered into a solution called Audio2Face which was employed in the Omniverse pipeline. We were able to take in people's voice data, it would animate the face and then we were also able to use a participating company called Resepeec
LINK: https://www.tvbeurope.com/production-post/using-local-technology-to-bu...
See more stories from tvb

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

08/07/2026

Universal Audio introduce Black Box HG-2 & elysia karacter

Latest analogue-emulation plug-ins revealed Universal Audio have just added two new analogue-emulation plug-ins to their DSP-powered UAD line-up. Developed ...

08/07/2026

Pitch Innovations release Loop2Kit

Turn any audio loop into a playable kit Pitch Innovations have recently introduced an interesting new tool that's capable of creating playable kits from...

08/07/2026

MonkeyC update Rando sampler plug-in

Adds new keyboard-split function MonkeyC have recently launched an update that overhauls their powerful software sampler. Described as the sampler that mad...

08/07/2026

Strymon unveil the TimeLine MX

Four new delay algorithms & dual-engine functionality Strymon have just announced that the much-anticipated MX version of their hugely popular delay pedal i...

08/07/2026

Rohde & Schwarz and China Mobile Research Institute jointly demonstrate generative AI user experience testing

Rohde & Schwarz and China Mobile Research Institute jointly demonstrate generati...

08/07/2026

RT to air award-winning documentary TESTIMONY

Film follows the courageous fight for justice by survivors of Ireland's Magdalene Laundries & Mother and Baby Homes TESTIMONY airs Wednesday 22 July at 9...

07/07/2026

Open call: Apply for the Media Innovation Europe Validation Booster

Applications are now open for the Validation Booster, a six-month acceleration programme supporting journalists, media organisations, content creators, media in...

07/07/2026

Mix Buddy instrument mixer from Heritage Audio

New mixer aimed squarely at instrument-level sources Heritage Audio have clearly been busy recently, as alongside their all-new Tubestrip, they've also ...

07/07/2026

Heritage Audio unveil the Tubestrip

New channel strip combines popular hardware designs The latest arrival to the Heritage Audio line-up brings together a selection of their praised hardware d...

07/07/2026

Clear-Com Powers Ross Production Services Mobile Productions

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

07/07/2026

Toby Regbo, Harry Gilby and Jessica Barden lead cast for The Cadburys - the true story of the Cadbury family - with filming now underway in Birmingham

UKTV commission with BritBox and Sony Pictures Television and inspired by Deborah Cadbury's book, Chocolate Wars The six-part series is produced by Fable P...

07/07/2026

Record audiences tune into the ICC Womens T20 World Cup 2026 on Sky Sports

Tuesday 7 July 2026 Record audiences tune into the ICC Women's T20 World Cup 2026 on Sky Sports The ICC Women's T20 World Cup 2026 was the most watche...

07/07/2026

Official trailer released for Fightland, a revenge drama from executive producer Curtis 50 Cent Jackson coming August to Sky and NOW

Tuesday 7 July 2026 Official trailer released for Fightland, a revenge drama fr...

07/07/2026

Riedel and ARRI Bring Cinematic Live Production to the Eurovision Song Contest

Wuppertal July 7, 2026 Riedel and ARRI Bring Cinematic Live Production to the Eurovision Song ContestRiedel Communications and ARRI played a key role in one o...

07/07/2026

Patrick Kielty in The Late Late Chair until 2028

To Whom It Concerns RT today confirmed that Patrick Kielty is to extend his contract as host of The Late Late Show. Last season, the world's longest-runn...

06/07/2026

Synth Anthology 5 From UVI

Bundle gains 100 new synths & more Synth Anthology 5 the largest and most feature-packed edition of UVI's hardware synth emulation bundle, bringing toge...

06/07/2026

MOTU 16A, 848 & 10pre gain Milan certification

Available now via free firmware update MOTU have just announced that three of their popular audio interfaces now boast official Milan Certification. The 16A...

06/07/2026

Rohde & Schwarz completes Hunter Preliminary Design Review for the Integrated Communications System

Rohde & Schwarz completes Hunter Preliminary Design Review for the Integrated Co...

06/07/2026

The R&S IMAGER from Rohde & Schwarz uses millimeter wave imaging to inspect the quality of packaged goods in real time

The R&S IMAGER from Rohde & Schwarz uses millimeter wave imaging to inspect the ...

06/07/2026

Sky Kids unveils new slate for 2026 including Paris Hiltons animated series, Paris & Pups

Monday 6 July 2026 Sky Kids unveils new slate for 2026 including Paris Hilton&#...

06/07/2026

Sky agrees to acquire ITV Media & Entertainment, creating a commercial streaming champion for the UK

Monday 6 July 2026 Sky agrees to acquire ITV Media & Entertainment, creating a ...

06/07/2026

Pico Lopes joins RT's FIFA World Cup 2026 Live panel

Fresh from his World Cup heroics with Cabo Verde, Roberto Pico' Lopes will join the RT panel for Argentina v Egypt tomorrow and for the England v Norway q...

06/07/2026

New RT documentary The Girl in the Water follows one family's search for answers following the death of their 23-year-old daughter

A death can be unsuspicious, but it has to be explained What happened to Ke...

05/07/2026

Free Behringer Synth Editor

Browser-based and desktop apps available Digital Sunset Studios have been busy working on an interesting project: a free software tool that provides compute...

04/07/2026

Rhodes to launch the MK8/80AE

Celebrates company's 80th anniversary Rhodes have recently revealed that they will be producing a limited run of electric pianos in celebration of their...

04/07/2026

** MEDIA ALERT **BLEACH: THOUSAND-YEAR BLOOD WAR - THE CALAMITY Continues Its Momentum at Anime Expo

** MEDIA ALERT ** BLEACH: THOUSAND-YEAR BLOOD WAR THE CALAMITY Continues I...

04/07/2026

** MEDIA ALERT ** VIZ Media Unveils New Anime Slate at Anime Expo 2026 with MAO, RWBY, and BLACK TORCH Updates

** MEDIA ALERT ** VIZ Media Unveils New Anime Slate at Anime Expo 2026 with ...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

03/07/2026

VSL reveal Synchron Brass (muted)

New bundle & three Single Packs Continuing to expand their already sizeable orchestral collection, VSL's latest release introduces three new Single Pack...

03/07/2026

London Symphony Orchestra upgrade LSO St Luke's

Venue installs new ATC-equipped control room LSO St Luke's, a unique music venue that also serves as the home of the London Symphony Orchestra, have rec...

03/07/2026

2023

1 February 2023 SHARE Facebook Twitter Linkedin Email Munich, Germany, 1st February 2023: Cinegy GmbH, the premier provider of software technology for digit...

02/07/2026

The Crow Hill Company introduce Brackish Pads

Stammering, stuttering, strangulated tones The Crow Hill Company's latest creation promises to be the most original sound set they've produced to d...

02/07/2026

Steinberg SpectraLayers 13 now available

A new era in unmixing and spectral editing The latest version of Steinberg's spectral audio-editing software has just arrived, building on the strength...

02/07/2026

Sine Machine from Melatonin

Aims to simplify additive synthesis Sine Machine is the debut launch from Melatonin, a Vienna-based developer who have spent the past six years creating wha...

02/07/2026

iZotope acquired by Boris FX

Products to remain fully active & supported Following the news of Native Instruments joining the inMusic brand line-up, Academy and Emmy Award-winning visua...

02/07/2026

GearExpo UK 2026

What you missed! Last weekend, Saturday 27 June 2026, saw the debut of Sound On Sounds new GearExpo UK event, the largest dedicated pro-audio event to take ...

02/07/2026

Tea with Judi Dench returns to Sky Arts with legendary guest, Sir Ian McKellen

Thursday 2 July 2026 Tea with Judi Dench returns to Sky Arts with legendary guest, Sir Ian McKellen Sky today confirms Tea with Judi Dench will return this su...

01/07/2026

Tracktion unleash Waveform 14 DAW

New AI Assistant, Multi-channel Audio, ARA2 improvements & more Tracktion's DAW software has just received its latest major update, gaining a selection ...

01/07/2026

The Crow Hill Company release Brackish Pads

Stammering, stuttering, strangulated tones The Crow Hill Company's latest creation promises to be the most original sound set they've produced to d...

01/07/2026

Sweetwater & Andertons launch Darkglass Anagram Limited Edition Guitar Essentials

Exclusive run of limited-edition modelling pedals Sweetwater and Andertons M...

01/07/2026

Engineers choose DiGiCo Quantum 338 and Quantum 5 for Laufey

Matt started engineering and mixing in studios. Twelve years later, a good friend, front of house engineer Shane Haase, took him out on tour as system engineer ...

01/07/2026

DiGiCo Quantum T software popular with Stage Sound Services

Our SD10T was an absolutely rock-solid, stable console and the Quantum 338T has been the perfect upgrade, Hurley says. Having multiple screens is a big advant...

01/07/2026

DiGiCo Quantum338 on Tyler Childers' Snipe Hunt Tour

LEXINGTON, Kentucky - July 2026 -Tyler Childers' seventh and latest studio record, Snipe Hunter, is an adventurously sprawling collection of tunes that span...

01/07/2026

** MEDIA ALERT ** BLEACH Comes to Life in Los Angeles with First-of-Its-Kind Artist Gallery Experience During Anime Expo Week

** MEDIA ALERT ** BLEACH Comes to Life in Los Angeles with First-of-Its-Kind...