TVBEurope talks to the team behind a proof of concept looking at a standardised data pipeline allowing content makers to create 3D animated content quickly and collaboratively
By Jenny Priestley
Published: January 26, 2022 Updated: January 27, 2022
TVBEurope talks to the team behind a proof of concept looking at a standardised data pipeline allowing content makers to create 3D animated content quickly and collaboratively
target=_blank title=Share on LinkedIn class=share-linkedin>
During its upcoming Production Technology Seminar, the European Broadcasting Union will be revealing more details of its proof of concept around using remote production for real-time animation.
As part of the IBC Accelerators programme, the proof of concept team developed a solution that explores a standardised pipeline that enables users to employ everyday technology such as smartphones and web cams as well as real-time render engines to create 3D animated content quickly and collaboratively.
The project has been led by the EBU's senior project manager Paola Sunna alongside RT motion graphics designer Ultan Courtney. Early last year they came up with the idea of building and designing a low-cost pipeline for computer generated characters, leveraging game engines, AI tools and off the shelf equipment.
We got in touch with other broadcasters, including RAI, YLE, and VRT and told them about the project and what we wanted to try and test, explains Sunna. They came on board and then we submitted a proposal to the IBC Accelerator programme, it was accepted and so we started working with other champions and participants.
Just before the team submitted their PoC, Nvidia launched Omniverse, a scalable, multi-GPU, real time reference development platform for 3D content creation. So we agreed with the other broadcasters to develop two pipelines, continues Sunna, one based on the beta version of Omniverse, and the other based on Unreal Engine. The team at RAI focused mostly on the Omniverse platform, which includes a solution called Machinima that is for cinematics, so animation, manipulation of the CG characters using high-fidelity renders. They also used Audio2Face, which allows you to generate facial animation from just an audio source. You record the audio clip and it's used to animate the face of the CG characters.
data-src=https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-726x408.jpg alt= width=445 height=250 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-726x408.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-353x199.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-768x432.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-1536x864.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1-241x136.jpg 241w, https://www.tvbeurope.com/wp-content/uploads/2022/01/RADICAL_MOCAP_WEBCAM_IPHONE_v1.jpg 1920w data-sizes=(max-width: 445px) 100vw, 445px />The team wanted to decentralise the production pipeline by relying on what audiences had already in their homes or have access to. A lot of our project, believe it or not, involves saying no to potentially better and more expensive technology, states Courtney. By sort of building on the model of almost having a connected series of home offices, we were able to connect all of the artists who were working internationally on the project. Often you're expected to have a kind of generalist skill set when you work with a broadcaster and some of this required some specialist knowledge. *But at the same time, we also needed almost to have access to a few specialists and when we came together we realised we had everything we needed to form a very well educated team.
The focus on collaboration and remote workflow meant the team was spread right across Europe, with 3D modellers in Belgium, an FX artist and vocal performer in Finland, innovators in Italy, and a sound designer in Ireland. One of the team at the EBU set up a live working mechanism for cloud based workflow through a system called Perforce, adds Courtney, RT were directing and doing performances as well and then RAI were testing tools and refining and cleaning motion capture data.
Even though we all had a generalist skill set, each one was able to kind of push it slightly enough towards a specialisation without it turning into a full Hollywood pipeline. It was essentially trying to find a way to create a usable pipeline within the skill sets of broadcasters and also making it as accessible as possible to talent who would be digitally captured and then perform using their voices.
data-src=https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-726x408.jpg alt= width=461 height=259 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-726x408.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-353x199.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-768x432.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-1536x864.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1-241x136.jpg 241w, https://www.tvbeurope.com/wp-content/uploads/2022/01/AUDIO2FACE__RECORDING_TALENT_v1.jpg 1920w data-sizes=(max-width: 461px) 100vw, 461px />Once recorded, the voices were entered into a solution called Audio2Face which was employed in the Omniverse pipeline. We were able to take in people's voice data, it would animate the face and then we were also able to use a participating company called Resepeec
Most recent headlines
04/11/2022
The best gamers know DTS Headphone:X technology ups their play. Now major magazines have caught on, too.
DTS Headphone:X technology creates immersive soundsc...
21/05/2022
TORONTO At a time when broadcasters are facing increased security risks, the World Broadcasting Unions (WBU) has issued updated cybersecurity recommendations fo...
21/05/2022
EXTON, Penn. The Society of Cable Telecommunications Engineers (SCTE) has unveiled some of the key content themes for Cable-Tec Expo 2022, chaired this year by ...
21/05/2022
NEW YORK New forecasts from Kagan, the media research unit of S&P Global Market Intelligence, suggest that the ongoing move from console gaming to cloud-based g...
21/05/2022
Can You Write an Uplifting Song About the Climate Crisis? Student Zitong (Selina) Zhang talks about the inspiration behind her new song Life, a meditation o...
20/05/2022
20th May 2022 UKTV today announces that Late Night Mash (9x60) will return to Dave for a new series of topical comedy later this year, with new host Rachel Parr...
20/05/2022
--
By Stephanie Ornelas
No question, drones are impacting the way many filmmakers approach cinematography today. Whether in television, biopics, documentar...
20/05/2022
--
By Stephanie Ornelas
Streaming services have become one of the most popular ways to watch films. The convenience and flexibility that streaming offers,...
20/05/2022
Since 2018, Chile's capital, Santiago, has led the world when it comes to re...
20/05/2022
K-Pop fans, Spotify has a listening experience that will let you connect with your favorite bands in a new way. Through Spotify's Blend feature, you can sin...
20/05/2022
Tragedy is often accompanied by triumph, on scales both big and small. As the wo...
20/05/2022
DALLAS AT&T and Dish have announced an internet distribution agreement that will allow Dish to offer AT&T Internet services, including AT&T Fiber with Hyper-Gig...
20/05/2022
CANNES The 75th edition of the Cannes Film Festival is for the very first time hosting a virtual production space, a development that marks a new milestone in t...
20/05/2022
INDIANAPOLIS NTT and Penske Entertainment have announced that they will be providing an enhanced, more immersive experience for INDYCAR fans in time for the 106...
20/05/2022
The Paramount upfront presentation at Carnegie Hall largely focused on its new streaming platform, but it was a broadcast staple that offered the event its them...
20/05/2022
Streaming grew 10% globally in the first quarter, with consumption continuing to shaft to big screens, particularly smart TVs, according to a new report from Co...
20/05/2022
Nielsen said it is now including more streaming devices and providers in its deduplicated connected TV viewing measured by its Digital Ad Ratings....
20/05/2022
Streaming's share of television viewing rose to a record 30.4% in April from 29.7% in March, Nielsen said....
20/05/2022
The CW has released its fall schedule, with new shows The Winchesters, Professionals and Walker Independence, among others, in the lineup for the first time....
20/05/2022
Viamedia, an independent ad company serving local cable operators, said it launched its Parity Ads Platform, which simultaneously inserts regionally targeted ad...
20/05/2022
Digital entertainment and games executive Andrew Schneider was named president of Genvid Entertainment and CMO of its parent company Genvid Holdings....
20/05/2022
The CW will air The Black Pack: Excellence, a special celebrating Black excellence, the network said, and commemorating Juneteenth, Sunday, June 19. The CW wi...
20/05/2022
Cinedigm's Digital Rights Management unit said its AsianCrush unit has been launched on Comcast platforms including Xfinity X1, Xfinity Flex and XClass TV....
20/05/2022
The CW presentation began with a bang, as Stevie Wonder opened things up. Wonder slid in a few CW is the way! calls during Superstition , then gave way to Ma...
20/05/2022
By TVBEurope Staff
Published: May 20, 2022
Mo-Sys Engineering has signed a distribution partnership with South Korean dealer GMS International. The agreemen...
20/05/2022
John Griffiths, chief commercial officer at Spicy Mango, takes a look at the sports broadcasting landscape and why segmented subscriptions are likely to be the ...
20/05/2022
MediaKind CEO Allen Broome talks exclusively to TVBEurope about his nerve-wracking introduction to the industry, and the democratisation of video
By TVBEurope ...
20/05/2022
NEW YORK Nielsen's The Gauge is reporting that streaming reached another record high in April, capturing 30.4% of total TV viewing and surpassing its previo...
20/05/2022
LONDON Amazon's Prime Video has announced that it has invested more than £1 billion ($1.25 billion) in the U.K. on TV programming, movies, and live sport si...
20/05/2022
WASHINGTON D.C. The National Association of Broadcasters Leadership Foundation (NABLF) has announced that renowned actor and television personality Mario Lopez ...
20/05/2022
NEW YORK The cross-media local advertising company Viamedia has launched its new Parity ADS Platform....
20/05/2022
BURBANK, Calif. The content localization and distribution services provider Pixelogic has announced that it has reached an agreement to acquire Korean dubbing s...
20/05/2022
Six games live across RT including Republic of Ireland v Ukraine
On tonight's Late Late Show special celebrating one hundred years of Irish football, RT...
20/05/2022
Advances in extended reality have already changed the way we work, live and play, and it's just getting started.
Extended reality, or XR, is an umbrella ca...
20/05/2022
Behind the Mic: Dan Orlovsky Joins ESPN's No. 2 Commentary Team for Monday N...
20/05/2022
FCC Denies Wireless-Microphone Makers' Plea for Vacant Spectrum Availability The action also spotlights new WMAS spectrum-efficient wireless technology By...
20/05/2022
MLB, ESPN Take Player-Miking to a New Level Ballplayers on the field are happy to share what's on their minds By Dan Daley, Audio Editor
Friday, May 20,...
20/05/2022
PBR Caps Epic Season With World Finals in Fort Worth, Preps for Inaugural Team S...
20/05/2022
Sky News has announced its coverage plans for The Queen's Platinum Jubilee, when the country will come together to celebrate 70 years of service by Her Maje...
20/05/2022
Published On: May 20th, 2022
--
--
--
--
data-orig-src=https://www.sgo...
20/05/2022
Overnight in Turin, Italy, Sheldon took to the stage to perform his emotive and powerful Eurovision song Not The Same, wowing the crowd in the arena, the worldw...
20/05/2022
Nokia Corporation: Repurchase of own shares on 20.05.2022
Nokia Corporation
Stock Exchange Release
20 May 2022 at 21:00 EEST
Nokia Corporation: Repurchase...
20/05/2022
Back to All News
Fares Fares Makes His Directorial Debut With A Day and A Half for Netflix
Entertainment
20 May 2022
GlobalSweden
** Group photo and indivi...
20/05/2022
Back to All News
Heartstopper Will Return to Netflix with a Second and Third Season
Entertainment
20 May 2022
GlobalUnited Kingdom (Great Britain)
Netflix ...
20/05/2022
Amazon Prime Video has commissioned ITN Productions to produce a new true crime series looking at the incredible story of a missing persons case which turned in...
20/05/2022
News | May 20 2022
Working together to build primary school children's soft skills
A new generation had fun learning about working together when volunte...
20/05/2022
Banijay Brands, in collaboration with Endemol Shine North America, will be attending Licensing Expo on 24-26 May in Las Vegas, showcasing its diverse portfolio ...
20/05/2022
On the surface, Mai Tai is an easy-to-program, fine-sounding virtual analog subtractive synthesizer. But let's dig deeper-and unlock its unique FM synthesis...
20/05/2022
Building next-generation intelligent vehicles requires an AI infrastructure that pushes the cutting edge.
Electric vehicle maker NIO is using NVIDIA HGX to bui...
TVBEurope talks to the team behind a proof of concept looking at a standardised data pipeline allowing content makers to create 3D animated content quickly and collaboratively
