Sony Pixel Power calrec Sony

Getting up close and personal with a digital Liam Payne

08/04/2021

TVBEurope talks to the team at The Round, an augmented reality app which will feature an exclusive performance by Liam Payne ahead of Sundays EE British Academy Film Awards

By Jenny Priestley

Published: April 8, 2021

TVBEurope talks to the team at The Round, an augmented reality app which will feature an exclusive performance by Liam Payne ahead of Sunday's EE British Academy Film Awards

target=_blank title=Share on LinkedIn class=share-linkedin> TVBEurope talks to the team at The Round, an augmented reality app which will feature an exclusive performance by Liam Payne ahead of Sunday's EE British Academy Film Awards

https://www.tvbeurope.com/production-post/getting-up-close-and-personal-with-a-digital-liam-payne title=Share via Email class=share-email>

On Sunday night Liam Payne will open the British Academy Film Awards alongside his digital doppelganger.

But first, fans will be able to see Liam's avatar in a world-first real-time augmented reality mobile experience, created using EE's 5G network. Liam's performance will be recorded live and beamed to fans in the UK on their mobile phones wherever they are via AR app The Round.

Pip Brignall and Thomas Winsor, founders of The Round, developed the app as a way to enable live event producers and creatives to build and distribute their productions using augmented reality, and they describe it as a venue for live holographic performances.

Our background is in theatre, so our in' for immersive tech was very much from a theatre perspective, and we started to explore how virtual reality and augmented reality could be used to enhance that live performative storytelling format, Brignall tells TVBEurope. When we first started working on The Round it really came out of Covid shutting down all the theatres. We realised that a lot of the obstacles that we were facing could be solved by creating this one platform. We wanted to explore ways that dramatic storytelling could evolve into the audience's personal space. They're inviting the drama to them rather than going to it.

Pip Brignall (left) and Thomas Winsor (photo courtesy Anand Vara at V A Photography) The duo were taking part in Digital Catapult's 5G Accelerator Programme, experimenting on how they could utilise that technology to improve the platform and develop it further when the marketing team at EE found them. 5G is a huge part of EE's immediate and future roadmap and they always try to do a big exciting campaign around the BAFTAs and they were looking for something that would be a world first. They got in touch and asked us what would be possible, explains Brignall.

It was quite funny. They saw the video of our prototype and emailed saying they wanted to do that, and we said well that's what we're already doing', adds Winsor.

EE brought Payne on board, and the project developed from there. The AR version of the singer will be kept under wraps until 6.45pm on Sunday evening, but the app is available to download now with an AR holding animation that viewers can use to help them familiarise themselves with the process. Payne will perform exclusively for The Round at 6.45pm on Sunday before taking to the stage alongside his avatar to open the BAFTAs.

The avatar itself has already been created using photogrammetry. We captured Liam's image from every single angle you could imagine in a huge rig, and took lots of photos of his face and then we've turned that into the avatar, explains Winsor.

The images were then turned into a mesh, which was converted into an avatar and touched up in Maya. We're using really innovative facial capture technology as well so when we were doing the photogrammetry shoot we got Liam to recreate the face shapes that he makes when he's singing, says Brignall. When we were creating his avatar we had ready-made facial positions that we know are similar to what he does, so we then pre-programmed these blend shapes which were from an iPhone just strapped to his head. It tells the avatar that Liam is now doing blend shape number six and the face moves into blend shape number six. It has a series of blend shapes depending on what he's doing. That is all transmitted in real time so that once we've rigged the avatar it moves and behaves in the ways that Liam himself does, his digital face is programmed to make the same facial positions. When it's in real time that information makes the avatar come to life.

A slightly enhanced version of the avatar is being used in the TV performance. There are some limitations at this point as to what level of fidelity you can put an AR avatar into a mobile phone because they have a hard ceiling on what they can process. So we've created an improved' version of the avatar that people will see on the TV broadcast, says Winsor.

Part of the process has also involved Payne pulling on the dreaded mo-cap suit. But Winsor and Brignall say he's been up for anything. We had a very early session with him when we went to our motion capture studio and we got him in a mo-cap suit, and had a play and started loosely blocking it out. At that point we captured some test data so that we could run that through our app, and we did the photogrammetry session in the afternoon, adds Winsor.

We had another session about three weeks later where we had our first version of the avatar so he got to see what it was all about and move his avatar around. In that session we tested everything was working. We did a dry run the week before last in the studio we're using to stream the performance from, and then we've got him for one more day.

So what does Payne make of his digital doppelganger? He seems to love it, says Winsor. It's a strange experience, someone controlling their own avatar in augmented reality. In the studio th
LINK: https://www.tvbeurope.com/production-post/getting-up-close-and-persona...
See more stories from tvb

Most recent headlines

22/04/2021

Sony launches new suite of cloud-based microservices

Media Solutions Toolkit offers a number of cloud-native, specialised services, each addressing a particular function, like import or workflow management By Jen...

22/04/2021

Netflix to double Madrid studio capacity

Since 2016, the streamer says it generated over 7,500 jobs for Spanish cast and crew By Jenny Priestley Published: April 22, 2021 Since 2016, the streamer ...

22/04/2021

EBU investigates best practice for UHD and HDR

Organisation has launched two new activities looking at UHD and production codecs By Jenny Priestley Published: April 22, 2021 Organisation has launched tw...

22/04/2021

ES Broadcast acquires Sony's archiving division

Purchase expands the reach of ES Broadcast and extends its portfolio of services By TVBEurope Staff Published: April 22, 2021 Purchase expands the reach of...

22/04/2021

Queensland crime drama Troppo coming to ABC

22 04 2021 - Media release Queensland crime drama Troppo coming to ABC Yolanda Ramke, Thomas Jane ABC, AGC Television, Screen Australia and Screen Queensland...

22/04/2021

Thrilling new drama Barons greenlit for ABC

22 04 2021 - Media release Thrilling new drama Barons greenlit for ABC Marieke Hardy, Matt Cameron, Liz Doran The hedonistic world of surfing, the cutthroat ...

22/04/2021

Collaborate, educate and demonstrate, live from your OR

Collaborate, educate and demonstrate, live from your OR Kortrijk, Belgium, 22 April 2021 - Global visualization and collaboration leader Barco innovates in remo...

22/04/2021

Vizrt Channel Branding with Flexible Access makes identity, branding, and content cross-promotion powerfully easy

Vizrt Channel Branding with Flexible Access makes identity, branding, and conten...

22/04/2021

Clear-Com Releases Station-IC Virtual Desktop Client

Clear-Com Releases Station-IC Virtual Desktop Client posted: 18/04/2021 - Agent-IC Functionality Is Now Available for Mac and Windows PCs - Clear-Com Cl...

22/04/2021

Lighting in 2021: Orbiter, SkyPanel, Daylight, Tungsten, trends, and new solutions

For MACCAM, based in Los Angeles, California, catering specifically to gaffers, ...

22/04/2021

IBC To Consult Industry on 2021 Physical Event Plans

IBC today set out more details around its plans to bring the content and technology industry together again to discover the future of media and do business face...

22/04/2021

Marshall PTZ Cameras Deliver Broadcast Quality UHD Images for Newnan Presbyterian Church and rsquo;s Live Streams

When the coronavirus shut down in-person gatherings, many houses of worship were...

22/04/2021

MITOMO STUDIO SHIBUYA Upgrades 8K Editorial Review Suite with AJA KUMO 3232-12G and SKAARHOJ Rack Fly Duo

Mitomo is a leading Japanese broadcast equipment and service provider, and since...

22/04/2021

Alpha Sound Selects DPA for Famed Cathedral AV Overhaul

St. Mary's Cathedral is one of the most popular and beautiful Catholic churches in the Portland area. It serves as its parish's diocese, hosting weekly ...

22/04/2021

Marc Fennell tackles racism in bold new documentary series

22 04 2021 - Media release Marc Fennell tackles racism in bold new documentary series Marc Fennell Popular media personality and Walkley award-winning journa...

22/04/2021

Barco Announces NEXXIS Partnership with Sigma - Jones AV in India to Accelerate Next-Gen Healthcare Video Integration Solutions

Barco Announces NEXXIS Partnership with Sigma - Jones AV in India to Accelerate ...

22/04/2021

Learning More in PreSonus Sphere with Jacob Lamb

With a PreSonus Sphere membership you get access to exclusive masterclasses in the Learn section. Here you can dive into practical recording topics from indu...

22/04/2021

ES Broadcast acquires archiving solutions specialist Memnon from Sony

ES Broadcast acquires archiving solutions specialist Memnon from Sony posted: 21/04/2021 ES Broadcast, a leading provider of end-to-end solutions to the p...

22/04/2021

Reaching a new galaxy: Lawo HOME revolutionizes management of IP broadcast infrastructures

Reaching a new galaxy: Lawo HOME revolutionizes management of IP broadcast infra...

22/04/2021

Bringing you the expanded Atomos Ninja V Line-up

Bringing you the expanded Atomos Ninja V Line-up data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg data-srcset=ht...

22/04/2021

Sony Announces Latest IP, Cloud Solutions and Imaging Products for More Flexible and Scalable Productions and Workflows

Sony Announces Latest IP, Cloud Solutions and Imaging Products for More Flexible...

22/04/2021

Viz Artist 4.2 Free Edition and Viz Artist in Residence program debut

Viz Artist 4.2 Free Edition and Viz Artist in Residence program debut data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthu...

22/04/2021

MITOMO STUDIO SHIBUYA Upgrades 8K Editorial Review Suite with AJA KUMO 3232-12G and SKAARHOJ Rack Fly Duo

MITOMO STUDIO SHIBUYA Upgrades 8K Editorial Review Suite with AJA KUMO 3232-12G ...

22/04/2021

Flanders Scientific Introduces the AM211 and BM211 Monitors

Flanders Scientific Introduces the AM211 and BM211 Monitors data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg......

22/04/2021

Introducing RDE Connect - Simple, Powerful, Free Software for Podcasting and Streaming with the NT-USB Mini

Introducing R DE Connect - Simple, Powerful, Free Software for Podcasting and St...

22/04/2021

Throwback Thursday: Menconi Delves into the Music Behind WRAL Legend Uncle Paul

David Menconi recently penned a piece about Triangle legend Paul Montgomery, known familiarly as Uncle Paul, for Walter Magazine. Montgomery hosted the belove...

22/04/2021

WO Automation for Radio v5.0 offers fully remote station operations without compromise

The latest version of WO Automation for Radio, version 5.0, includes significant...

21/04/2021

UKTV experiences record Q1 viewing and sees huge uptick in 16-34s tuning in

21 April 2021 Multi-channel broadcaster enjoys highest ever Q1 share of viewing at 4.73% - an 8.6% growth year-on-year UKTVs share of commercial impacts (S...

21/04/2021

Netflix Adds 4M Subscriptions in Q1 2021, Short of Expectations

LOS GATOS, Calif.-Is the streaming boom powered by the pandemic starting to fade? One sign that could point to that idea is Netflix, the largest streaming provi...

21/04/2021

Hulu Strikes Deal to Carry NFL Network, NFL RedZone

NEW YORK-Hulu and NFL Media have come to terms on a multi-year carriage agreement that will bring NFL Network and NFL Redzone to the Hulu + Live TV service in t...

21/04/2021

Dejero Completes $60M Minority Recapitalization to Boost Growth

WATERLOO, Ontario-Dejero has announced a minority recapitalization of its business that totaled $60 million. The recapitalization was led by Vertu Capital, alon...

21/04/2021

ESPN, Fox Lead 42nd Sports Emmy Nominations

NEW YORK-The National Academy of Television Arts and Sciences has announced the nominees for the 42nd Annual Sports Emmy Awards, with ESPN and Fox leading all n...

21/04/2021

APTS, PBS Back FCC's Efforts to Increase False Emergency Alert Reports

WASHINGTON-Citing the goal of quickly and accurately informing the public about safety threats, America's Public Television Stations and PBS (collectively P...

21/04/2021

IBC Set to Go Ahead as Planned in September

LONDON-IBC 2021 is set to go ahead as planned in September, with organizers saying they are focused on delivering a fantastic event at the RAI in Amsterdam....

21/04/2021

Sony Sells Its Memnon Archiving Division to ES Broadcast

LONDON-ES Broadcast announced its acquisition of Sony's Memnon archiving solution arm. Terms of the deal were not disclosed....

21/04/2021

Quibi Content Becomes Roku Originals'

SAN JOSE, Calif.-Roku has driven the final nail in Quibi's coffin, announcing that the short-lived mobile streaming platform's content it acquired in Ja...

21/04/2021

Tightrope's Cablecast Powers Online Video Delivery for Cambridge Public Schools

MINNEAPOLIS-The Cablecast Community Media platform from Tightrope Media Systems ...

21/04/2021

Live Video Game Streaming Hit 8.8B Hours in Q1 2021

LONDON-People aren't just streaming TV shows and movies, live streams of video games grew substantially in 2020, and after the first quarter, 2021 is off to...

21/04/2021

Teradek Joins NDI Ecosystem

IRVINE, Calif.-Teradek is now part of the NDI ecosystem, which it will incorporate with its line of Teradek Cube 700 series encoders. Teradek Cube 705 and Terad...

21/04/2021

SVG Sit-Down: New FOR-A America President Satoshi Kanemura on Company's Role in Sports Production

SVG Sit-Down: New FOR-A America President Satoshi Kanemura on Company's Role...

21/04/2021

SVG SportsTech On Demand: VITEC Mark Robison's on New Venues With IPTV Systems and Enhancing the Fan Experience

SVG SportsTech On Demand: VITEC Mark Robison's on New Venues With IPTV Syste...

21/04/2021

SVG SportsTech On Demand: Haivision's Mark Horchler on Remote Collaboration and Remote Operation Over IP

SVG SportsTech On Demand: Haivision's Mark Horchler on Remote Collaboration ...

21/04/2021

SVG SportsTech On Demand: Spectra Logic's Hossein ZiaShakeri on Evolution of the Storage Industry and the Power of StorCycle

SVG SportsTech On Demand: Spectra Logic's Hossein ZiaShakeri on Evolution of...

21/04/2021

SVG SportsTech On Demand: disguise's Tom Rockhill on the Unlimited Options of xR Technology

SVG SportsTech On Demand: disguise's Tom Rockhill on the Unlimited Options o...

21/04/2021

SVG SportsTech On Demand: BirdDog's Dan Miall on the Power of NDI

SVG SportsTech On Demand: BirdDog's Dan Miall on the Power of NDI By Ken Kerschbaumer, Editorial Director Wednesday, April 21, 2021 - 9:20 am Print Thi...

21/04/2021

SVG SportsTech On Demand: Blackmagic Design's Bob Caniglia Discusses Expanded ATEM Lineup and More

SVG SportsTech On Demand: Blackmagic Design's Bob Caniglia Discusses Expande...

21/04/2021

IBC Still Planning on In-Person September Event But Has Fall-Back Option in December

IBC Still Planning on In-Person September Event But Has Fall-Back Option in Dece...

21/04/2021

At the Rink: Washington Capitals Approach Regular Season With Virtual Gameday Digital Experience, Traditional In-Venue Flair

At the Rink: Washington Capitals Approach Regular Season With Virtual Gameday Di...

21/04/2021

Inside the ESPN's NBA Daily Wager Special: How ESPN Produced Its First Sports-Betting-Driven Broadcast

Inside the ESPN's NBA Daily Wager Special: How ESPN Produced Its First Sport...

21/04/2021

STN IP Protection Suite

Maximize and protect your IP with the STN IP Protection Suite . From new users to expert searchers, at all stages of your innovation journey, STN has the soluti...