
In the second part of our look at augmented or virtual reality elements in virtual sets we'll start by explaining the difference between AR and VR. The terms augmented reality (AR), virtual reality (VR), virtual studio and virtual set are all referring to different flavours of the same technology but just emphasise different features.
Originally published by The Broadcast Bridge
Gerhard Lang, chief engineering officer, Vizrt explains: When we're talking about augmented reality we are, for the most part, referencing tracked virtual elements. They're arranged three-dimensionally and attached to a live video signal. These are outputted as a ready-composite of live video and graphics. Virtual reality is an older term that refers to live motion in a three dimensional world. This doesn't necessarily have any live video in it.
The term virtual studio (or virtual set), refers to a three-dimensional space where elements - like a presenter - are keyed on top. Camera motion inside the virtual studio is created using tracking data from a live studio camera creating a realistic environment. The tracking data from the camera and the rendering of the graphics are composited and outputted as a final image. You can still put keyed graphics (for example, AR graphics) on top of this image so you can have additional graphics as part of the final image.
Lang says AR graphics are more complicated to work with compared to normal real-time 3D graphics. Users and operators need to understand not only the physics of what is going on but also the potential and limitations of the technology, he says.
The human eye is highly sensitive to irregularities in any video content and picks them up immediately, he explains. This ruins the illusion. To get AR right, we must minimise any errors introduced by technology. One of the most important elements is studio camera tracking, which reports the position and the viewing direction of every studio camera, as well as the zoom and focus of each lens. This tracking data must be accurate to the smallest detail and delivered with as little delay as possible with constant attention paid to timing behaviour.
An AR virtual camera must match its real camera as exactly as possible, including things like image deformation when using a specific wide-angle lens and depth of field. The position and rotation of the camera are, of course, local. The camera's coordinate space must match the one used to build the scene. Put simply, an AR element which is meant to sit on a real table wouldn't be there if the coordinate system's data doesn't match.
The virtual elements must fit naturally with the real set with regards to colour, contrast, light and shadows - even if the element is something which does not exist in real life, outlines Lang. It's distracting to the human eye if the shadows cast by virtual 3D objects are different to the ones cast by the real objects in the space, or if an object appears a lot brighter than the real-life studio lights would allow.
What are some of the best approaches to designing with AR in mind?Lang: Focus on getting the idea right. Content producers need to ensure they know that the AR they're putting into their work will enhance the content and make the production stand out. And involve everyone. Producers, designers and virtual set wizards should all have a say in the process.
Secondly, limit your idea to something your team is able to produce. Make sure that your AR objects, texture videos and so on will run in real time on your Viz Engine. Think carefully through the production set-up so you know what cameras and shots will be needed during production and how you'll cut between them live. Stick with real live measurements and avoid scaling. If possible have a mock-up of the real environment available inside Viz Artist to check how your elements will work without the need to have a camera and tracking available for planning.
When does AR / VR not work?Lang: Everything in this area now works so well that there aren't really any limits to the use of AR anymore. With highly portable tracking systems, like ncam, AR is now possible everywhere. If the hardware has already been assembled and calibrated, on-site setup time is really short. AR enhancements can now be used in a live broadcast within a few minutes. AR systems from Vizrt consisting of a laptop and Thunderbolt expansion box are lightweight and easy to transport anywhere. Because there are no more limitations, technically-speaking, the question producers need to ask themselves is whether AR makes sense and is appropriate for their particular project.
How do you best prepare talent to work with AR/VR?Lang: It's fair to say that some talent is better than others when working with AR or VR. Those who are better can visualise for themselves how things will look. They often have a better timing which helps when understanding how to work with virtual elements. Having enough monitors to show the final picture makes it easier for everyone, not just the talent. But most importantly, there should be plenty of rehearsal and time for talent to study plans of the content. Moving with an AR element or within a VR environment should be as natural as moving with real things in a real environment.
Vizrt virtual set at Sky Sports
How important is lens calibration?Lang: It is crucial for getting virtual and real elements to match up at all zoom levels. It's a job that just has to be done and at Vizrt we have made some nice tools to simplify this process. These tools also cut down the time needed for calibrating lenses. At Vizrt we keep the lens and camera calibration separate. That means that once you've calibrated a lens, its data can be easily recalled when being mounted on a different camera body. A little bit of fine tuning and you are
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
22/11/2026
Try out modular synthesis for free
If you're looking for a way to explore modular synthesis without having to spend any money, then it's worth takin...
21/11/2026
Billie Jean King and Ilana Kloss attend the premiere of Give Me the Ball! by Liz Garbus and Elizabeth Wolff, an official selection of the 2026 Sundance Film Fes...
21/11/2026
Compressor plug-in free for first two weeks
The latest plug-in to join fedDSP's Amps & Pedals line-up has just arrived, and the company are kindly offer...
21/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
21/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
21/11/2026
A larger studio puts more distance between the lights and the people who need to look good under them. Brightline Lighting, a manufacturer of energy-efficient l...
21/11/2026
LA JOLLA, CA-Despite its enormous impact on individuals, families and communities, addiction remains an area of significant unmet medical need.
A $7 million gi...
21/11/2026
27 FANGORIA Chainsaw Awards Nominees Created with Blackmagic Design
Brie Clayton November 20, 2026
0 Comments
Blackmagic Design hardware and software ...
21/11/2026
Qube Cinema Named Technical Partner for 57th International Film Festival of Indi...
20/11/2026
The sports broadcaster's chairman sees the upcoming game as an opportunity t...
20/11/2026
In-venue and creative video staffers at the professional and collegiate level have one major thing in common: the intensity and attention to detail ramps up dur...
20/11/2026
A variety of LED displays, integrated broadcast infrastructure covers every angl...
20/11/2026
Real American Freestyle (RAF) has announced a distribution partnership with Migu Video, a Chinese digital sports platform, to carry the RAF15 main event between...
20/11/2026
Apple and F1 Academy have announced that the all-female racing series will stream on Apple TV in the U.S. beginning in 2027. Fans will be able to watch every qu...
20/11/2026
Regional broadcaster m nchen.tv has modernized its production infrastructure at a new location in northern Munich. Riedel MediorNet provides decentralized signa...
20/11/2026
Eutelsat has announced three appointments to its Executive Committee, effective November 2026, under CEO Jean-Fran ois Fallacher.
Jean-Hubert Lenotte is appoin...
20/11/2026
After more than two decades at Harbour Esplanade in Docklands, the Seven Network has relocated its Melbourne headquarters to a new, custom-built ST 2110 facilit...
20/11/2026
Brazil is among the first markets deploying Versatile Video Coding (VVC) as part...
20/11/2026
The Soccer Tournament (TST), the $1 million winner-take-all 7v7 world championsh...
20/11/2026
Enhancements include a larger compound, an elevated camera count, and a whole lo...
20/11/2026
Leaders from ESPN, iHeartMedia, and Just Women's Sports explore creating new...
20/11/2026
New EQ plug-in aimed at mastering duties
Lemur Audio's latest plug-in has just arrived, delivering a characterful EQ that's aimed primarily at maste...
20/11/2026
Discounts of up to 75% now available
Soundtoys' annual Black Friday sale is now live, with discounts of up to 75% applied across the company's range...
20/11/2026
New creative looping tool revealed
Described as a cycling audio fragmenter , the latest addition to the SoundGhost range draws its inspiration from tape ph...
20/11/2026
Fairchild recreation gets plug-in counterpart
Heritage Audio's Herchild 670 offers a meticulous hardware recreations of the much-loved Fairchild 670 and...
20/11/2026
BONDI: 7 Minutes That Changed Australia
16 November, 2026
Media releases
A landmark documentary chronicling the worst terror attack in modern Australian hi...
20/11/2026
Statement regarding SBS non-Executive Director Aaron Fa'Aoso
20 November, 2026
Media releases
Aaron Fa'Aoso has advised that he is stepping down a...
20/11/2026
INVITATION FOR PUBLIC COMMENTS AND OBJECTIONS ON NOMINEES FOR APPOINTMENT TO THE COUNCIL OF THE NATIONAL FILM AND VIDEO FOUNDATION (NFVF) The Department of Spor...
20/11/2026
UEFA Nations League football and autumn premieres propel TVP to number one as YouTube grows its TV screen share
Warsaw, Poland, November 19, 2026 - Nielsen, a...
20/11/2026
October's autumn weather clearly encouraged Poles to spend more time in front of their screens, resulting in both longer viewing times and a higher overall ...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
DigitalGlue releases creative.space Pulse, a free Mac app that shows creatives w...
20/11/2026
How NBCUniversal Telemundo Used Virtual Production for its FIFA World Cup 2026 C...
20/11/2026
What Film School Pays and What it Costs: The Federal Numbers
Mark Santos November 20, 2026
0 Comments
Every editor has had the argument about film sch...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Beam Dynamics has introduced new Model Context Protocol (MCP) support, expanding how customers can work with the live operational data held in Beam. The new cap...
20/11/2026
Re:Vision Effects Cyber Week Sale Nov 24 to Nov 30
Pierre Jasmin November 19, 2026
0 Comments
Long time friends of the COW are up with a big sale!
Us...
20/11/2026
Avid is offering up to 33% off annual subscriptions!
Brie Clayton November 19, 2026
0 Comments
Hero image courtesy Deposit Photos
Pro Tools
Pro To...
19/11/2026
With a sports-bar vibe and all the teams onsite in a huge atrium in Ballpark Vil...
19/11/2026
The senior from Phoenix and England is balancing life as a Division I tennis player with a growing career behind the microphone
The future of live sports produ...
19/11/2026
RED Digital Cinema and Colorfront have partnered to integrate native Colorfront color management into RED Connect, letting productions apply Colorfront's co...
19/11/2026
SMPTE has published an engineering report summarizing an industry survey by its Study Group on Content Provenance and Authenticity in Media. The findings point ...
19/11/2026
CTech and Skyline Communications have announced a partnership to deliver integra...