In the second part of our look at augmented or virtual reality elements in virtual sets we'll start by explaining the difference between AR and VR. The terms augmented reality (AR), virtual reality (VR), virtual studio and virtual set are all referring to different flavours of the same technology but just emphasise different features.
Originally published by The Broadcast Bridge
Gerhard Lang, chief engineering officer, Vizrt explains: When we're talking about augmented reality we are, for the most part, referencing tracked virtual elements. They're arranged three-dimensionally and attached to a live video signal. These are outputted as a ready-composite of live video and graphics. Virtual reality is an older term that refers to live motion in a three dimensional world. This doesn't necessarily have any live video in it.
The term virtual studio (or virtual set), refers to a three-dimensional space where elements - like a presenter - are keyed on top. Camera motion inside the virtual studio is created using tracking data from a live studio camera creating a realistic environment. The tracking data from the camera and the rendering of the graphics are composited and outputted as a final image. You can still put keyed graphics (for example, AR graphics) on top of this image so you can have additional graphics as part of the final image.
Lang says AR graphics are more complicated to work with compared to normal real-time 3D graphics. Users and operators need to understand not only the physics of what is going on but also the potential and limitations of the technology, he says.
The human eye is highly sensitive to irregularities in any video content and picks them up immediately, he explains. This ruins the illusion. To get AR right, we must minimise any errors introduced by technology. One of the most important elements is studio camera tracking, which reports the position and the viewing direction of every studio camera, as well as the zoom and focus of each lens. This tracking data must be accurate to the smallest detail and delivered with as little delay as possible with constant attention paid to timing behaviour.
An AR virtual camera must match its real camera as exactly as possible, including things like image deformation when using a specific wide-angle lens and depth of field. The position and rotation of the camera are, of course, local. The camera's coordinate space must match the one used to build the scene. Put simply, an AR element which is meant to sit on a real table wouldn't be there if the coordinate system's data doesn't match.
The virtual elements must fit naturally with the real set with regards to colour, contrast, light and shadows - even if the element is something which does not exist in real life, outlines Lang. It's distracting to the human eye if the shadows cast by virtual 3D objects are different to the ones cast by the real objects in the space, or if an object appears a lot brighter than the real-life studio lights would allow.
What are some of the best approaches to designing with AR in mind?Lang: Focus on getting the idea right. Content producers need to ensure they know that the AR they're putting into their work will enhance the content and make the production stand out. And involve everyone. Producers, designers and virtual set wizards should all have a say in the process.
Secondly, limit your idea to something your team is able to produce. Make sure that your AR objects, texture videos and so on will run in real time on your Viz Engine. Think carefully through the production set-up so you know what cameras and shots will be needed during production and how you'll cut between them live. Stick with real live measurements and avoid scaling. If possible have a mock-up of the real environment available inside Viz Artist to check how your elements will work without the need to have a camera and tracking available for planning.
When does AR / VR not work?Lang: Everything in this area now works so well that there aren't really any limits to the use of AR anymore. With highly portable tracking systems, like ncam, AR is now possible everywhere. If the hardware has already been assembled and calibrated, on-site setup time is really short. AR enhancements can now be used in a live broadcast within a few minutes. AR systems from Vizrt consisting of a laptop and Thunderbolt expansion box are lightweight and easy to transport anywhere. Because there are no more limitations, technically-speaking, the question producers need to ask themselves is whether AR makes sense and is appropriate for their particular project.
How do you best prepare talent to work with AR/VR?Lang: It's fair to say that some talent is better than others when working with AR or VR. Those who are better can visualise for themselves how things will look. They often have a better timing which helps when understanding how to work with virtual elements. Having enough monitors to show the final picture makes it easier for everyone, not just the talent. But most importantly, there should be plenty of rehearsal and time for talent to study plans of the content. Moving with an AR element or within a VR environment should be as natural as moving with real things in a real environment.
Vizrt virtual set at Sky Sports
How important is lens calibration?Lang: It is crucial for getting virtual and real elements to match up at all zoom levels. It's a job that just has to be done and at Vizrt we have made some nice tools to simplify this process. These tools also cut down the time needed for calibrating lenses. At Vizrt we keep the lens and camera calibration separate. That means that once you've calibrated a lens, its data can be easily recalled when being mounted on a different camera body. A little bit of fine tuning and you are
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
30/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/05/2026
Zero in on one that says yes (and no)
Andy Marken May 29, 2026
0 Comments
Hero image courtesy of Deposit Photos
For content creators the most difficu...
29/05/2026
With InfoComm 2026 just weeks away, NDI is giving attendees plenty of reasons to...
29/05/2026
Reaffirming a partnership that has defined Canadian sports broadcasting since 19...
29/05/2026
Mobile/tablet is No. 2 device for watching TV, suggesting that the sports-production industry needs to take another look at the format
Ring Digital's Sprin...
29/05/2026
Berliner Ensemble, one of Berlin's five major theater companies, has expande...
29/05/2026
Solid State Logic will showcase its new compact, fly-away TCA Tour audio product...
29/05/2026
Gerald (Jerry) Pierce, a pioneering technologist who helped shape the digital transformation of the motion picture industry, passed away last month on April 12 ...
29/05/2026
Paramount+ will be the English-language U.S. home for Barclays Women's Super...
29/05/2026
Further strengthening its virtualisation strategy to fully support broadcasters ...
29/05/2026
Swiss broadcaster Canal Alpha has deployed Harmonic's award-winning, software-based XOS Advanced Media Processor to modernize playout operations across cant...
29/05/2026
PTZOptics will showcase a new generation of intelligent video workflows at InfoComm 2026, June 17-19, Las Vegas. Visitors to booth N8227 will see how PTZOptics ...
29/05/2026
Arizona's Family has launched the Arizona's Family Sports (AZFS) streaming app, a new direct-to-consumer destination for live, local sports. The app is ...
29/05/2026
Starting in 2027, DAZN will be the exclusive home of The Canadian Football Leagu...
29/05/2026
Comcast Business has detailed the advanced network infrastructure it has deploye...
29/05/2026
In two-day event, leaders from academia and industry explored solutions to chall...
29/05/2026
The Basketball Tournament (TBT), now entering their 13th year of competition, ha...
29/05/2026
Roku has launched FOX One as a Premium Subscription on The Roku Channel in the U.S. Roku customers can now subscribe to FOX One using their Roku account for liv...
29/05/2026
In its sixth year, the broadcaster's coverage has become a global brand and ...
29/05/2026
Ratings Roundup is a rundown of recent ratings news and is derived from press re...
29/05/2026
The days are getting longer, the temperatures are rising, and playlists are filling up for the season. With summer around the corner, Spotify's global edito...
29/05/2026
New retro-inspired MPC announced
There are few devices that have gained the status held by Akai Pro's MPC range, and in recent years, the company have s...
29/05/2026
Save up to 30 on acclaimed titles
Following a successful launch at Superbooth 2026, Bjooks have revealed that they will be continuing the Kickstarter campa...
29/05/2026
Binaural monitoring application improved
Genelec have just released an update that brings some powerful new features to their HRTF-based binaural headphone ...
29/05/2026
6 June 2026 at SAE Institute, London, UK
IMSTA FESTA 2026 is almost upon us, with some of the biggest names in pro-audio set to descend upon SAE Institute i...
29/05/2026
Gerald (Jerry) Pierce, a pioneering technologist who helped shape the digital transformation of the motion picture industry, died April 12, 2026, at his home in...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Comparing 5 AI Video Enhancers for Restoring Old Video Quality
Kate Luvis May 29, 2026
0 Comments
Digitizing VHS, MiniDV, and other legacy formats doe...
29/05/2026
Studio Hamburg Builds New Post Pipeline with DaVinci Resolve Studio
Brie Clayton May 29, 2026
0 Comments
Workflow replaces a patchwork of legacy tools...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
At the Intersection of Music and Dance, an Epic Collaboration Boston Conservatory musicians and dancers found creative parallels in their recent performance o...
29/05/2026
Back to All News
Latino Film Institute Fellows Screen Their Short Films at the Egyptian Theatre
The Inclusion Fellowship and Spark Animation Grant uplifts 15 ...
29/05/2026
GLOOKAST LAUNCHES CINNAFILM TACHYON PLUGIN FOR MEDIA PRODUCER AND MEDIA SERVICES
This release first appeared here.
Visit our Tachyon product page or contact...
29/05/2026
May 29 2026, 09:00 (PDT) Dolby and rednote Bring More Immersive Storytelling to...
29/05/2026
Something fundamental has shifted in how people consume media. Audiences aren't abandoning television or radio content; they're just expanding how, wher...
29/05/2026
Youtube exclusive special drops today
Watch now
UKTV today announces another e...
29/05/2026
Back to All News
The Official Trailer of Physical 100 Italy, on Netflix From Se...
In the second part of our look at augmented or virtual reality elements in virtual sets we'll start by explaining the difference between AR and VR. The terms augmented reality (AR), virtual reality (VR), virtual studio and virtual set are all referring to different flavours of the same technology but just emphasise different features.
