Sony Pixel Power calrec Sony

Virtual sets and motion capture combine for a new kind of TV

20/05/2016

Philip Stevens looks at a recent innovation in the world of virtual sets by Vizrt and Vicon

Originally published by TVTechnology Europe

There's been a significant increase in the use of virtual sets for a raft of production genres in recent years. And with that growth has come new and innovative ways of improving the look and complexity of such systems - especially when it comes to tracking.

One of the most recent has resulted from a strategic partnership between Vizrt and motion capture technology specialist, Vicon.

Vicon has been working on this solution with Vizrt for approximately 18 months, explains Warren Lester, product manager at Oxford-based Vicon Motion Systems Ltd.

He goes on to explain that the Vicon solution broadly consists of multiple tracking cameras that observe reflective markers rigidly mounted on the moving studio cameras.

The Vicon cameras generate data that is streamed to Vicon Tracker, a piece of software that then converts this stream of 2d information into precise 3d position and orientation of the studio cameras. This is then broadcast to Vizrt Tracking Hub in real time over a local area network.

Additionally, Vicon Studio is a setup wizard that automatically measures the position of the broadcast cameras' sensor relative to the Vicon markers mounted on the camera.

Gerhard Lang, chief engineering officer at Vizrt, adds, Our Viz Virtual Studio is made up of two components - the Studio Manager and Tracking Hub. The Studio Manager provides a visual representation of the studio and allows the operator to design the co-cyc, hiding the limits of the green screen. The Tracking Hub is the central collection and redistribution point for tracking data that's fed from cameras and tracking systems. After receiving the raw data from the systems, it converts it into meaningful information for output by Viz Engine which is used for playout.

Viz Engine is the real-time render engine for virtual sets and immersive graphics. It takes the tracking data converted by the Tracking Hub and adds camera movement and keys the set before rendering the final composition. This now includes camera movement, presenter and virtual set graphics as an SDI or IP output.

Eliminating complexitiesSo, with other tracking systems on the market, what makes this special? The Vicon solution is very scalable and provides tracking capabilities for small to large studios, reveals Lester. Everything being tracked within the studio is measured using the same datum, therefore eliminating complexities found when integrating different tracking solutions, or even combining several of the same. The Vicon solution has a high level of precision which makes it perfect for generating jitter-free tracking, even when used with long focal length lenses and high resolution video.

Currently, the Vicon solution works with Canon and Fujinon lenses with built in encoders, but the company is looking at integrating other devices as and when required. The Vicon system only takes around 30 minutes for a full calibration and then a quick, one-minute daily check takes place to ensure no parameters have changed. This is one of the huge benefits of this partnership - a fast, easy-to-set-up system, maintains Lester.

Lang says that as far as the Vizrt's side of the system is concerned there's no need for calibration. The Viz Virtual Studio application allows us to build virtual environments in any studio space, and means immersive graphics can be used in any environment - including outdoors. It's also designed to be part of the journalist's workflow allowing elements of the virtual studio to be controlled through playlists. These can be defined using templates within a newsroom control system like iNews, ENPS or any other system.

The workflowAll the virtual set background designs exist within the Vizrt database as meta-data that can be easily called up within seconds. This makes changing sets for a studio a really fast job for the operators.

To edit the design of any backgrounds, designers simply open up their set in Viz Artist, and use the software to make the changes they need.

These alterations can be seen live in the virtual set so the designer can create it with the final output in mind - it makes sure they know exactly what kind of space they're working with, says Lang.

Lester adds, If you were setting up the workflow for a specific show the process is really simple. All you need to do is select the camera or cameras and props that are to be used in the Vicon Tracker software. With a high resolution of 16 Megapixels, the Vicon Vantage V16 cameras can be used to track in a practically limitless environment. Realistically, 10-16 cameras are required for a typical studio. And there's no reason why the system cannot be used in an OB environment.

In either case, the vision mixing can be done with any physical units, but also with software-based switchers such as Viz Opus and Viz Mosart automation systems. In fact, no physical switcher is required because the virtual set feeds replicate a camera source for the switcher.

Adding graphicsAny other graphics, such as lower thirds or tickers, can be easily added downstream on the switcher or automation system in the same way as any live production.

This is one of the key things we wanted to address when designing the system so there's is no change in this workflow, declares Lang. If those graphics have to be changed for, say, a breaking news situation, this is where our template-based workflow comes into play. Virtual sets designed in Viz Artist can be created with certain sections that can be controlled by a playlist coming from the journalist. These would typically be a virtual video wall or immersive object.

The journalist can easily make the choice for which graphics to present using templates in their newsro
LINK: http://www.vizrt.com/news/newsgrid/49395/Virtual_sets_and_motion_captu...
See more stories from vizrt

Most recent headlines

06/12/2025

Survey: M&E Embraces Horizontally Integrated Media Archiving Approach

FORT LAUDERDALE, Fla. A new survey from Pixitmedia by Datacore revealed a major shift in the Media & Entertainment industry in media archiving, with 85% of resp...

06/12/2025

Czech TV Deploys LiveU Solutions in 10 OB Vans

HACKENSACK, N.J. LiveU has announced that the national public broadcaster Czech Television has completed one of the largest LiveU live production deployments fo...

06/12/2025

NATAS Celebrates 76th Technology & Engineering Emmy Award Honorees

NEW YORK The National Academy of Television Arts and Sciences (NATAS) presented the Excellence in Production Technology Emmy Award to NASA+ and Dr. Tom Leight...

05/12/2025

2025 Sports Broadcasting Hall of Fame: Curt Gowdy Jr. - Master Storyteller, Nationally and Regionally

2025 Sports Broadcasting Hall of Fame: Curt Gowdy Jr. - Master Storyteller, Nati...

05/12/2025

SVG Sit-Down: Veritone's Sean King on the Power of Mining Video, Audio Data

SVG Sit-Down: Veritone's Sean King on the Power of Mining Video, Audio DataThe company's Data Refinery offers users total control and governance over da...

05/12/2025

Platinum White Paper: Inside the Nashville Predators' Unified, Flexible, Scalable Production System with Ross Video

Platinum White Paper: Inside the Nashville Predators' Unified, Flexible, Sca...

05/12/2025

Netflix Reaches Agreement To Acquire Warner Bros. Following Planned WBD Split

Netflix Reaches Agreement To Acquire Warner Bros. Following Planned WBD SplitThe deal does not include WBDs sports assets like TNT Sports (US, UK, LatAm), Euros...

05/12/2025

FOX Sports Returns to Indianapolis for Primetime Broadcast of Big Ten Championship

FOX Sports Returns to Indianapolis for Primetime Broadcast of Big Ten Championsh...

05/12/2025

SVG Summit 2025 Preview: Digital Engagement & Monetization Workshop Tackles the Future of the Viewer Experience

SVG Summit 2025 Preview: Digital Engagement & Monetization Workshop Tackles the ...

05/12/2025

Atlanta United Lights Up New Emory Healthcare Studio With First Live Broadcast for World Cup Draw

Atlanta United Lights Up New Emory Healthcare Studio With First Live Broadcast f...

05/12/2025

As Messi Takes the Pitch, MLS, Apple, NEP Roll Out Largest MLS Cup Production Ever

As Messi Takes the Pitch, MLS, Apple, NEP Roll Out Largest MLS Cup Production Ev...

05/12/2025

ESPN Enters College Football's Most Intense Month With Elevated Workflows for Championship Week

ESPN Enters College Football's Most Intense Month With Elevated Workflows fo...

05/12/2025

Sorry, Baby, Peter Hujar's Day, Among Sundance Institute-Supported Projects Nominated for 2026 Film Independent Spirit Awards

It's about that time! Awards season is in full swing, and the Film Independe...

05/12/2025

Surprised by Your 2025 Wrapped? Here's a Look at How the Data Comes to Life

Every year, Spotify Wrapped offers a personalized look back at the audio that defined your year. It's a snapshot of your listening habits, designed to tell ...

05/12/2025

Celebrating Spotify's GLOW, RADAR, and EQUAL Artists of 2025

In 2025, Spotify's EQUAL, GLOW, and RADAR programs celebrated women, LGBTQIA , and emerging artists who turned moments into milestones. From breaking record...

05/12/2025

Wi-Fi 7 - Go Beyond Speed to Deliver Security, Trust and Value

In our latest blog, we explain how Wi-Fi 7 rollouts can drive consumer loyalty with value-add services such as consumer cybersecurity. We also explore how this ...

05/12/2025

Netflix to Acquire Warner Bros. in Deal Worth $82.7 Billon

LOS ANGELES Netflix announced it has entered into an agreement to acquire the assets of Warner Bros. for $82.7 billion....

05/12/2025

Gracenote Launches New CTV Ad Platform

NEW YORK Nielsens Gracenote has launched Gracenote Content Connect, a new ad platform that provides agencies, brands, supply-side platforms (SSPs) and demand-si...

05/12/2025

IAB Tech Lab Releases Deals API

NEW YORK In an most important update to the workings of deal-based programmatic advertising, IAB Tech Lab has released version 1.0 of its Deals API for public c...

05/12/2025

Nielsen: NFL Thanksgiving Games Score Big Audiences

NEW YORK Pass the turkey. Pass the stuffing. Pass the cranberry sauce. All are common requests of Americans celebrating Thanksgiving Day with family and f...

05/12/2025

Iris Cloud-Connected Camera Control Platform Now Available

NEW YORK Iris, the new cloud-connected camera control platform, has officially launched with features that turn virtually any PTZ camera into a software-connect...

05/12/2025

Netflix to Acquire Warner Bros. in Deal Worth $82.7B

HOLLYWOOD, Calif. Netflix announced today that it has entered into an agreement to acquire the assets of Warner Bros. for $82.7 billion....

05/12/2025

Iris Cloud-Connected Camera Control Platform Is Now Available

NEW YORK Iris, the new cloud-connected camera control platform, has officially launched with features that turn virtually any PTZ camera into a software-connect...

05/12/2025

FCC Approves AT&T's $1 Billion Acquisition of UScellular Spectrum

WASHINGTON The Federal Communications Commission has approved AT&T's $1.02 billion acquisition of spectrum from UScellular in a decision that was issued sho...

05/12/2025

The Best Coldplay Songs: 21 Tracks That Shoot for the Stars

The Best Coldplay Songs: 21 Tracks That Shoot for the Stars From Yellow to Viva La Vida, Fix You to Paradise, this playlist goes back to the start. December ...

05/12/2025

Zafris Lecture Series Brings Nabil Ayers to Berklee

Zafris Lecture Series Brings Nabil Ayers to Berklee The 32nd annual James G. Zafris Distinguished Lecture series was held on Thursday, November 13, with guest...

05/12/2025

A new Game of Thrones Tale: Official trailer for Sky Exclusive series A Knight of the Seven Kingdoms lands today

Friday 5 December 2025 A new Game of Thrones Tale: Official trailer for Sky Exc...

05/12/2025

Don Lee, Lee Jin-uk, and Lalisa Manobal to Star in Netflix Action Thriller 'TYGO'

Back to All News Don Lee, Lee Jin-uk, and Lalisa Manobal to Star in Netflix Act...

05/12/2025

Give Back Fridays with a twist is back for 2025!

Tis the season of giving once again and this year we've taken our Give Back Fridays' concept and turned it on its head. In the autumn we were approach...

05/12/2025

2025-11-06

Brayden Gogis doesn't remember a time when he wasn't completely fixated on games in all forms. In preschool, when they asked us to dress up as what we ...

05/12/2025

The Grinch steals the spotlight as the theme for The Late Late Toy Show 2025

The Grinch steals the spotlight as the theme for The Late Late Toy Show 2025 Tune in tonight at 9:35pm on RT One and worldwide on RT Player #LateLateToyShow...

05/12/2025

RT Announces New Presenters of Flagship News Programmes

RT Announces New Presenters of Flagship News Programmes New RT Six One News co-presenter Tommy Meskill Sarah McInerney & Justin McCarthy join Morning Ir...

04/12/2025

ToolsOnAir Blackmagic Design HyperDeck Event Presets for just:in mac pro 2025 & just:in linux

ToolsOnAir Blackmagic Design HyperDeck Event Presets for just:in mac pro 2025 & ...

04/12/2025

ToolsOnAir AJA Ki Pro Event Presets for just:in mac pro 2025 & just:in linux

ToolsOnAir AJA Ki Pro Event Presets for just:in mac pro 2025 & just:in linux More Details:Starting with version 5.5, both just:in mac pro and just:in linux sol...

04/12/2025

Young Journalist finalists looking to the future

Wangu Kanuri from Kenya and Godwin Asediba from Ghana are two of this years finalists for Thomsons Young Journalist of the Year Award. The pair are runners-up i...

04/12/2025

SVG Sit-Down: ProximaVision's Claudio Lisman on Why Tethered Drones Could Be a Game-Changer for Live Sports Production

SVG Sit-Down: ProximaVision's Claudio Lisman on Why Tethered Drones Could Be...

04/12/2025

SVG Campus Shot Callers: Imry Halevi, Senior Associate Director of Athletics, Content & Strategic Communications, Harvard University

SVG Campus Shot Callers: Imry Halevi, Senior Associate Director of Athletics, Co...

04/12/2025

Platinum White Paper: LiveU Lightweight Sports Production: A Step Change in Sports Storytelling

Platinum White Paper: LiveU Lightweight Sports Production: A Step Change in Spor...

04/12/2025

London to Riyadh: DAZN Brings the Boxing Glamour to New Production Levels for Benavidez v Yarde in Saudi Arabia

London to Riyadh: DAZN brings the boxing glamour to new production levels for Be...

04/12/2025

Analysis: Paramount Bets on the Battering Ram' with Champions League Play

Analysis: Paramount bets on the battering ram' with Champions League play By Callum McCarthy, Editor-at-Large Tuesday, December 2, 2025 - 10:12 Print ...

04/12/2025

Space City Home Network Launches SCHN+ DTC App for Astros and Rockets

Space City Home Network Launches SCHN DTC App for Astros and RocketsThe Rockets and Astros were previously the lone NBA and MLB teams without a DTC appBy Jason...

04/12/2025

SVG Summit 2025 Preview: Content Workflows Workshop Spotlights Evolution of Sports Media Supply Chain

SVG Summit 2025 Preview: Content Workflows Workshop Spotlights Evolution of Spor...

04/12/2025

New Sponsor Spotlight: Geotech's Patrick Wambold On the Unreal Engine Revolution Taking Place in Sports Broadcasting

New Sponsor Spotlight: Geotech's Patrick Wambold On the Unreal Engine Revolu...

04/12/2025

Curt Gowdy Jr. - Master Storyteller, Nationally and Regionally

Curt Gowdy Jr. - Master Storyteller, Nationally and RegionallyBy Jason Dachman, Editorial Director, U.S. Thursday, December 4, 2025 - 1:52 pm Print This Sto...

04/12/2025

Cutting Through Rocks ( ) Shows the Difference That One Person Can Make for Change

(L-R) Rebecca Lichtenfeld, Mohammadreza Eyni, Sara Khaki, and Judith Helfand att...

04/12/2025

SBS launches Future Frames initiative to support emerging First Nations video editing talent

SBS launches Future Frames initiative to support emerging First Nations video ed...

04/12/2025

L3Harris Supports NOAA's Million Mile Journey to Safeguard Earth from Solar Storms

Coronal mass ejections caused by eruptions on the surface of the sun can have fa...

04/12/2025

Gracenote launches new CTV ad platform making program-level targeting a reality

Gracenote Content Connect enables media ecosystem to precisely align ad campaigns and programming based on rich content signals NEW YORK - December 4, 2025 - N...