Canon Free Viewpoint Tech Used for ESPN+ Full NBA Game Production Virtual camera system provides views from nearly any angle, three-second delay By Ken Kerschbaumer, Editorial Director
Monday, March 21, 2022 - 3:18 pm
Print This Story | Subscribe
Story Highlights
ESPN last week rolled out a volumetric video version of NBA CourtView for an ESPN+ broadcast of a game between the Brooklyn Nets and Dallas Mavericks. The production team relied almost 100% on the Canon Free Viewpoint virtual camera system, which has been installed at the Barclays Center. The result was a viewer experience that was like watching NBA2K on steroids, with sweeping camera views from nearly any angle and with only a three-second delay from the happenings on the court.
The Canon Free Viewpoint system gives the production team ultimate freedom in terms of angles.
We did the entire game as if it was a full six-camera production, says Ed Placey, senior coordinating producer, ESPN. We had six camera stations, with four of them designated for the live pictures and two of them had specialty opportunities with replays. We also had other traditional replay record devices at [ESPN facilities in] Bristol, [CT,] where we produced and directed it; the announcers were also in Bristol. We were dealing with the three seconds of latency, so the announcers needed to be downstream of the latency rather than courtside.
The Canon Free Viewpoint system at the Barclays Center comprises more than 100 Canon Cinema EOS-based cameras and lenses. The video information they capture is processed and turned into data on a proprietary Canon image-processing box behind each camera. The data from all the cameras is sent to a server system that creates a point-cloud 3D model of the players and other objects on the court. A similar system was used to create highlights last month at the NBA All-Star Game in Cleveland.
We've seen technology like this over five to eight years in different forms, says Placey. It's not that it wasn't great technology and something to keep an eye on, but it didn't have the tools necessary to do much with it from a production standpoint that makes it interesting and engaging time and time again. It has to more than just a clip two or three times.
Images are built using voxels, which are units of graphic information that define a point in three-dimensional space (basically, the 3D equivalent of a pixel) combined with RGB values. An operator with a joystick akin to a cabled camera system flies the virtual camera within the virtual environment and builds the clips in a process similar to rendering an animation.
Placey thinks of Canon Free Viewpoint as a virtual version of a cabled camera system. A physical cabled camera system in an arena historically has been difficult to install and operate: the pilot needs to avoid things like hanging scoreboards and backboards, and the device needs to be operated safely relative to the fans in the stands.
The lengths to which directors work to make sure the Skycams don't appear in their other shots is important, he says. In basketball and hockey, the only way they've been able to do that is by keeping it high and out of the way.
The Canon Free Viewpoint system is operated via joystick control.
ESPN brought in drone pilots in to operate the system, which has a joystick that is similar to those of robotic and cabled camera systems. We brought drone operators to [Barclays] for about four games so they could get comfortable with flying it, Placey says. Over the course of those four games, they got better and better.
ESPN's team went in eyes wide open, knowing that the system still has inherent imperfections due to the amount of processing needed, he adds. It's impressive to this point, but it's really only in its infancy. But this gives people a glimpse of the type of things you can do. If you can do it at a higher quality and higher resolution, there are real opportunities you could create as opposed to a clip here or there within a game.
One potential? The ability to get the ultimate look at fouls and other events. Says Placey, We could see what the referee saw, look over their shoulder, and see the player's head snap back.
The production team learned a lot from the first full game. he adds. Replay operations can be tightened up to provide a more optimal viewpoint, and the addition of preset flight paths that could be available at the push of a button would allow the system to take another step forward.
A virtual centerhung scoreboard allowed real video to be a part of the virtual volumetric experience.
Although most of the show existed in the virtual world, there was a way to get real video into the show. A virtual centerhung scoreboard allowed shots like cutaways of coaches or players on the bench, which were not rendered in the virtual environment.
Says Placey, We had the ability to put our own cameras from the main production into the jumbotron so we could always get replays or cutaways.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
15/06/2026
Detach from Direct-Attached: How Remote Editing with EVO Keeps Creative Teams Mo...
14/06/2026
Library captures 1960s R&B/pop drum sound
Following on from their recent wave of plug-in effects, Iconic Instruments have just launched an all-new virtual d...
14/06/2026
HBO Comedy Rooster Shot with URSA Cine 17K 65
Brie Clayton June 14, 2026
0 Comments
Large format brings viewers intimately close to characters.
Black...
13/06/2026
Latest expansion pack includes 252 presets
Devious Machines have recently introduced another expansion for their powerful multi-effects plug-in, Infiltrator...
13/06/2026
Create custom DAW/plug-in controllers using prompts
MetaGrid have recently introduced an all-new AI Builder function to their touchscreen-based control surf...
13/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
13/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
12/06/2026
YES Network and The Gotham Sports App will air seven Athletes Unlimited Softball...
12/06/2026
The United Football League will host its FAST Innovation Suite at the 2026 United Bowl presented by Credit One Bank on Saturday, June 13 at 3:00 p.m. ET at Audi...
12/06/2026
PTZOptics and LayerJot will present live demonstrations at InfoComm 2026 showing how natural-language AI prompting, robotic camera control, and on-device comput...
12/06/2026
MultiDyne Video and Fiber Optic Systems will exhibit at InfoComm 2026, featuring...
12/06/2026
Ateme has announced that Eurovision Services is using Ateme's software-based frame-rate conversion technology for international live event workflows. The de...
12/06/2026
Bitmovin and Simplestream have announced a partnership with Xperi to simplify the launch of OTT streaming services on TiVo OS smart TVs and devices. The collabo...
12/06/2026
Net Insight has announced that a multinational technology company is deploying a...
12/06/2026
MLB Players Inc., the business arm of the MLB Players Association, has announced a partnership with Athletes First to develop and sell brand partnerships across...
12/06/2026
Guntermann and Drunck (G&D) and VuWall have announced the CommandKeyboard-Advanc...
12/06/2026
Comcast Smart Solutions announces a new smart technology deployment with Major L...
12/06/2026
Elevation Worship completed the initial leg of its Elevation Nights 2026 tour ...
12/06/2026
AJA Video Systems has announced KONA IP25 support for Colorfront Transkoder and ...
12/06/2026
Audinate Group Limited (ASX: AD8) will exhibit at InfoComm 2026 (Booth C7321, Ce...
12/06/2026
Pac-12 Commissioner Teresa Gould has announced the appointment of Scott Adametz as Chief Technology Officer. The Pac-12 describes the hire as the first CTO appo...
12/06/2026
Grass Valley has announced AMPP Edge Live, a production system combining Grass Valley hardware, NVIDIA Blackwell GPU acceleration, and AMPP OS in a single platf...
12/06/2026
At one time a trailblazer with the launch of the Longhorn Network, the Universit...
12/06/2026
Ratings Roundup is a rundown of recent rating news and is derived from press rel...
12/06/2026
Chyron has announced PAINT 10.4, an update to its illustrated replay and sports ...
12/06/2026
SVP, Production, Mark Gross: With the new schedule, with not having every Sunday night, it has given us an opportunity to take a step back and reimagine what o...
12/06/2026
For Televisa Technical Engineering Manager Roberto N nez Ibarra and the small team of 12 technicians and two production personnel at the IBC things are already ...
12/06/2026
Simple Steps to Better Acoustics - Taming The Small Room
Most of us mix in spare rooms and small spaces, where the acoustics fight us at every turn. At Gear...
12/06/2026
Latest addition expands vintage-inspired effects palette
Meris' Ottobit pedal range draws its inspiration from vintage gaming consoles, and the latest a...
12/06/2026
Soundbox-based chamber strings series expanded
Sonora Cinematic have just announced the launch of the second instalment in their Soundbox-based chamber stri...
12/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
12/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
12/06/2026
AJA Announces KONA IP25 Integration with Colorfront Software
Brie Clayton June 12, 2026
0 Comments
Collaboration enables uncompressed SMPTE ST 2110 I/O ...
12/06/2026
URSA Cine 12K LF Used to Create Visuals for STUTS' K-Arena Concert
Brie Clayton June 12, 2026
0 Comments
Organic visuals projected on a giant scre...
12/06/2026
MTI FILM Acquires Mango New Edit, Expanding its Global Post-Production Services ...
12/06/2026
AI Point Tracking Speeds Up Complex VFX Tracks in Mocha Pro
Jessie Electa Petrov June 12, 2026
0 Comments
The 2026.5 release adds automatic point trac...
12/06/2026
Bitmovin, a provider of video streaming solutions, has partnered with Simplestream, a provider of OTT and broadcast solutions, and technology provider Xperi, to...
12/06/2026
Leostream Corporation, creator of the world-leading Leostream Remote Desktop Access Platform, today announced Jigsaw24, a leading B2B IT solutions provider wit...
12/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
12/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
12/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
12/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
12/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
12/06/2026
How Aussie indie games and screen are levelling up with IP 11 June 2026
Ari Harrison, Pro Jank Footy
Head of Games Joey Egger and Ari Harrison of Umbrella sha...
12/06/2026
AgentPerf from Artificial Analysis, the industry's first agentic AI benchmark, gives developers, enterprises and infrastructure providers a clear way to com...
Canon Free Viewpoint Tech Used for ESPN+ Full NBA Game Production Virtual camera system provides views from nearly any angle, three-second delay By Ken Kerschbaumer, Editorial Director 
