Live From NBA All-Star: Canon Free Viewpoint To Make U.S. Broadcast Debut Improved system takes volumetric video to new level for live sports production and more By Ken Kerschbaumer, Editorial Director
Sunday, February 20, 2022 - 12:11 pm
Print This Story | Subscribe
Story Highlights
The Canon Free Viewpoint volumetric capture system will take its next step tonight during the NBA All-Star Game. More than 100 Canon Cinema EOS-based cameras and lenses inside Cleveland's Rocket Mortgage FieldHouse will be used to give replays a whole new look.
The Canon Free Viewpoint system will allow an operator to fly a virtual camera through volumetric video capture of tonight's NBA All-Star Game.
It has been a long time coming, says Steve Hellmuth, executive vice president of media operations and technology, NBA, noting that discussions with Canon began at NAB in 2019. But Canon was great, soliciting our advice and keeping us updated on the progress. We remained in touch, and Canon decided to grace us with two systems. One has been installed at the Barclays Center in Brooklyn, the other in Cleveland; both will remain in place through the end of the season.
From left: Brent Valenti of Bally Sports Ohio, Steve Hellmuth of the NBA, and Tsuyoshi Wakazono of Canon at the NBA All-Star Game
We decided to install it [at Rocket Mortgage Fieldhouse] because of the All-Star Game and also because the Cavaliers are a great outfit for introducing new technology, he says. They gave us the rack space inside the building and also allowed for the installation of the cameras around the perimeter of the arena.
Tonight's use will emphasize new types of replays: a virtual camera can swoop around and between players and virtually go anywhere in the building.
This will allow us to fly in the arena, notes Hellmuth. It will be like having six drones in the building without any limitations and any liability. He believes all leagues should be looking at volumetric capture because it offers multiple benefits well beyond cool replays.
At the end of the day, he adds, you get player tracking and player positioning, and, with AI, you can generate statistics and can also create metrics that don't exist today. For example, right now, deciding whether a player defended a shot is a manual process, but, with this, you can write into the AI [that, if the hand is here relative to the ball,] it's a defended shot.
The cameras in the system capture the video information, which is processed on proprietary Canon image-processing boxes behind each camera and turned into data. The data from all the cameras is then sent to a server system that creates a point-cloud 3D model of the players and other objects on the court. Images are built using voxels, which are units of graphic information that define a point in three-dimensional space (basically, the 3D equivalent of a pixel) combined with RGB values. An operator with a joystick akin to a cabled camera system flies the virtual camera within the virtual environment and builds the clips in a process similar to rendering an animation.
The system made its public debut at the 2019 Rugby World Cup, where 125 cameras were used, but three years of innovation will result in a more robust production experience.
During the Rugby World Cup, says Tsuyoshi Wakazono, manager, Image Solutions Business Operations, Canon SV Business Planning Department, rendering the replay took about 15 minutes. Now we are integrated into the live broadcast so we can quickly turn around a clip in about 10 seconds and also keep streaming so other highlights can be created.
The applications for volumetric capture are numerous: besides the broadcast and social-media applications, uses range from videogames to VR to officiating, training, and coaching. It creates a perfect VR environment that is free of convergence issues and will allow fans to take seats they wish to take in a VR environment, so it holds tremendous promise, says Hellmuth. All of our videogaming partners are visiting us to create the ideal data set for videogames because they can get a perfect model of the players.
He notes that the benefits extend to the officials, teams, coaches, and players. Officials, for example, could look at plays from any angle and zoom in from any angle, solving one of the big problems in relying on camera angles framed to include multiple players. The virtual environment also will not have the stanchions supporting the hoop and backboard, allowing officials a better view of plays under the basket.
We can now put the virtual camera right behind the basket and looking straight out at the court because the stanchion is gone, adds Hellmuth.
The system does require a lot of storage, about 60 TB per game. But continued improvements in storage, the use of edge computing, and even 5G could make it easier to move the vast amounts of data around.
The amazing thing is, Canon has figured out how to do all of that in only three seconds, says Hellmuth. It's a unique collaboration because Canon understands lenses, imaging, and how to translate that into digital.
The efforts tonight will be part of the Turner Sports production as well as the world feed, the NBA's social-media channels, and more. It's getting a global reception, he adds, and the fact that I've been on the phone with China for a few nights this week shows the interest.
Brent Valenti, senior producer, Bally Sports Ohio, is looking forward to putting the system through its paces for the rest of the season. We'll be playing more with it, and it will help out with our analysis.
Most recent headlines
11/12/2025
Dalet, a leading provider of cloud-native, end-to-end media workflow solutions, ...
28/11/2025
Nadia Fall attends the 2025 Sundance Film Festival premiere of Brides at the Egyptian Theatre on January 24, 2025, in Park City, Utah. (Photo by Donyale West/...
28/11/2025
It's easy to ignore those little red update available badges. But when it ...
28/11/2025
WASHINGTON Federal Communications Commission has released a tentative agenda for the December Open Commission Meeting scheduled for Thursday, December 18, 2025 ...
28/11/2025
The Professional Fighters League is looking to super-serve fans of mixed martial...
28/11/2025
Fubo has released in beta on select Roku devices a new feature that lets users display up to four simultaneous streams at once....
28/11/2025
The WNBA playoffs and Week 4 of the NFL regular season highlight the list of live sports events airing on television this weekend....
28/11/2025
The 32nd class of honorees to the B+C Hall of Fame took to the stage at New York's Ziegfeld Ballroom on September 26 for a gala induction event. Click below...
28/11/2025
We hold in our hands the very last Next Text for Next TV, the weekly back-and-fo...
28/11/2025
DirecTV said it made a deal with EchoStar to buy EchoStar's video businesses, including satellite-TV provider Dish TV and virtual MVPD Sling TV, for $1 plus...
28/11/2025
The Broadcasting+Cable Hall of Fame, the premier industry event paying tribute to the influencers, innovators and shining lights of broadcast, cable and streami...
28/11/2025
Friday 28 November 2025
Sky Sports x Slawn drop limited-edition football jersey...
28/11/2025
Rohde & Schwarz shows resilience in a challenging environment, revenue exceeds t...
28/11/2025
Unwrapped: The Toy Show Appeal - airing this Sunday on RT One and RT Player- s...
27/11/2025
LONDON Vizrt has added several AI-driven advanced features offering improved speed, intelligence and accuracy in the newest version of its media asset managemen...
27/11/2025
Prime Video has launched AI-powered video season recaps in a beta version for select English-language Prime Original series in the U.S., a move Amazon is callin...
27/11/2025
Back to All News
Netflix's Raat Akeli Hai: The Bansal Murders Marks a Grand...
27/11/2025
27 Nov 2025
GSMA brings M360 Eurasia 2026 to Samarkand in partnership with VEON...
27/11/2025
Tahar Rahim and Izuka Hoyle star in the gripping six-part Sky Original from Acad...
27/11/2025
Thursday 27 November 2025
Sky Arts Reveals the Nation's Greatest Basslines - and Queen Reign Supreme
The UK's most iconic basslines have been revealed...
27/11/2025
Back to All News
Stranger Things 5': Prepare for One Last Adventure With O...
27/11/2025
The media industry has a paradox at its core. It's an industry built on light, color and imagination, yet behind the scenes, it's powered by one of the ...
27/11/2025
Rating reflects rating progress across areas including policies, diversity & inclusion, health & safety and Net Zero leadership
Winchester, UK, 27 November 202...
27/11/2025
What are the industry standards for Retail Media? Kathryn explains that certification is based on the IAB Europe Retail Media Measurement Standards and the IAB ...
27/11/2025
World champion boxer and Irish sporting icon Katie Taylor will be in studio this...
27/11/2025
Roblox, one of the world's most popular online gaming platforms for primary ...
27/11/2025
Black Friday is leveling up. Get ready to score one of the biggest deals of the season - 50% off the first three months of a new GeForce NOW Ultimate membership...
26/11/2025
SVG Sit-Down: Prime Video EP Mike Muriano Previews Massive Black Friday Slate Fe...
26/11/2025
A cinematic snow sculpture at the 1995 Sundance Film Festival. Photo by Randall Michelson...
26/11/2025
Book podcasts are booming. On Spotify, you'll find everything from celebrity book clubs to deep dives with bestselling authors. And in markets where audiobo...
26/11/2025
Mumbai, November 24, 2025: In a first-of-its-kind initiative, JioStar, in collab...
26/11/2025
LONDON Factual content producer ITN Productions has launched a new low-latency IP gallery for news bulletins....
26/11/2025
MIAMI TelevisaUnivision said it struck a new multiyear distribution agreement with YouTube TV that includes distribution of TelevisaUnivision's U.S. network...
26/11/2025
OpenDrives, Inc., a leader in software-defined data storage and data services, today announced the launch of the Atlas Corporate Creative Solution. This new Atl...
26/11/2025
Disguise, the industry-leading company powering the world's biggest live performances, is partnering with pioneering LED wall manufacturer DVS to give atten...
26/11/2025
HighField AI, the pioneer in agentic and multimodal automation for broadcast and media production, today announced the expansion of its global channel partner n...
26/11/2025
As high-stakes Premier League fixtures approach and additional premium content launches, with MONO positioning themselves to dominate Thailand's sports stre...
26/11/2025
Hosting a wide variety of events from high-intensity NHL games to complex live music concerts and major entertainment productions, Montreal's 21,000 capacit...
26/11/2025
Vizrt, the leader in live production technology revolutionizing viewer engagement and experience, releases AI-driven advances focusing on speed, intelligence, a...
26/11/2025
ITN Productions, an award-winning factual content producer, today launched a new low-latency IP gallery for news bulletins. Responsible for delivering a leading...
26/11/2025
Ikegami reports ongoing advances throughout 2025 in developing and delivering coordinated television production solutions that maximize quality, versatility and...
26/11/2025
Following the Nov. 21 blackout of NBCUniversal channels on Fubo, the two sides have traded barbs about their inability to reach a new carriage deal....
26/11/2025
LONDON As TV sports rights become increasingly important for both broadcasters and streamers, Ampere Analysis predicts global investment in the genre will surpa...
26/11/2025
LOS ANGELES Vubiquity said it has achieved the Amazon Web Services (AWS) Media & Entertainment Competency as part of the AWS Partner Network (APN). This designa...
26/11/2025
WASHINGTON The Federal Communications Commission's Enforcement Bureau said it has entered into a consent decree with Comcast calling for the cable company t...
26/11/2025
Berklee Named to the Hollywood Reporters Top Music Schools List The publication highlights the college's screen scoring program, industry partnerships, and ...
26/11/2025
Back to All News
Animated Series Love Through a Prism' Casts New Light on ...
26/11/2025
Back to All News
NALIP Unveils Fifth Cohort of Director Incubator
Social Impact
26 November 2025
United States
Link copied to clipboard
The National Assoc...
26/11/2025
YouView Achieves Greenly Gold Certification for SustainabilityNov 26, 2025
YouView is proud to announce a Gold Certification award from Greenly for our perform...
Live From NBA All-Star: Canon Free Viewpoint To Make U.S. Broadcast Debut Improved system takes volumetric video to new level for live sports production and more By Ken Kerschbaumer, Editorial Director 
