NBA Virtual-Reality Broadcasts on Oculus Fueled By Fully Cloud-based Decentralized Workflow

NBA Virtual-Reality Broadcasts on Oculus Fueled By Fully Cloud-based Decentralized Workflow Through The Switch and AWS, MediaMonks takes live VR sports production into the cloud By Brandon Costa, Director of Digital

Tuesday, May 11, 2021 - 12:56 pm

Print This Story | Subscribe

Story Highlights

In a challenging season of evolving COVID-based protocols, limited fan attendance, and national broadcast partners' taking much of their live game production remote, the NBA has managed to uphold its reputation as one of the nation's most progressive professional sports leagues.

That includes leading the way on NFTs (through NBA Top Shot), sports-betting-based alternative streaming broadcasts, and, yes, even virtual reality.

The NBA has partnered with Facebook to deliver a package of live games in virtual reality on the Oculus platform.

Through its partnership with Facebook, the NBA has delivered a package of 10 VR broadcasts of live games on the Oculus Quest platform, the last of which - between the Toronto Raptors and Dallas Mavericks - will stream Friday evening.

Consumable on Oculus Quest's Venues app, this season's edition of the NBA's live VR experience brings users (and their dynamic avatars) into a suite-like experience to interact with other fans of their choosing while watching a produced, multi-camera live presentation of the game itself.

Yet, although the consumer side of the production has been advanced significantly by pushing the quality of the video to 4K at 60 fps, perhaps the most radical and impactful changes are behind the scenes, where the entire live experience is being produced via a new decentralized model with the crew working from numerous locations around the globe.

The Key First Mile to the Cloud The NBA and Facebook have entrusted international creative digital-production company MediaMonks to produce the live game coverage and assist with marrying it to the Venues app experience within Oculus.

Camera specialist Alan Bucaria sets up one of four cameras used to shoot the VR broadcast. Bucaria is one of just two-three people required at the arena to make the production possible. (Photo Courtesy: MediaMonks)

MediaMonks' team has logged plenty of reps working NBA VR experiences in the past, but, when it became clear that conditions at NBA arenas were going to be quite different this season given careful resumption of play amid the coronavirus pandemic, it was understood that this slate of productions would be the most challenging yet.

Unable to travel staff and have a large technical presence onsite, MediaMonks had to get creative. Like many broadcasters throughout this pandemic, it would need to find a way to produce from home - literally. The agency would assemble a completely decentralized workflow that would allow the entire production to be done in the cloud.

The key to decentralization came in unlocking the connectivity. MediaMonks turned to The Switch for its high-capacity, low-latency first-mile connectivity into every NBA arena. This enabled The Switch to extend a direct peering with AWS via a private Direct Connect which MediaMonks accessed directly from the NBA Venue panel. The ability to funnel 4K video signals over those pipes (The Switch network) out of the arena and into the cloud was the critical element that enabled the entire show.

A chart of the signal workflow behind the NBA VR experience. (Courtesy: MediaMonks)

The signal workflow is relatively straightforward (see image at right). From AWS Direct Connect, the camera signals are fed through nine softwareSRT decoders into TouchDesigner for 3D mapping and custom projection. From there, it runs into Vizrt's Viz Vectar Plus production-switching system controlled by Central Control where the crew can tap in and work from their respective homes to build the final product, which is transmitted to Oculus headsets through AWS Cloudfront.

This workflow sounds terrifying and bizarre, says Lewis Smithingham, MediaMonks' Director of Creative Solutions, but, once it got up and running, it has been one of the more stable shows that we've ever run.

Minimal Onsite Presence At the arena on a game night, the MediaMonks team has to deploy little more than a collection of five cameras and a small, 12 rack unit rolling case housing a collection of Haivision Makito X4 encoders.

The only gear required on-site for the production are five Sony cameras and a 12 RU rolling case of Haivision Makito X4 encoders. Those encoders leverage The Switch's in-venue network to transport the camera feeds to AWS Direct Connect. (Photo Courtesy: MediaMonks)

With the team looking to stick with more-traditional broadcast elements, these games are not produced with some special VR rig, which previous major VR projects across the industry may have used. Instead, these games are shot using Sony FX6 full-frame cinema cameras outfitted with Canon EF 8-15mm fisheye lenses. They are positioned in four spots in the arena: high center court, low center court, and under each basket.

Only two to three crew members are needed onsite: VR Broadcast Engineer in Charge Ken Stiver and Camera Lead/Live Tech Alan Bucaria, supported by Broadcast Engineer Adam Roth, or a local utility. Everyone else involved in the show works on equipment in their own homes.

Says Smithingham, It's liberating as a manager to be able to recruit the talent that I want for this show, [rather] than be restricted to just who can get to the truck.

Bringing in Talent Far and Wide The show is steered by a crew more than 15 people deep, all working from home in locales ranging from Orlando to New York, New Jersey, Los Angeles, San Francisco, Arkansas, London, Nottingham, Buenos Aires, and S o Paolo.

Among those behind the scenes were Solutions Architect Lead Jason O'Malley, Broadcast and Films Senior Technica

LINK:	https://www.sportsvideo.org/2021/05/11/nba-virtual-reality-broadcasts-...
	See more stories from svg

More from Sports Video Group