MLB Returns: Inside Fox Sports' Virtual-Fans Effort With SMT, Silver Spoon, Pixotope The technology holds promise even for when venues are filled once again By Ken Kerschbaumer, Editorial Director
Tuesday, September 1, 2020 - 12:34 pm
Print This Story | Subscribe
Story Highlights
Fox Sports' coverage of the 2020 MLB season has featured one of the more interesting solutions for dealing with a stadium without fans: add digital fans. The goal is to both fill the stands of MLB games and lay the groundwork for more augmented reality within a live sports production.
Virtual fans are especially effective on wide shots.
The idea is to augment the broadcast, not take away from it, says Dan Pack, managing director/partner, Silver Spoon, the company that gives each of the digital fans life via its Crowded software (with a tech assist from Pixotope and SMT). We want to show broadcasters that there is a lot of value in using AR.
Mike Davies, SVP, technical and field operations, Fox Sports, notes that the visual difference in seeing an empty venue vs. seeing a venue full of fans, even if they are virtual, is striking.
The big thing is that Fox isn't trying to fool anyone here; everyone knows there are no fans, he says. But we are in the business of making a better presentation, and I think that this technology accomplishes this goal.
Fox, SMT, Pixotope, and Silver Spoon came together in a fairly intricate collaboration, according to SMT COO Kirk Brown. It brought together SMT's technology allowing virtual graphics to be inserted into the broadcast with geospatial precision; Pixotope's platform, based on the Unreal Engine 3D graphics real-time processor; and the Silver Spoon software allowing thousands of fans to be dynamically created and controlled instantly.
For this project, he explains, we have four cameras at every venue, taking the pan, tilt, zoom, and focus from each camera and doing image stabilization. That gives rock-solid information to Pixotope, which then takes the animated graphics from Silver Spoon and places them in the precise location in the stadium so we can make the effects look as real as possible.
The trick is to make sure the virtual fans are placed accurately within their seats. That process begins by taking scans of each stadium from MLB and Fox Sports, showing exactly where the stands, tunnels, and other physical elements are located relative to seats.
We performed the same thing for The MLS Is Back,' providing a series of virtual Jumbotrons and virtual advertising on the far side and ends of the field, says Brown.
Pack notes that the work leading to the Fox Sports implementation actually began for a different sport and a different network. At first, we were half joking about it, but we kept cracking at it and had a little bit of time to develop and put this together for Fox.
The Crowded software runs in real time and at 60 fps and is produced onsite at each ballpark. Each character Silver Spoon creates begins with motion capture that records the various states a fan will experience during a game.
Silver Spoon does a tremendous amount of motion capture in its studio, and that is where the process of creating virtual fans begins: by capturing a variety of motions and reactions from fans.
You start with a neutral position, Pack explains. If there is a pop-up to the outfield, the crowd stands up, and they can start cheering or booing. It all has to happen in a way that looks natural and isn't jarring.
He describes the process of animating each character as a bit like pulling puppet strings: It's fun and built in a way that is scalable and customizable as we preload all the approved logos and build out a series of outfits, shirts, pants, etc. Then we can customize those on the fly with colors and skin tones. And everything with crowd simulation is about making it feel random, but, at the same time, you have control over everything.
Not every game with virtual fans needs to be a sellout.
Director, the Pixotope system, is based on the Unreal Engine 3D graphics real-time processor. Pack says the graphics GUI allows operators to communicate with all of the Unreal Engine machines at one time. He says the Pixotope Director platform is great because it can process multiple cameras at once, allowing cuts from one of the four cameras to another to be seamless and done efficiently.
Getting the fans into the stands begins with the scan, tagging all of the seats, and then narrowing down the virtual crowd to fit into the individual section.
If there are any discrepancies, he adds, we can paint in or erase part of the crowd by just moving the mouse over it.
Even when fans return to the ballpark, there will be uses for more AR technologies. Virtual mascots can be branded and placed into real-world environments. And things like moments of exclusivity, when a stadium is Coca-Cola red or Pepsi blue, for example, can be taken to new heights. And Super Bowl halftime shows will never be the same.
We want to make it respectful of the game and also more encompassing, says Pack.
The next goal, he adds, is to reduce the footprint required onsite, including the ability to do the insertion from a remote location. It's all about lowering the barrier to entry. Right now, the big issue is the hardware required to run it. If we can centralize the production, broadcasters can use more machines at a lower cost per game.
The current offering shows the work that still needs to be done (and, eventually, will be done, given the trajectory of technology and processing power) to bring virtual fans to every corner of a ballpark. For example, placing virtual fans behind home plate needs another leap of capabilities to allow the foreground objects - batter, umpire, pitcher - to be separated from the background object - the se
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
13/05/2026
New Adobe Premiere Color Grading Mode Accelerated on NVIDIA GPUs
Joel Pennington May 13, 2026
0 Comments
New NVIDIA RTX-accelerated features streamlin...
13/05/2026
Grass Valley announced that dB Broadcast has delivered new IP-based outside broadcast (OB) trucks for Cloudbass, featuring Grass Valley LDX 100 Series cameras a...
13/05/2026
Ikegami will exhibit the latest additions to its wide range of broadcast production cameras, control units, viewfinders and monitors on stand 5D3-1 at Broadcast...
13/05/2026
FISE, working with the founding members of the XR Sports Alliance (XRSA), Accedo, Qualcomm Technologies, Inc. and HBS, have collaborated to develop an immersive...
13/05/2026
Canon Unveils New EOS R6 V Full-Frame EOS Camera and RF20-50mm F4 L IS USM PZ Bu...
13/05/2026
Boston Conservatory at Berklee Honors Beth Morrison and Moses Pendleton at Comme...
13/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
13/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
13/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
13/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
13/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
13/05/2026
Creative software developer Foundry today announced the latest developments on Nuke Stage. A purpose-built application for end-to-end virtual production and in-...
13/05/2026
A definitive portrait of one of Ireland's most influential musicians
New TV documentary airs Monday 18 May on RT One and RT Player at 9.35pm
Watch the...
13/05/2026
Agentic AI is changing the way users get work done. Following the success of OpenClaw, the community is embracing new open source agentic frameworks. The latest...
13/05/2026
Reinforcement-learning agents - AI systems that learn by trial and error - can c...
12/05/2026
Beyond the Hype: A Strategic Post-Hoc Analysis of NAB 2026 If NAB Show 2026 had an underlying theme, it was a quiet, industry-wide pivot from the high-energy sp...
12/05/2026
Guntermann and Drunck (G&D), a Panoptec Technologies Group company, and CT Square, led by Chandresh Shah, have announced a joint venture to distribute G&D and V...
12/05/2026
With 30 days until the start of the FIFA World Cup 2026, Telemundo, the exclusive Spanish-language home of the tournament in the United States, has announced th...
12/05/2026
The NHL has announced the return of Stanley Pup for its third consecutive year, a 90-minute special featuring adoptable rescue dogs competing on a miniature rin...
12/05/2026
NBCUniversal presented its 2026 Upfront to advertisers at Radio City Music Hall, detailing upcoming programming across NBC, Peacock, Bravo, and Versant properti...
12/05/2026
FOX Sports has announced funding for the Fandom and Social Connection Initiative at Harvard Kennedy School's Shorenstein Center on Media, Politics, and Publ...
12/05/2026
TNDV and Live Media, both divisions of Live Media Group, supported live broadcast coverage around NCAA Final Four weekend in Indianapolis, including the March M...
12/05/2026
The European Football Alliance (EFA) has announced a content distribution agreement with Fubo Sports Network, the free ad-supported streaming TV (FAST) channel ...
12/05/2026
For the first time, Spanish-speaking fans in the U.S. will have two separate tel...
12/05/2026
CP Communications led a comprehensive spectrum management initiative on behalf of Churchill Downs during Kentucky Derby week, coordinating RF assets across the ...
12/05/2026
LiveU has announced a strategic partnership with DRONERESPONDERS, a 501(c)3 non-...
12/05/2026
Open Broadcast Systems has announced that BMC TV, a specialist in IP transport of broadcast content, has selected the Open Broadcast Systems 5G Flyaway solution...
12/05/2026
NEP Europe, part of NEP Group, has announced it will deliver broadcast solutions...
12/05/2026
Grass Valley has announced continued collaboration with Ravensbourne University ...
12/05/2026
Stats Perform has announced the launch of Opta Pulse, an AI-assisted video creation and distribution platform for leagues, rights holders, and broadcasters. The...
12/05/2026
FOX Sports has announced a collaboration with Sesame Workshop to integrate Sesame Street characters into FOX Sports' FIFA World Cup 2026 programming. Conten...
12/05/2026
To date, NHL Productions has produced 19 broadcasts with commentary in American Sign Language
NHL in ASL (American Sign Language) may be just one show, but the...
12/05/2026
Google's Brian Albert: creators, athletes, highlights, nostalgia, second-scr...
12/05/2026
A still from Past Lives by Celine Song, an official selection of the Premieres program at the 2023 Sundance Film Festival. (Courtesy of Sundance Institute | p...
12/05/2026
Spotify is where fans and artists come together, turning discovery into somethin...
12/05/2026
Features patented Marco-MMC clocking technology
Black Lion Audio's latest release combines the company's expertise in clocking with their renowned p...
12/05/2026
New Track Panel, sequencer upgrades & more
Following their recent public beta release, Reason Studios have announced the full release of Reason 14. With the...
12/05/2026
One month to go! SBS reveals expansive FIFA World Cup 2026 lineup beyond the pi...
12/05/2026
Rohde & Schwarz presents its advanced solutions for power electronics testing at...
12/05/2026
aconnic AG (ISIN: DE000A0LBKW6), Munich, has developed a modified fund raising p...
12/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
12/05/2026
Tyrell Corporation, specialists in high-end live sports and entertainment broadcasts, was tasked with delivering compelling broadcast coverage of premier equest...
12/05/2026
Registration is now open for IBC2026 as the global media, entertainment and technology community prepares to converge on the RAI Amsterdam from 11 14 September ...
12/05/2026
Ross Video, a global leader in live video production technology, will present its latest innovations and integrated production workflows at BroadcastAsia 2026, ...
12/05/2026
500 selected leaders from around the world across start-ups, corporates, and venture capital. Over 50bn in assets under management among attending investors, a...
MLB Returns: Inside Fox Sports' Virtual-Fans Effort With SMT, Silver Spoon, Pixotope The technology holds promise even for when venues are filled once again By Ken Kerschbaumer, Editorial Director 
