A new technology is turning heads at the Billie Jean King USTA Tennis Center this year: Replay Technologies' freeD 360-degree-style replay system. Installed at Arthur Ashe Stadium and making its Grand Slam debut on ESPN, the freeD (Free Dimensional Video) system relies on 28 5K cameras, each capturing a 2D image, and a custom algorithm to process the images into the 3D scene. The operator can freeze the action, then turn the perspective to show any angle in the replay.
Replay Technologies' Dror Elbaz
The system itself is very robust, says Dror Elbaz, VP, engineering, Operations Business Unit, Replay Technologies. [It] can be implemented in various fields of sports with minor designated adjustments, derived from the specific sport characteristics (e.g., expected speed of the ball, physical dimensions of the field, indoor/outdoor stadium, etc.).
In the past four years, he continues, freeD systems have already been installed in baseball, basketball, soccer, football, tennis, athletics, and [other] fields. As for tennis in general and Arthur Ashe Stadium in particular, the environment is very convenient in terms of angles and field (background) color, which eases the algorithm's work of extracting the players from the background.
How It Works
The 28-camera complement comprises two wide-angles to see the entire stadium, six cameras with high-magnification zoom, and traditional-coverage cameras. Each camera is connected via optic fibers to a dedicated server custom-designed by Replay Technologies (the server room is adjacent to the freeD control room at Ashe).
Camera positions are defined by two main guidelines: first, to have an optimum area of coverage for the entire court; second, to have an optimal angle enabling coverage of a play from each angle. Elbaz describes it as 28 cameras essentially working together as a 3D scanner to pinpoint any voxel (a value on a regular grid in 3D space) and allow unlimited camera movements from any angle in space.
He explains that the 2D images from the cameras are processed together and the entire space is reconstructed by an algorithm into 3D. After the 3D scene is rendered, he says, the system generates seamless and unlimited virtual camera movement.
The images from the 28 freeD cameras at Arthur Ashe Stadium
Inside the Replay Technologies control room, a pilot and a navigator control the system itself. The pilot works with a producer to define where the camera perspective is to move in the virtual space and determine the exact clip to provide to ESPN. Meanwhile, the navigator works intimately with each aspect of the system to verify that everything is running smoothly in terms of the camera and servers (which are responsible for both processing the images and saving the data generated by the cameras). At the US Open, the Replay Technologies team also has the ability to manually wipe out spectators blocking various cameras in a shot.
Generally, when everything is working automatically, clips are generated in 90-120 seconds, says Elbaz. But here at Ashe, most of the cameras are blocked by spectators, so manual involvement is required to clear the spectators prior to clip rendering. In general, it takes about five minutes.
The clips, he continues, are being generated based on guidelines (such as specific frame to freeze, requested perspective, clip duration and high level path for the virtual camera) by the ESPN producer. The mutual work and coordination are very good, as one side knows the game and desired perspective while the other side knows the way to provide it with the system.
Truly a Multisport Affair
freeD has been a staple at AT&T Stadium in Arlington, TX, used for NBC Sunday Night Football telecasts featuring the Cowboys over the past two seasons, as well as at the 2014 NCAA Men's Basketball Final Four. Although it has worked tennis at the BNP Paribas Open from Indian Wells, CA, this marks freeD's first-ever appearance on any network at a tennis Slam.
From above, a freeD corner camera between stadium lights
Replay Technologies has also deployed freeD for the New York Yankees at Yankee Stadium for YES Network telecasts, the Los Angeles Dodgers at Dodger Stadium for SportsNet LA telecasts, and NBA's All-Star Weekend 2014 at Smoothie King Center in New Orleans for Turner Sports. In addition, the Baltimore Ravens have installed the system at M&T Bank Stadium for the 2015 NFL season.
One of the [company's] main guidelines is pursuing for constant improvements in quality and performance, Elbaz points out. The improvements [are] derived from intensive R&D work, which relies on the system's install base over the different sports.
Each installation, he continues, is being evaluated based on customer demands, the company's knowledge base, and previous similar installations. In Ashe Stadium, the system works with 28 cameras, [but] there are fields in which more cameras are required (e.g., soccer) to cover the entire field or focus on main areas of interest.
The freeD video format, which is a three-dimensional representation of reality, serves multiple platforms and services.
Broadcasters and teams are using it to enhance the fan experience in venues and at home. The next step is to allow people at home to view interactive content from the game. Using a laptop, cellphone, or VR (virtual-realty) headset, fans can create personalized content -how they want to see the game, even from inside the action - and share it with friends.
Viewing freeD content on VR allows fans to place themselves on the field itself. Although it might sound like science fiction, Elbaz notes, several collaborations between Replay and VR-hardware companies are enabling a new level of experience.
Most recent headlines
04/08/2024
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet, a leading technology and service provider for media-rich organizations, a...
04/05/2024
NEW YORK As the Asian Pacific American Heritage Month kicks off in May, Nielsen has released an extensive new report diving into their media habits with data sh...
04/05/2024
PHILADELPHIA As National Military Appreciation Month gets underway, Comcast has announced several new initiatives to help veterans, service members, and their f...
04/05/2024
WASHINGTON, D.C. Federal Communications Commission chairwoman Jessica Rosenworcel has announced a tentative agenda for the May Open Commission Meeting scheduled...
04/05/2024
The Broadband Forum has announced major enhancements to key 5G convergence standards that the group said will help advance next-generation applications, improve...
04/05/2024
Spotify Wrapped Campaign Spot Graded With DaVinci Resolve Studio
Brie Clayton May 3, 2024
0 Comments
Blackmagic Design today announced that Colorist M...
04/05/2024
Three Boston Conservatory at Berklee Alums Nominated for Tony Awards An additional eight alums and two current students performed in nominated productions.
...
03/05/2024
An innovative learning tool to help media and civil society better understand ho...
03/05/2024
PARK CITY, UTAH - JANUARY 21: (L-R) Actors K stutis Cic nas and Greta Grinevi i t , Director Marija Kavtaradze and Producer Marija Razgute attend the 2023 Sunda...
03/05/2024
If you aren't familiar with Danny Ocean's music, it's only a matter ...
03/05/2024
Spotify has an unwavering commitment to supporting emerging artists across all genres, to helping them launch and thrive in their careers, and to connecting the...
03/05/2024
Como uno de los sonidos de mayor expansi n en el mundo, la M sica Mexicana va m ...
03/05/2024
As one of the fastest-growing sounds worldwide, M sica Mexicana is more than jus...
03/05/2024
NEW YORK FuboTV reported that it lost 110,000 subs in Q1 2024 but it exceeded its guidance for the quarter with double digit year-over-year increases across key...
03/05/2024
Only 3 Weeks Left To Enter The Creative Industries Most Award
Brie Clayton May 3, 2024
0 Comments
Creativepool is giving a last call to the creative i...
03/05/2024
WePlay Studios Transforms the Future of Live Event Storytelling with AJA Gear
Brie Clayton May 3, 2024
0 Comments
By 2032, the esports market is expec...
03/05/2024
WASHINGTON Shannon Bream, Fox News Sunday anchor and chief legal correspondent, sat for a keynote chat at The Business of TV News, with Tom Umstead, senior co...
03/05/2024
WASHINGTON Asked how important is local news, Martha Raddatz, who has covered foreign conflicts for decades and moderated presidential debates for ABC News, s...
03/05/2024
Sony Pictures and Apollo Global Management have made a $26 billion cash offer fo...
03/05/2024
CBS announced its 2024-2025 primetime schedule, which features the new dramas NCIS: Origins, Matlock and Watson, and new comedies Poppa's House and Georgie ...
03/05/2024
Sports-focused streaming service Fubo said it reduced its red ink in the first quarter, despite losing 110,000 subscribers since the end of the year....
03/05/2024
Walmart is reportedly about to release a new 4K streaming box/smart speaker hybrid device for Google TV that could retail for as low as $50, according to a repo...
03/05/2024
Enhancements to its Delivery Workspace solution provide increased content delivery robustness and security
By Matthew Corrigan
Published: May 3, 2024
Enha...
03/05/2024
According to reports, if the bid is successful, Sony would be the significant majority shareholder of the new private company
By Jenny Priestley
Published: M...
03/05/2024
Located in Manchesters Spinningfields district, the course aims to equip students with the skills, knowledge and industry insight for a career in the creative s...
03/05/2024
Lightbridge has created a new Cine Reflect Lighting System kit, dedicated to enabling artistic lighting with consideration of today's productivity practical...
03/05/2024
Broadcast media systems integrator BeckTV and Lawo worked together on a large-scale AES67 build of radio control rooms at KPBS, San Diego's NPR and PBS memb...
03/05/2024
Raleigh, NC, April 12, 2024 SmallHD announces PageOS 6, a powerful software update free for owners of SmallHD monitors, featuring increased functionality, exp...
03/05/2024
SmallHD announces the Quantum 32 a new 31.5 OLED monitor designed to provide reference HDR/SDR images for post-production final color grading, as well as cri...
03/05/2024
By 2032, the esports market is expected to grow to $9.29 billion, bolstered by a global player count and fan following that both continue to climb. The 2023 Lea...
03/05/2024
Amagi, the global leader in cloud-based SaaS technology for broadcast and connected TV (CTV), today announced that the 11th edition of the Amagi Global FAST Rep...
03/05/2024
Riedel Communications today announced that Westdeutscher Rundfunk (WDR) is relying on a media and intercom network based on Riedel technology for the renewal of...
03/05/2024
Broadpeak , a leading provider of content delivery network (CDN) and video streaming solutions for content providers and pay-TV operators worldwide, announced t...
03/05/2024
Media technology innovator Limecraft will exhibit the latest updates to its online platform on stand G79 at the 15-16 May 2024 Media Production & Technology Sho...
03/05/2024
Audio interface specialist Prism Sound is partnering with console manufacturer Solid State Logic, professional monitor manufacturer PMC and acoustic panel and d...
03/05/2024
Intinor, Sweden's leading developer of products and solutions for high-quality video over the internet, is set to join forces with its UK partner Zest Techn...
03/05/2024
NAKIVO Inc., a fast-growing software company dedicated to protecting physical, virtual, cloud, and SaaS environments, announced its Q1 2024 financial results to...
03/05/2024
Hiltron Communications announces an addition to its range of satellite communication products and systems: a field-upgradable motorisation kit specifically desi...
03/05/2024
Visit LiveU at Stand D30
With this year an exceptional one for major sporting events alongside multiple, key elections, the power and flexibility of LiveU'...
03/05/2024
Agile Content, the leader in the development of technology and solutions for the provision of television services over the Internet, announces Koldo Unanue as i...
03/05/2024
Eight co-signers representing streaming services, pay TV operators and public interest groups have sent a letter to Congressional leaders urging their Committee...
03/05/2024
BOSTON Brightcove has announced that it has implemented Amazon Q Business, a new generative AI assistant on Amazon Web Services (AWS)....
03/05/2024
NEW YORK CBS has declared that it will finish the 2023-24 season as Americas Most-Watched Network in primetime for the 16th consecutive season....
03/05/2024
A new survey indicates that U.S. businesses and consumers had an overall positive attitude towards their technology spending plans in the first quarter of 2024,...
03/05/2024
Sony and Apollo Global Management have sent an offer letter to Paramount Global's board of directors making an $26 billion all cash offer for Paramount Glob...
03/05/2024
EMG / Gravity Media has appointed Charlie Cubbon chief operating officer (COO) and Jamie Hindhaugh regional CEO for the U.K., U.S., Australia and the Middle Eas...
03/05/2024
Final 2024 Season Games to Air Saturdays on WRAL at 10:30am in May, Championship on June 1
Taping for the final episodes of the 2024 season of WRAL-TV's Br...
03/05/2024
Estrella MediaCo said it is expanding its connected TV portfolio by launching three new channels with Curiosity that will first appear on Samsung TV Plus....
A new technology is turning heads at the Billie Jean King USTA Tennis Center this year: Replay Technologies' freeD 360-degree-style replay system. Installed at Arthur Ashe Stadium and making its Grand Slam debut on ESPN, the freeD (Free Dimensional Video) system relies on 28 5K cameras, each capturing a 2D image, and a custom algorithm to process the images into the 3D scene. The operator can freeze the action, then turn the perspective to show any angle in the replay.
