Live From the US Open: IBM Watson Media Opens Up AI Possibilities for USTA IBM launches suite of solutions for Cognitive Highlights, Closed Captioning, and more By Jason Dachman, Chief Editor
Saturday, September 9, 2017 - 9:57 pm
Print This Story
Story Highlights
IBM has long been a major tech player for the USTA at the US Open, providing backend technology ranging from the US Open app to the SlamTracker point-by-point analysis tool. This year, however, IBM has taken it up a notch, using the Open as its launch platform for IBM Watson Media, a suite of AI-powered solutions on the IBM Cloud that analyze images, video, language, sentiment, and tone. Throughout the tournament, the USTA has used IBM Watson Media's Cognitive Highlights solution to rapidly create and share highlight videos of matches across multiple platforms.
This allows the USTA to produce more highlights at scale, explains John Kent, program manager, sports and entertainment partnerships, IBM. If you asked someone to [produce] highlights for every player of every match on the seven [TV] courts and then push them out to the mobile and social immediately, it would be a monumental task. That's what Watson does as an advisor. There's still a great editorial team and video team here that do a wonderful job creating highlights, but this allows them to produce that content at scale.
Cognitive Highlights Service Makes US Open Debut
Developed at IBM Research with IBM iX, Cognitive Highlights identifies a match's most important moments by analyzing the statistical tennis data, sounds from the crowd, and the reactions of a player, using both action and facial-expression recognition. The system ranks the shots from the seven TV courts at the USTA Billie Jean King National Tennis Center (NTC) and auto-curates the highlights, simplifying video production and ultimately positioning the USTA team to scale and accelerate creation of cognitive-highlight packages.
The Cognitive Highlights platform identifies important moments in a match by analyzing data, crowd sounds, and player reactions.
IBM first piloted the Cognitive Highlights platform at The Masters golf tournament in April and then supplied it as part of the content-production system at Wimbledon two months later. According to IBM, although many editors may fear that AI technology could replace them, the users at these events and the Open embraced Cognitive Highlights once they saw its capabilities first-hand.
As soon as [the edit team] gets their hands on the technology, they [see] it as a tool that can help them be more effective, says Dave Kulczar, senior offering manager, Watson Media. Bringing insights into their existing editorial tools is a big focus for us as well because it allows them to take information and clip it, cut it, repackage it, or put together in a reel. Those are the things that you're never going to automate; those are things that editors are going to do forever. We're just making their job easier.
The finished highlight videos are available in four ways. First, the USTA posts a Highlight of the Day, as ranked by Watson, on its Facebook page each day. Second, fans that favorite players on the US Open apps automatically receive real-time push notifications about those players' highlights (and iOS 10 users can play the highlights within the lock screen). Third, video highlights are available on player bio pages across all USTA digital platforms. And, fourth, highlights are available onsite in the players lounge and in the fan-facing IBM Watson Experience at the NTC.
The USTA is always looking for opportunities to enhance that fan experience, which is where the concept of cognitive highlights come into play, says Kent. On the seven courts being monitored, we are identifying those individual shots that we would call highlight-worthy, and we are coming up with an excitement level based on the crowd cheering, player gestures, and, for the first time here, facial expressions. So we're able to truly understand the emotion of that player and factor that in, as well as the high fives and other gestures.
IBM Watson Media Goes Live With New Products
Although IBM has been piloting Watson-powered AI tools at sports events for several years, the launch of IBM Watson Media signals the company's productization of these solutions.
With IBM Watson Media, we are packaging up real, scalable products that we can build upon and customize for individual media and entertainment clients, says Kulczar. The technology being used here at the US Open is now part of the IBM Watson Media portfolio. We plan on scaling that technology for other environments, other customers, and other sports.
In addition to Cognitive Highlights, IBM Watson Media offers a variety of other AI solutions: Content Search and Discovery, Intelligent Closed Captioning, Recommendation Uplift, and Spotlighting.
Editors are finding that, instead of automating them out of a job, AI solutions like Cognitive Highlights are just another tool.
The Content Search and Discovery solution creates refined, detailed searches of content down to the scene level, based on rich metadata identifying items and context. The idea, says Kulczar, is to annotate both live and VOD content and be able to annotate that with extremely deep metadata in order to more easily search and discover the most relevant highlight clips.
Automated speech-to-text for closed captioning is also key to the Watson Media offering, transcribing audio and improving by learning topic-specific terminology. In addition to Cognitive Highlights, the USTA is using this Intelligent Closed Captioning technology at the Open this year.
[Watson] is listening to the audio and transcribing for closed captioning, Kulczar explains. For each sentence, Watson gives you a confidence level in terms of its a
Most recent headlines
11/12/2025
Dalet, a leading provider of cloud-native, end-to-end media workflow solutions, ...
28/11/2025
Nadia Fall attends the 2025 Sundance Film Festival premiere of Brides at the Egyptian Theatre on January 24, 2025, in Park City, Utah. (Photo by Donyale West/...
28/11/2025
It's easy to ignore those little red update available badges. But when it ...
28/11/2025
WASHINGTON Federal Communications Commission has released a tentative agenda for the December Open Commission Meeting scheduled for Thursday, December 18, 2025 ...
28/11/2025
The Professional Fighters League is looking to super-serve fans of mixed martial...
28/11/2025
Fubo has released in beta on select Roku devices a new feature that lets users display up to four simultaneous streams at once....
28/11/2025
The WNBA playoffs and Week 4 of the NFL regular season highlight the list of live sports events airing on television this weekend....
28/11/2025
The 32nd class of honorees to the B+C Hall of Fame took to the stage at New York's Ziegfeld Ballroom on September 26 for a gala induction event. Click below...
28/11/2025
We hold in our hands the very last Next Text for Next TV, the weekly back-and-fo...
28/11/2025
DirecTV said it made a deal with EchoStar to buy EchoStar's video businesses, including satellite-TV provider Dish TV and virtual MVPD Sling TV, for $1 plus...
28/11/2025
The Broadcasting+Cable Hall of Fame, the premier industry event paying tribute to the influencers, innovators and shining lights of broadcast, cable and streami...
28/11/2025
Friday 28 November 2025
Sky Sports x Slawn drop limited-edition football jersey...
28/11/2025
Rohde & Schwarz shows resilience in a challenging environment, revenue exceeds t...
28/11/2025
Unwrapped: The Toy Show Appeal - airing this Sunday on RT One and RT Player- s...
27/11/2025
LONDON Vizrt has added several AI-driven advanced features offering improved speed, intelligence and accuracy in the newest version of its media asset managemen...
27/11/2025
Prime Video has launched AI-powered video season recaps in a beta version for select English-language Prime Original series in the U.S., a move Amazon is callin...
27/11/2025
Back to All News
Netflix's Raat Akeli Hai: The Bansal Murders Marks a Grand...
27/11/2025
27 Nov 2025
GSMA brings M360 Eurasia 2026 to Samarkand in partnership with VEON...
27/11/2025
Tahar Rahim and Izuka Hoyle star in the gripping six-part Sky Original from Acad...
27/11/2025
Thursday 27 November 2025
Sky Arts Reveals the Nation's Greatest Basslines - and Queen Reign Supreme
The UK's most iconic basslines have been revealed...
27/11/2025
Back to All News
Stranger Things 5': Prepare for One Last Adventure With O...
27/11/2025
The media industry has a paradox at its core. It's an industry built on light, color and imagination, yet behind the scenes, it's powered by one of the ...
27/11/2025
Rating reflects rating progress across areas including policies, diversity & inclusion, health & safety and Net Zero leadership
Winchester, UK, 27 November 202...
27/11/2025
What are the industry standards for Retail Media? Kathryn explains that certification is based on the IAB Europe Retail Media Measurement Standards and the IAB ...
27/11/2025
World champion boxer and Irish sporting icon Katie Taylor will be in studio this...
27/11/2025
Roblox, one of the world's most popular online gaming platforms for primary ...
27/11/2025
Black Friday is leveling up. Get ready to score one of the biggest deals of the season - 50% off the first three months of a new GeForce NOW Ultimate membership...
26/11/2025
SVG Sit-Down: Prime Video EP Mike Muriano Previews Massive Black Friday Slate Fe...
26/11/2025
A cinematic snow sculpture at the 1995 Sundance Film Festival. Photo by Randall Michelson...
26/11/2025
Book podcasts are booming. On Spotify, you'll find everything from celebrity book clubs to deep dives with bestselling authors. And in markets where audiobo...
26/11/2025
Mumbai, November 24, 2025: In a first-of-its-kind initiative, JioStar, in collab...
26/11/2025
LONDON Factual content producer ITN Productions has launched a new low-latency IP gallery for news bulletins....
26/11/2025
MIAMI TelevisaUnivision said it struck a new multiyear distribution agreement with YouTube TV that includes distribution of TelevisaUnivision's U.S. network...
26/11/2025
OpenDrives, Inc., a leader in software-defined data storage and data services, today announced the launch of the Atlas Corporate Creative Solution. This new Atl...
26/11/2025
Disguise, the industry-leading company powering the world's biggest live performances, is partnering with pioneering LED wall manufacturer DVS to give atten...
26/11/2025
HighField AI, the pioneer in agentic and multimodal automation for broadcast and media production, today announced the expansion of its global channel partner n...
26/11/2025
As high-stakes Premier League fixtures approach and additional premium content launches, with MONO positioning themselves to dominate Thailand's sports stre...
26/11/2025
Hosting a wide variety of events from high-intensity NHL games to complex live music concerts and major entertainment productions, Montreal's 21,000 capacit...
26/11/2025
Vizrt, the leader in live production technology revolutionizing viewer engagement and experience, releases AI-driven advances focusing on speed, intelligence, a...
26/11/2025
ITN Productions, an award-winning factual content producer, today launched a new low-latency IP gallery for news bulletins. Responsible for delivering a leading...
26/11/2025
Ikegami reports ongoing advances throughout 2025 in developing and delivering coordinated television production solutions that maximize quality, versatility and...
26/11/2025
Following the Nov. 21 blackout of NBCUniversal channels on Fubo, the two sides have traded barbs about their inability to reach a new carriage deal....
26/11/2025
LONDON As TV sports rights become increasingly important for both broadcasters and streamers, Ampere Analysis predicts global investment in the genre will surpa...
26/11/2025
LOS ANGELES Vubiquity said it has achieved the Amazon Web Services (AWS) Media & Entertainment Competency as part of the AWS Partner Network (APN). This designa...
26/11/2025
WASHINGTON The Federal Communications Commission's Enforcement Bureau said it has entered into a consent decree with Comcast calling for the cable company t...
26/11/2025
Berklee Named to the Hollywood Reporters Top Music Schools List The publication highlights the college's screen scoring program, industry partnerships, and ...
26/11/2025
Back to All News
Animated Series Love Through a Prism' Casts New Light on ...
26/11/2025
Back to All News
NALIP Unveils Fifth Cohort of Director Incubator
Social Impact
26 November 2025
United States
Link copied to clipboard
The National Assoc...
26/11/2025
YouView Achieves Greenly Gold Certification for SustainabilityNov 26, 2025
YouView is proud to announce a Gold Certification award from Greenly for our perform...
Live From the US Open: IBM Watson Media Opens Up AI Possibilities for USTA IBM launches suite of solutions for Cognitive Highlights, Closed Captioning, and more By Jason Dachman, Chief Editor 
