Sony Pixel Power calrec Sony

Putting in a Good Word: GPU-Powered Crossword Solver Makes Best Showing Yet Against Humans

28/05/2021

What's a three-letter acronym for a video-handling chip ? A GPU, of course. Who knew, though, that these parallel processing powerhouses could have a way with words, too.

Following a long string of victories for computers in other games - chess in 1997, go in 2016 and Texas hold'em poker in 2019 - a GPU-powered AI has beaten some of the world's most competitive word nerds at the crossword puzzles that are a staple of every Sunday paper.

Dr.Fill, the crossword puzzle-playing AI created by Matt Ginsberg - a serial entrepreneur, pioneering AI researcher and former research professor - scored higher than any humans last month at the American Crossword Puzzle Tournament.

Dr.Fill's performance against more than 1,300 crossword enthusiasts comes after a decade of playing alongside humans through the annual tournament.

Such games, played competitively, test the limits of how computers think and help researchers better understand how people do, Ginsberg explains. Games are an amazing environment, he says.

Dr.Fill's edge? A sophisticated neural network developed by UC Berkeley's Natural Language Processing team - trained in just days on an NVIDIA DGX-1 system and deployed on a PC equipped with a pair of NVIDIA GeForce RTX 2080 Ti GPUs - that snapped right into the system Ginsberg had been refining for years.

A way with words: A pair of NVIDIA RTX 2080 Tis powered a sophisticated neural network developed by UC Berkeley's Natural Language Processing team. Crossword fills require you to make these creative multi-hop lateral connections with language, says Professor Dan Klein, who leads the Natural Language Processing team. I thought it would be a good test to see how the technology we've created in this field would handle that kind of creative language use.

Given that unstructured nature, it's amazing that a computer can compete at all. And to be sure, Dr.Fill still isn't necessarily the best, and that's not only because the American Crossword Puzzle Tournament's official championship is reserved only for humans.

The contest's organizer, New York Times Puzzle Editor Will Shortz, pointed out that Dr.Fill's biggest advantage is speed: it can fill in answers in an instant that humans have to type out. Judged solely by accuracy, however, Dr.Fill still isn't the best, making three errors during the contest, worse than several human contestants.

Nevertheless, Dr.Fill's performance in a challenge that, unlike more structured games such as chess or go, rely so heavily on real-world knowledge and wordplay is remarkable, Shortz concedes.

It's just amazing they have programmed a computer to solve crosswords - especially some of the tricky hard ones, Shortz said.

A Way with Words Ginsberg, who holds a Ph.D. in mathematics from the University of Oxford and has 100 technical papers, 14 patents and multiple books to his name, has been a crossword fan since he attended college 45 years ago.

But his obsession took off when he entered a tournament more than a decade ago and didn't win.

The other competitors were so much better than I was, and it annoyed me, so I thought Well, I should write a program,' so I started Dr.Fill, Ginsberg says.

Organized by Shortz, the American Crossword Tournament is packed with people who know their way around words.

Dr.Fill made its debut at the competition in 2012. Despite high expectations, Dr.Fill only managed to place 141st out of 600 contestants. Dr.Fill never managed a top 10 finish until this year.

In part, that's because crosswords didn't attract the kind of richly funded efforts that took on - and eventually beat - the best humans at chess and go.

It's also partly because crossword puzzles are unique. In go and chess and checkers, the rules are very clear, Ginsberg says. Crosswords are very interesting.

Crossword puzzles often rely on cryptic clues that require deep cultural knowledge and an extensive vocabulary, as well as the ability to find answers that best slide into each puzzle's overlapping rows and columns.

It's a messy thing, Shortz said. It's not purely logical like chess or even like Scrabble, where you have a word list and every word is worth so many points.

Crossword puzzles often rely on cryptic clues that require deep cultural knowledge and an extensive vocabulary. A Winning Combination The game-changer? Help from the Natural Language Processing team. Inspired by his efforts, the team reached out to Ginsberg a month before the competition began.

It proved to be a triumphant combination.

The Berkeley team focused on understanding each puzzle's often gnomic clues and finding potential answers. Klein's team of three graduate students and two undergrads took the more than 6 million examples of crossword clues and answers that Ginsberg had collected and poured them into a sophisticated neural network.

Ginsberg's software, refined over many years, then handled the task of ranking all the answers that fit the confines of each puzzle's grid and fitting them in with overlapping letters from other answers - a classic constraint satisfaction problem.

While their systems relied on very different techniques, they both spoke the common language of probabilities. As a result, they snapped together almost perfectly.

We quickly realized that we had very complementary pieces of the puzzle, Klein said.

Together, their models parallel some of the ways people think, Klein says. Humans make decisions by either remembering what worked in the past or using a model to simulate of what might work in the future.

I get excited when I see systems that do some of both, Klein said.

The result of combining both approaches: Dr.Fill played almost perfectly.

The AI made just three errors during the tournament. Its biggest edge, howev
LINK: https://blogs.nvidia.com/blog/2021/05/28/gpu-crossword-ai/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

CBS Sports UEFA Champions League Today Studio Show Heads to Budapest for Final as Transcontinental Popularity Grows

In its sixth year, the broadcaster's coverage has become a global brand and ...

01/06/2026

AudioShake Launches End-to-End Copyright Compliance System for Mixed-Media Audio

Designed to solve a common problem in broadcasting, the automated workflow detects, identifies, removes, and documents copyrighted music AudioShake has introdu...

01/06/2026

SVG Sit-Down: Stats Perform's Charles Kaplan on 30 Years of Opta, a Busy Summer of Soccer, What's Next

The sports-analytics company combines its data with proprietary AI to help leagu...

01/06/2026

Production Music Awards 2026

Category line-up & sponsors announced Photo: Paul Clarke The Production Music Awards (PMA) have announced that submissions are now officially open ahead of...

01/06/2026

Evolve Nest Acoustics from Excite Audio

New hybrid sample/synthesis instrument revealed Excite Audio have just released the latest instalment in their Evolve series, which has been developed in co...

01/06/2026

IK Multimedia release Royal 45 Legends Signature Collection

Latest TONEX expansion captures three rare vintage amps The newest addition to IK Multimedia's ever-growing TONEX line-up introduces a set of three incr...

01/06/2026

Scaler Music Carbon Electra 2

Musically intelligent soft synth gets upgraded Scaler Music will be probably be best known to many for their music theory tools, but their product range al...

01/06/2026

SBS confirms its broadcast sponsors for FIFA World Cup 2026

SBS confirms its broadcast sponsors for FIFA World Cup 2026 1 June, 2026 Media releases SBS has secured Hyundai, Hisense, Macca's, Rexona, bet365, Com...

01/06/2026

Rohde & Schwarz Satellite Industry Days 2026 guided by the motto From Earth to Orbit

Rohde & Schwarz Satellite Industry Days 2026 guided by the motto From Earth to ...

01/06/2026

ASG Advances Joe Marchitto to Western Regional CTO

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

Scripps Stations Go Dark on DirecTV

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

MARSHALL ELECTRONICS POWERS SEAMLESS AV EXPERIENCES WITH...

Marshall Electronics is showcasing a comprehensive lineup of next-generation POV cameras, purpose-built to power today's connected AV environments, at InfoC...

01/06/2026

Adobe Announces Concept to Vector

Adobe Announces Concept to Vector Deepa Subramaniam June 1, 2026 0 Comments One of the biggest frustrations we hear from designers is how difficult it...

01/06/2026

Vampire Feature Night Patrol Graded with DaVinci Resolve Studio

Vampire Feature Night Patrol Graded with DaVinci Resolve Studio Brie Clayton June 1, 2026 0 Comments Colorist shapes dark, gritty tone for horror thri...

01/06/2026

U.S. Broadcasters Ready for Most Complex FIFA World Cup Ever

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

Broadcasters Prepare for Nation's 250th Birthday Bash

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

Broadcasters Reveal What Makes C-Band Alternatives Right for Them

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

IAMT to Offer New Educational Sessions at InfoComm 2026

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

NewsNation Launches New Podcasting Studio and Podcasts

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

Simplifiez vos workflows avec FLAPI. Paris. 2 juin 2026

Mardi 2 juin 14h00 FilmLight (ARRI), 10 rue Ren Boulanger, 75010 Paris Rejoignez-nous pour d couvrir comment FLAPI (l'API FilmLight) peut transformer e...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

31/05/2026

Olivia Prez-Collellmir to Premiere Original Work at Gaud Centennial in Barcelona

Olivia P rez-Collellmir to Premiere Original Work at Gaud Centennial in Barcelona The Berklee graduate and faculty member will debut her choral symphony with...

31/05/2026

Netflix Wins 15 Awards at the Canadian Screen Awards - See Photos From Inside Our Photo Suite

Back to All News Netflix Wins 15 Awards at the Canadian Screen Awards - See Pho...

31/05/2026

Taiwan's Industry Titans Turbocharge World's AI Infrastructure Buildout With NVIDIA

Taiwan is home to more than 500 NVIDIA ecosystem partners. More than 1 million N...

31/05/2026

NVIDIA Factory Operations Blueprint Gives Factories a New AI Brain

As factories move from isolated automation to plant-wide intelligence, manufacturers need AI systems that can connect live machine signals, quality systems, wor...

31/05/2026

NVIDIA AI Cloud Ecosystem Expands Worldwide to Meet Global AI Compute Demand

The NVIDIA AI Cloud ecosystem is accelerating the global buildout of AI factory infrastructure. Partners are expanding capacity to meet growing demand from ente...

30/05/2026

NAB Asks FCC to Shift Regulatory Fee Burden to Big Tech, Broadband

Share Copy link Facebook X Linkedin Bluesky Email...

30/05/2026

NAB Announces 2026 Board Election Results

Share Copy link Facebook X Linkedin Bluesky Email...

30/05/2026

IAB Tech Lab Releases Guidance for Managing AI Crawlers and Bots

Share Copy link Facebook X Linkedin Bluesky Email...

30/05/2026

Zero in on one that says yes (and no)

Zero in on one that says yes (and no) Andy Marken May 29, 2026 0 Comments Hero image courtesy of Deposit Photos For content creators the most difficu...

29/05/2026

InfoComm 2026: NDI Demos NDI 6.3, Hands-On Presentation About Educational Integrations

With InfoComm 2026 just weeks away, NDI is giving attendees plenty of reasons to...

29/05/2026

Bell Media Inks New Long-Term Media Rights Deal for Broadcast, Streaming of the Canadian Football League

Reaffirming a partnership that has defined Canadian sports broadcasting since 19...

29/05/2026

Spring 2026 TV Survey: Vertical Live Matters. The Bigger Story Is Context

Mobile/tablet is No. 2 device for watching TV, suggesting that the sports-production industry needs to take another look at the format Ring Digital's Sprin...

29/05/2026

Germanys Berliner Ensemble Bolsters Backstage Infrastructure With Riedel Stage Systems

Berliner Ensemble, one of Berlin's five major theater companies, has expande...

29/05/2026

InfoComm 2026: Solid State Logic Spotlights TCA Tour, Live V6.2 Software, New SSL Live Trade-in Program

Solid State Logic will showcase its new compact, fly-away TCA Tour audio product...

29/05/2026

Gerald Jerry Pierce, Architect of Modern Digital Cinema, Passes Away at Age 73

Gerald (Jerry) Pierce, a pioneering technologist who helped shape the digital transformation of the motion picture industry, passed away last month on April 12 ...

29/05/2026

CBS Sports Becomes New Home of Barclays Women's Super League Thorough 2029-2030

Paramount+ will be the English-language U.S. home for Barclays Women's Super...

29/05/2026

Calrec Scales ImPulseV to Empower Broadcasters With Greater Choice in Virtualized Workflows

Further strengthening its virtualisation strategy to fully support broadcasters ...

29/05/2026

Switzerlands Canal Alpha Streamlines Playout to Delivery With Harmonic

Swiss broadcaster Canal Alpha has deployed Harmonic's award-winning, software-based XOS Advanced Media Processor to modernize playout operations across cant...

29/05/2026

InfoComm 2026: PTZOptics Showcases Intelligent Video Ecosystem

PTZOptics will showcase a new generation of intelligent video workflows at InfoComm 2026, June 17-19, Las Vegas. Visitors to booth N8227 will see how PTZOptics ...

29/05/2026

Arizona's Family Sports Debuts Direct-to-Consumer Streaming App

Arizona's Family has launched the Arizona's Family Sports (AZFS) streaming app, a new direct-to-consumer destination for live, local sports. The app is ...

29/05/2026

DAZN Brings The Canadian Football Leagues Saturday Night Football to the Masses in New Media Rights Deal

Starting in 2027, DAZN will be the exclusive home of The Canadian Football Leagu...

29/05/2026

Comcast Business Supports Advanced Technology Infrastructure at Levi's Stadium for Fan Experience, Venue Operations

Comcast Business has detailed the advanced network infrastructure it has deploye...

29/05/2026

College Sports-Production Community Gathers in Atlanta for 2026 SVG College Summit

In two-day event, leaders from academia and industry explored solutions to chall...

29/05/2026

TBT Reaches Two-Year Extension With FOX Sports for New-Look $2 Million Tournament

The Basketball Tournament (TBT), now entering their 13th year of competition, ha...

29/05/2026

Roku Expands Premium Subscriptions Experience with FOX One

Roku has launched FOX One as a Premium Subscription on The Roku Channel in the U.S. Roku customers can now subscribe to FOX One using their Roku account for liv...