Sony Pixel Power calrec Sony

Just What You're Looking For: Recommender Team Suggests Winning Strategies

20/07/2021

The final push for the hat trick came down to the wire.

Five minutes before the deadline, the team submitted work in its third and hardest data science competition of the year in recommendation systems. Called RecSys, it's a relatively new branch of computer science that's spawned one of the most widely used applications in machine learning, one that helps millions find what they want to watch, buy and play.

The team's combination of six AI models packed into the contest's limit of 20 gigabytes all of the smarts it culled from studying 750 million data points. An unusual rule in the competition said the models had to run in less than 24 hours on a single core in a cloud CPU.

They hit the submission button and waited.

Twenty-three hours and 40 minutes later an email arrived: They hit No. 1 on the leaderboard.

Right Under the Buzzer On June 28 it was official, a seven-member NVIDIA team won for the second time the ACM RecSys Challenge.

The email came in right under the buzzer - 20 minutes later and we would have timed out, said Chris Deotte, one of several team members who's also a grandmaster in Kaggle competitions, the online Olympics of data science.

We were really on the edge, said Benedikt Schifferer, a teammate who helps design NVIDIA Merlin, a framework to help users quickly build their own recommendation systems.

GPUs could have busted through the inference job in a fraction of the time. Adapting the work to one CPU core was like going back to the distant past, said Gilberto Giba Titericz, a Brazil-based Kaggle grandmaster on the team.

In fact, once the competition was over, the team demonstrated the inference job that took nearly 24 hours on a CPU core could run on a single NVIDIA A100 Tensor Core GPU in just five and a half minutes.

Sorting 40M Items a Day For that competition, Twitter gave participants millions of data points a day for 28 days and asked them to predict which tweets users would like or retweet. It was an industrial-strength challenge from the leading technical conference on RecSys, an event that draws a who's who of top engineers from Facebook, Google, Spotify and other players.

Part of the RecSys Challenge team (clockwise from upper left): Bo Liu, Benedikt Schifferer, Gilberto Titericz and Chris Deotte. The discipline is as hard as it is helpful. Recommendation systems fuel our digital economy, serving up suggestions faster and smarter than a traditional search.

Industry challenges help advance the field for everyone, whether they're seeking the perfect gift for a spouse or trying to find an old friend online.

Three Wins in Five Months Earlier this year, the full NVIDIA team led a field of 40 in the Booking.com Challenge. They used millions of anonymized data points to correctly predict the final city a vacationer in Europe would choose to visit.

In June, another top recsys contest, the SIGIR eCommerce Data Challenge, set an even higher hurdle.

SIGIR challenge winners include (clockwise from upper left) Ronay Ak, Sara Rabhi, Md Yasin Kabir and team leader Gabriel Moreira. The annual meeting of the Special Interest Group on Information Retrieval, SIGIR, draws experts from companies that span Alibaba to Walmart Labs. Its 2021 challenge provided 37 million data points from online shopping sessions and asked participants to predict which products users would buy.

Overlap with the ACM contest forced the NVIDIA team to split into two groups that coordinated their efforts between the contests. Ratcheting up the pressure, some team members were heads down writing a paper for the ACM RecSys conference.

The Art of the Fast Break Two factors propelled a five-person NVIDIA team with members spread across Brazil, Canada, France and the U.S. to the best overall performance, taking first or second place in every leaderboard. They made a big bet on Transformer models developed for natural-language processing and increasingly adopted for recsys, and they understood the art of the handoff.

As one member is going to bed another picks up the work in a different time zone, said Even Oldridge, who leads the Merlin group.

When it all clicks, it's very effective, and I'm amazed at what we've accomplished in the last year building our internal knowledge and our standing in the recsys community to the point where we could win three major competitions in five months, he said.

Respecting User Privacy The contest required models to make predictions with no background on users beyond their current browsing session.

That's an important task because sometimes users want to browse anonymously, and some privacy laws limit access to historical information, said Gabriel Moreira, a senior Merlin researcher in S o Paulo who led NVIDIA's SIGIR team.

The competition marked the first time the team used only Transformer models in their solution to a challenge. Moreira's team aims to make the massive neural networks more easily available to every Merlin customer.

From a Hat Trick to a Haul On June 30, we notched a fourth consecutive win in RecSys, what hockey players call a haul. MLPerf, an industry benchmarking group, announced that NVIDIA and its partners set records in all its latest training benchmarks, including one in recommendation systems.

The team behind that effort described its work training a recommendation system in less than a minute on 14 NVIDIA DGX systems, a 3.3x speedup compared to their submission a year ago.

Sharing Lessons Learned The competitions fuel ideas for new techniques that find their way into recsys frameworks like Merlin and related tools, papers and online classes held by the NVIDIA Deep Learning Institute. The ultimate goal: Help everyone succeed.

In interviews NVIDIA's recsys experts freely shared their know-how - part art, part science.

A Pro Tip on RecSys One best practice is
LINK: https://blogs.nvidia.com/blog/2021/07/20/recommendation-systems-winner...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

08/10/2026

Life Safety, Part 2: From Noise to Nice: The Evolution of Speech Intelligibility in Stadium Sound

Modern venues have come a long way since the tinny, echoing audio of the mid 20t...

08/10/2026

ESPN's First Super Bowl Adds Disney+ to U.S. Distribution Mix

ESPN's first Super Bowl production will stream in English and Spanish on Disney+, while the ESPN App carries the full slate of game, ManningCast, studio, an...

08/10/2026

SVG Students To Watch: Addison McGhee, Auburn University

From high-school videoboards to War Eagle Productions, the Opelika native is learning how to lead shows and capture big moments The future of live sports produ...

08/10/2026

Prime Video to Become Exclusive Global Home of Emmy Awards Beginning in 2027

The Television Academy and Prime Video have announced a six-year agreement making Prime Video the exclusive global home of the Emmy Awards beginning with the 20...

08/10/2026

Techex to Demonstrate Hybrid Satellite and IP Delivery Platform at NAB Show New York

Techex will exhibit at NAB Show New York 2026 (Booth 623, Javits Center, October...

08/10/2026

X Games Appoints Steve Rogers as Chief Operating Officer

X Games has announced the appointment of Steve Rogers as Chief Operating Officer. Rogers previously served as COO of World Supercross and spent nearly a decade ...

08/10/2026

Fonn Group Appoints Trevor Spielmann as Sales Director, DACH

Fonn Group has appointed Trevor Spielmann as Sales Director for Germany, Austria, and Switzerland. Spielmann joins from EVS, where he held sales and business de...

08/10/2026

Perfect Game Introduces New Studio Show on the Road With Launch of PG Central

The flagship program will originate from major PG events with a four-camera production, live distribution across PGTV, social platforms Perfect Game is bringin...

08/10/2026

Uplynk White Paper: The IP Convergence Framework for Distribution

Innovation rarely happens in a vacuum. More often, it happens at the point of collision: when worlds that have run on separate tracks begin to converge. That is...

08/10/2026

Gravity Media Op-Ed: Gravity Media's Next Act - From Service Provider to Strategic Content Partner

For decades, the production and broadcast services business has run on a familia...

08/10/2026

Uplynk, Zixi, BroadView Software, and Grass Valley Publish Satellite-to-IP Distribution Framework

Uplynk, Zixi, BroadView Software, and Grass Valley have published The IP Converg...

08/10/2026

NFL Announces Ninth Annual Big Data Bowl Powered by AWS

The NFL has announced the return of the Big Data Bowl, the league's analytics competition, now in its ninth year and again powered by AWS. Registration is o...

08/10/2026

Eutelsat Renews Partnership with Tldiffusion dAlgrie on EUTELSAT 7 West A

Eutelsat has renewed its partnership with T l diffusion d'Alg rie (TDA), Algeria's national broadcasting network operator, for continued distribution of...

08/10/2026

Disney+ to Stream Super Bowl LXI on February 14, 2027

Disney will livestream Super Bowl LXI on February 14, 2027, alongside the game's broadcast on ESPN and ABC. All Disney subscribers in the United States wi...

08/10/2026

RHStv to Stream Clemson vs. Coastal Carolina Baseball at Myrtle Beach Fall Showdown

RHStv and Red House Streaming have announced an expansion of their partnership w...

08/10/2026

Gray Media to Simulcast 15 Timberwolves Games Free Over-the-Air in Minnesota and Wisconsin

Gray Media has announced a distribution agreement with TEGNA and DAZN to simulca...

08/10/2026

SMPTE Media Technology Summit Returns to Pasadena Nov. 16-19; Get 10% Off With SVG Promo Code

SVG readers can save 10% on registration and receive a complimentary Solutions H...

08/10/2026

PROTON Camera Innovations Named Recipient of 2026 Technology and Engineering Emmy for FPV Drone Systems

PROTON Camera Innovations GmbH has been named a recipient of a 2026 Technology a...

08/10/2026

Silver Lining: Sharing Tales From the Trenches of Cloud-Based Production with NBC Sports, MLB, NHL, and Warner Bros. Discovery

Industry leaders discuss real-world cloud workflows for live game production, pl...

08/10/2026

Dolby Atmos Coming to Formula 1 on Apple TV Beginning with 2026 U.S. Grand Prix

The next-gen audio technology joins Dolby Vision as part of Apple TV's immersive F1 experience...

08/10/2026

Free Leonard Peltier Proves That the Fight for Justice Is Just Beginning

David France, Jesse Short Bull, Mato Wayuhi, N. Bird Runningwater, Jodi Archambau, Jhane Myers, Paul McGuire, Amber Morning Star Byars, Holly Macarro, Nick Tils...

08/10/2026

Sound Particles update Energy Panner 2 & Brightness Panner 2

Dynamic panning plug-ins get an upgrade Sound Particles have just announced major updates for two of their popular dynamic panning plug-ins. Energy Panner 2...

08/10/2026

The DMNO ON from UDO Audio

New expandable instrument boasts full DMNO engine UDO Audio have just announced the upcoming release of a new, expandable synth that packs the power of the ...

08/10/2026

ADAM Audio introduce the Sub8 PRO & Sub10 PRO

Two new subwoofers added to monitoring line-up ADAM Audio's monitoring range has just been expanded with two new DSP-equipped subwoofers, the Sub8 PRO a...

08/10/2026

Clear-Com Powers Critical Communications at Rock in Rio 2026

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

08/10/2026

NAB New York 2026 Preview

Calrec gives broadcasters freedom of choice at NAB Show New York We're looking forward to meeting up with you all at NAB New York on 21st-22nd October. Cal...

08/10/2026

ESPN Unveils First Studio W Refresh

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Pay-TV Operators Ask FCC to Pause TV Station Ownership Cap Rules

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Calrec Brings New Consoles, Software to NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Mediagenix Bows AI Content-Aware Scheduling

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ikegami to Unveil UHK-X700VN Camera at NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ed McGivern Joins USSI Global as Chief Revenue Officer

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Globecast Brings Media Orchestration and C-Band Transitio...

Globecast, a leading provider of broadcast, media and entertainment managed services, will showcase its next generation of media orchestration services at NAB S...

08/10/2026

Clear-Com Powers Critical Communications at Rock in Rio 2...

Clear-Com played a critical role in the production communications infrastructure for Rock in Rio 2026, one of the world's largest and most recognized music...

08/10/2026

Sohonet Launches ClearView Rush: A Leap Forward in Studio Review, Built for Creative Executives

Sohonet Launches ClearView Rush: A Leap Forward in Studio Review, Built for Crea...

08/10/2026

NAB Show New York Returns to Javits

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

FCC to Vote on Restrictions for Device Testing, Spectrum for D2D and Drones

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

World First' as DTM Deploys Riedel Private 5G for On-Track Coverage

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

LiveU Cranks Up Connectivity Across Tour de France

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ikegami to Introduce New UHK-X700VN Camera at NAB New Yor...

Ikegami announces a major expansion to its range of broadcast-quality live production cameras. Scheduled for introduction on Ikegami booth 708 at NAB New York, ...

08/10/2026

Calrec gives broadcasters freedom of choice at NAB Show...

Calrec will be located at Booth 444. Freedom to choose The media landscape is evolving quickly, and the broadcasters best placed for what comes next will be...

08/10/2026

LiveU LU900Q with LIQ Brings Unprecedented Connectivity t...

LiveU has announced that CRD Audiovisuel relied on LiveUs LU900Q intelligent production unit, with built-in native LiveU IQ (LIQ ) connectivity, to deliver live...

08/10/2026

Disney+ to Stream Super Bowl LXI Live

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Formula 1 U.S. Grand Prix to Be Carried in Dolby Atmos, Dolby Vision on Apple TV

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Marshall to Bring Newest PTZ and POV Cameras to NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Marshall Electronics to Showcase Award-winning Camera Sol...

Marshall Electronics, a globally recognized provider of high-performance video solutions for broadcast, streaming, AV and professional production, will exhibit ...

08/10/2026

UKTV acquires first two series of new Maigret for U and U&DRAMA in deal with Banijay Rights

14-hour package also includes A Remarkable Place to Die season 2 as well as libr...