Team NVIDIA has triumphed at the Amazon KDD Cup 2024, securing first place Friday across all five competition tracks.
The team - consisting of NVIDIANs Ahmet Erdem, Benedikt Schifferer, Chris Deotte, Gilberto Titericz, Ivan Sorokin and Simon Jegou - demonstrated its prowess in generative AI, winning in categories that included text generation, multiple-choice questions, name entity recognition, ranking, and retrieval.
The competition, themed Multi-Task Online Shopping Challenge for LLMs, asked participants to solve various challenges using limited datasets.
The new trend in LLM competitions is that they don't give you training data, said Deotte, a senior data scientist at NVIDIA. They give you 96 example questions - not enough to train a model - so we came up with 500,000 questions on our own.
Deotte explained that the NVIDIA team generated a variety of questions by writing some themselves, using a large language model to create others, and transforming existing e-commerce datasets.
Once we had our questions, it was straightforward to use existing frameworks to fine-tune a language model, he said.
The competition organizers hid the test questions to ensure participants couldn't exploit previously known answers. This approach encourages models that generalize well to any question about e-commerce, proving the model's capability to handle real-world scenarios effectively.
Despite these constraints, Team NVIDIA's innovative approach outperformed all competitors by using Qwen2-72B, a just-released LLM with 72 billion parameters, fine-tuned on eight NVIDIA A100 Tensor Core GPUs, and employing QLoRA, a technique for fine-tuning models with datasets.
About the KDD Cup 2024 The KDD Cup, organized by the Association for Computing Machinery's Special Interest Group on Knowledge Discovery and Data Mining, or ACM SIGKDD, is a prestigious annual competition that promotes research and development in the field.
This year's challenge, hosted by Amazon, focused on mimicking the complexities of online shopping with the goal of making it a more intuitive and satisfying experience using large language models. Organizers utilized the test dataset ShopBench - a benchmark that replicates the massive challenge for online shopping with 57 tasks and about 20,000 questions derived from real-world Amazon shopping data - to evaluate participants' models.
The ShopBench benchmark focused on four key shopping skills, along with a fifth all-in-one challenge:
Shopping Concept Understanding: Decoding complex shopping concepts and terminologies.
Shopping Knowledge Reasoning: Making informed decisions with shopping knowledge.
User Behavior Alignment: Understanding dynamic customer behavior.
Multilingual Abilities: Shopping across languages.
All-Around: Solving all tasks from the previous tracks in a unified solution.
NVIDIA's Winning Solution NVIDIA's winning solution involved creating a single model for each track.
The team fine-tuned the just-released Qwen2-72B model using eight NVIDIA A100 Tensor Core GPUs for approximately 24 hours. The GPUs provided fast and efficient processing, significantly reducing the time required for fine-tuning.
First, the team generated training datasets based on the provided examples and synthesized additional data using Llama 3 70B hosted on build.nvidia.com.
Next, they employed QLoRA (Quantized Low-Rank Adaptation), a training process using the data created in step one. QLoRA modifies a smaller subset of the model's weights, allowing efficient training and fine-tuning.
The model was then quantized - making it smaller and able to run on a system with a smaller hard drive and less memory - with AWQ 4-bit and used the vLLM inference library to predict the test datasets on four NVIDIA T4 Tensor Core GPUs within the time constraints.
This approach secured the top spot in each individual track and the overall first place in the competition-a clean sweep for NVIDIA for the second year in a row.
The team plans to submit a detailed paper on its solution next month and plans to present its findings at KDD 2024 in Barcelona.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
09/06/2026
The BBC has found its Hercule Poirot.
After Deadline revealed last month that t...
09/06/2026
Media buyers and sellers can now compare YouTube reach from computer, mobile, an...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
A project aimed at modernizing scheduling operations across Mediaset's channel portfolio
Mediagenix, a global leader in smart content solutions to profitab...
09/06/2026
tvONE, an ACT Entertainment brand, debuts its most powerful video processor ever built: the 4RU CALICO PRO (C7-PRO-4200), at InfoComm 2026 (Booth N6813). Engine...
09/06/2026
Composer and Conductor Eric Whitacre to Receive Honorary Doctorate at Berklee Va...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Technology collaboration to validate AMPP and Lawo HOME orchestration integration, showcasing Dynamic Media Facility principles in practice.
Grass Valley and ...
09/06/2026
Bitmovin, a leading provider of video streaming solutions, today announced that Axel Springer SE, international media and technology company, has deployed Playe...
09/06/2026
LiveU, the global leader in live IP-video solutions, today announced a landmark deployment with the Oceania Football Confederation (OFC) that has brought Video ...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Two Alumni Win Tony Awards Mike Morris and Cedric Leiba Jr. won awards for Best Orchestrations and Best Play, respectively.
June 8, 2026
By
Tori Donahue
...
09/06/2026
Enni Continues to Rely on Arvato Systems - And Will Be Using AEP.EnerS4 Billing Solution
Arvato Systems to implement transformation project for SAP S/4HANA Ut...
09/06/2026
These special programmes will highlight RT 's connection with the Irish diaspora
This year, RT is marking 100 years of public broadcasting in Ireland with...
08/06/2026
The two execs discuss the goals and the challenges of building a huge multi-cult...
08/06/2026
This industry legend has been a road warrior since the early '90s and is, today, a lynchpin on College GameDay
The sports-production industry continues to ...
08/06/2026
DAZN has agreed a multi-year rights partnership with Extreme Fighting Championship (EFC), expanding its global combat sports portfolio.
DAZN will broadcast EFC...
08/06/2026
As fans move across broadcast, streaming, social, mobile and creator-led platforms, and they expect every angle, in real time, TVU Networks has released a new e...
08/06/2026
Infront has further strengthened the 2026 Diamond League's international bro...
08/06/2026
Grass Valley has announced the appointment of Sam Craig as Vice President, Global Pre-Sales. Based in the United States, Craig will lead Grass Valley's glob...
08/06/2026
SMPTE has announced its summer 2026 education lineup covering IP networking and SMPTE ST 2110, including two standalone courses, a 13-week boot camp, and a hand...
08/06/2026
Sportradar Group AG has announced a multi-year global agreement with Kalshi, a p...
08/06/2026
FIFA and Gamefam have announced the launch of a FIFA World Cup 2026 event on Roblox, running June 5 through July 31, 2026. The event centers on FIFA Super Socce...
08/06/2026
A collaboration of NHL Productions, Monumental Sports, and Michael Levitt Produc...
08/06/2026
CBS Sports production staffer Bryce Adair has died at the age of 31 after sustaining injuries during a car accident on Wednesday while in Ohio working the the P...
08/06/2026
Behind The Mic provides a roundup of recent news regarding on-air talent, including new deals, departures, and assignments compiled from press releases and repo...
08/06/2026
WMT Digital today announced the launch of WMT Fan Intelligence, designed to unif...
08/06/2026
The Heat are the seventh NBA team to air their games over-the-air next season...
08/06/2026
Paramount and UFC have announced an expansion of their media rights partnership making Paramount the exclusive home of UFC Numbered Event main cards in Canada ...
08/06/2026
The Qatar Football Association (QFA), in cooperation with Sponix and broadcaster...
08/06/2026
Project B has announced the appointment of Host Broadcast Services (HBS) as Offi...
08/06/2026
The Buckeyes now produce and stream upwards of 200 sports events annually with a...
08/06/2026
At Spotify, our commitment to the LGBTQIA community is year-round. Through GLOW, our global music program, we celebrate and amplify the contributions of queer ...
08/06/2026
Get Hands-on With Keyboard & Synth Brands
GearExpo UK wouldn't be complete without some synth action, and we've got some of the industry's most ...
08/06/2026
50 popular in-ear monitoring system profiles added
The latest update for IK Multimedia's headphone-correction system has just arrived, and introduces ca...
08/06/2026
Manny Marroquin signature cans upgraded with SLAM Technology
The flagship model in Audeze's Manny Marroquin Signature Series has just been treated to an...
08/06/2026
Air domain supremacy redefined - New counter UAS, space solutions and directiona...
08/06/2026
he BBC and BritBox have announced that Edward Bluemel (We Might Regret This, My ...
08/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
Team NVIDIA has triumphed at the Amazon KDD Cup 2024, securing first place Friday across all five competition tracks.
