Sony Pixel Power calrec Sony

Billions Served: NVIDIA Merlin Helps Fuel Clicks for Online Giants


Online commerce has rocketed to trillions of dollars worldwide in the past decade, serving billions of consumers. Behind the scenes of this explosive growth in online sales is personalization driven by recommender engines.

Recommenders make shopping deeply personalized. While searching for products on e-commerce sites, they find you. Or suggestions can just appear. This wildly delightful corner of the internet is driven by ever more massive datasets and models.

NVIDIA Merlin is the rocket fuel of recommenders. Boosting training and inference, it enables businesses of all types to better harness data to build recommenders accelerated by NVIDIA GPUs.

The stakes are higher than ever for online businesses. Online sales in 2021 were expected to reach nearly $5 trillion worldwide, according to eMarketer, up nearly 17 percent from the prior year.

On some of the world's largest online sites, even a 1 percent gain in relevance accuracy of recommendations can yield billions more sales.

Investment in recommender systems has become one of the biggest competitive advantages of internet giants today.

The market for recommenders is expected to reach $15.13 billion by 2026, up from $2.12 billion in 2020, according to Mordor Intelligence. The largest and fastest growing segment of the market for recommender engines is in the Asia Pacific region, according to the research firm.

But an industry challenge is that improved relevance requires more data and processing. This data consists of trillions of user-product interactions - clicks, views, - on billions of products and consumer profiles.

Data of this scale can take days to train models. Yet the faster you can spin out new models informed by more data, the better your relevance.

The Merlin collection of models, methods, and libraries, includes tools for building deep learning-based systems capable of handling terabytes of data that can provide better predictions and increase clicks.

SNAP Taps Merlin and GPUs for Inference Upside U.S. digital advertising is expected to reach $191.1 billion in 2021, up 25.5 percent from the year before, according to eMarketer.

Snap, parent company to social media app Snapchat, is based in Santa Monica, Calif., and has more than 300 million daily active users. It creates ad revenue from its social photo and video messaging service.

We will continue to focus on delivering strong results for our advertising partners and innovating to expand the capabilities of our platform and better serve our community, said Snap CEO Evan Spiegel in its third-quarter earnings statement.

The technical hurdle for Snap is that it seeks to continue to develop its workload's higher-cost ranking models and expand into more complex models while reducing costs.

The company used NVIDIA GPUs and Merlin to boost its content ranking capabilities.

Snap used NVIDIA GPUs and Merlin software to improve machine learning inference cost efficiency by 50 percent and decrease serving latency by 2x, providing the compute headroom to experiment and deploy heavier, more accurate ad and content ranking models, said Nima Khajehnouri, VP of engineering at Snap.

Tencent Boosts Model Training With Merlin's HugeCTR Entertainment giant Tencent, which operates the enormously popular messaging service WeChat and payments platform WeChat Pay, is China's largest company by market capitalization.

Its engineers need to rapidly iterate on models for its advertising recommendation system, putting increasing demands on its training performance.

The advertising business is a relatively important business inside Tencent and the recommendation system is used to increase the overall advertising revenue, said Xiangting Kong, expert engineer at Tencent.

The problem is that accuracy of advertising recommendation can only be improved by training more sample data, including more sample features, but this leads to longer training times that affect model update frequency.

HugeCTR, as a recommendation training framework, is integrated into the advertising recommendation training system to make the update frequency of model training faster, and more samples can be trained to improve online effects, he said.

After the training model performance is improved, more data can be trained to improve the accuracy of the model, increasing advertising revenue, he added.

Meituan Reduces Costs With NVIDIA A100 GPUs Meituan's business is at a crowded intersection of food, entertainment and on-demand services, among its 200 service categories. The Chinese internet giant has more than 667 million active users and 8.3 million active merchants.

Jun Huang, a senior technical expert at Meituan, said that if his team can greatly improve performance, it usually prefers to train more samples and more complex models.

The problem for Meituan was that as its models became more and more complex, it became difficult to optimize the training framework deeply, said Huang.

We are working on integrating NVIDIA HugeCTR into our training system based on A100 GPUs. The cost is also greatly reduced. This is a preliminary optimization result, and there is still much room to optimize in the future, he said.

Meituan recently reported its average number of transactions per transacting users increased to 32.8 for the trailing 12 months of the second quarter of 2021, compared with 25.7 for the trailing 12 months of the second quarter of 2020.

Learn more about NVIDIA Merlin. Learn more about NVIDIA Triton.
See more stories from nvidia

North America Stories


Tegna Deal Critics Say FCC Needs More Data

Critics of the $8 billion-plus purchase of Tegnas TV station group by investment fund Standard General have told the FCC it needs to collect more data on the pr...


Kenan', Mr. Mayor', The Endgame' Done at NBC

Comedies Kenan and Mr. Mayor, and drama The Endgame will not return on NBC. Kenan lasted two seasons, as did Mr. Mayor. The Endgame lasted one....


Gray Names Ron Bartholomew GM of WNDU-TV, South Bend

Gray Television said it named Ron Bartholomew as general manager of WNDU-TV, South Bend, Indiana....


Nielsen Says Go-Shop Period Ends With No New Proposals

Nielsen, which has agreed to be acquired by a private-equity group led by Elliott Investment Management, said that its go-shop period has expired without an alt...


Federal Agencies To Share, Standardize, Broadband Data

The FCC, Department of Agriculture, National Telecommunications & Information Administration (all of which oversee broadband subsidy programs) and the Treasure ...


Lisa White Named VP/News Director at KPIX-KBCW San Francisco

Lisa White has been named vice president and news director at KPIX-KBCW San Francisco Bay Area, which are part of the CBS News and Stations group. She has been ...


CBS Orders Three New Dramas

CBS has ordered three dramas for the 2022-2023 season, cop drama East New York, firefighter drama Fire Country and private investigator drama So Help Me Todd....


Nancy Daniels To Run Turner Nets as Brett Weitz Leaves Warner Bros. Discovery

Warner Bros. Discovery's U.S. Networks Group will be reorganized under Kathleen Finch, chairman and chief content officer, with long-time Discovery executiv...


Natasha Lyonne Hosts SNL' Season Finale

Natasha Lyonne will host the season finale of Saturday Night Live on NBC May 21. It is her first time hosting....


ABC Renews AFHV', American Idol', Bachelor', Celeb' Wheel' and Shark Tank'

ABC has renewed unscripted series America's Funniest Home Videos, American I...


ESPN to Offer Record 23-Game NFL Slate

BRISTOL, Conn. ESPN has unveiled a record-setting 23-game NFL slate for the 2022 Season that includes 21 regular season games, plus the Monday night Super Wild ...


Lisa White Named VP and News Director for CBS Television Stations' San Francisco Bay Area Businesses

SAN FRANCISCO Veteran local news executive Lisa White has been named vice presid...


TelevisaUnivision's Uforia Expands Podcast Offerings

MIAMI TelevisaUnivision's audio network Uforia has announced that it is expanding its podcast offerings....


Gray Television Names Ron Bartholomew GM of WNDU

ATLANTA Gray Television has named Ron Bartholomew the new general manager of WNDU, the NBC affiliate in South Bend, Indiana (DMA 99)....


URSA Mini Pro 12K Used for VFX on 'The Gilded Age'

FREMONT, Calif. Blackmagic Design has announced that a Blackmagic URSA Mini Pro 12K digital film camera was used to capture visual effects (VFX) plates for the ...


blue Taps Rohde & Schwarz for Studio Production and Storage Tech

MUNICH Rohde & Schwarz has announced that its high-performance intelligent storage network, as well as its media servers for content preparation have been deplo...


Amazon Prime Video, NFL Unveil Thursday Night Football 2022 Schedule

NEW YORK The NFL and Amazon Prime Video have unveiled the schedule for the Thursday Night Football (TNF) games that will be streamed exclusively on Prime Video....


Kendrick Lamars New Album Is Full of Berklee Collaborators

Kendrick Lamars New Album Is Full of Berklee Collaborators Berklee alumni played significant roles in every step of the creation of Kendricks double album, Mr...


A Game Plan for Submitting Your Work to a Film Festival

-- John Nein is a senior programmer for the Sundance Institute....


Ryan Coogler and Friends: Creating a Soundscape on Film

Ryan Coogler and Ludwig G ransson have worked together on several films, including Fruitvale Station. By Vanessa Zimmer Why do people say they watched a movie...


Actionable Intelligence at the Speed of Light

Nations around the world - from the Pacific Ocean to the Baltic Sea - are facing increasingly aggressive actions from adversarial superpowers and terrorist orga...


The Eyes Have It

Imagine the scene: it's midday, and, somewhere in eastern Europe, a special operations team patrols through thick woodland to find and fix enemy positions c...


Roku Upgrades Its Top-of-the-Line Streaming Player

SAN JOSE, Calif. Roku has announced that its most powerful streaming player, the Roku Ultra, will include Roku's top-of-the-line remote, the Roku Voice Remo...


Scener Launches Mobile App to Simplify TV Viewing

LOS ANGELES Scener, a destination for finding and sharing streaming entertainment, has announced the launch of a new mobile application designed to enhance and ...


Dish Wireless Selects Radcom to Monitor Its 5G Network

TEL AVIV, Israel Radcom has announced that it was selected by Dish Wireless to provide its Radcom Ace solution to monitor customers experience across Dishs 5G S...


NAB Now Accepting Applications for Technology Apprenticeship Program

WASHINGTON, D.C. The NAB Leadership Foundation (NABLF) has announced that it is now accepting applications for the 2023 Technology Apprenticeship Program (TAP)....


New Gaian Solutions Monetization Platform Accelerates ATSC 3.0 Commercialization

LAGUNA BEACH, Calif. Gaian Solutions unveiled its Mobius Marketplace NextGen TV monetization platform, an AI-based ATSC 3.0 spectrum planning tool intended to e...


Blackbird Hires Sumit Rai as Chief Product Officer

Blackbird plc announced the appointment of Sumit Rai as chief product officer. He will join the company in June, to lead the strategic development and direction...


Comcast, Charter Tap Marcien Jenckes to Head New Streaming Venture

STAMFORD, Conn. & PHILADELPHIA, Penn. Charter Communications and Comcast Corporation have selected Marcien Jenckes as president of their recently announced stre...


Julius P. Williams Composes Song for 54th Massachusetts Regiment Memorial Rededication

Julius P. Williams Composes Song for 54th Massachusetts Regiment Memorial Rededi...


Broadpeak Showcases Superior Video Streaming Experiences at BroadcastAsia 2022

At BroadcastAsia 2022, Broadpeak will highlight how pay-TV operators, content providers, and OTT players can provide a compelling video streaming experience to ...


blue Entertainment AG Invests in Rohde and Schwarz Studio Production and Storage Technology

Rohde & Schwarz, a global leader in broadcast media technologies, has today anno...


Zero Density Wins Product of the Year Award at NAB 2022

Zero Density is proud to announce that its AI-powered, talent-tracking system, TRAXIS talentS, has won a Product of the Year award at this year's NAB! The a...


Capturing The UNLV Symphonic Wind Ensemble with Quantum 2626 and Studio One

The way I found out about Studio One and PreSonus: I had lunch with Bob Moses (president of the Audio Engineering Society at one time) and I asked him some que...


NAB 2022 Perspectives: Cobalt Digital's Suzana Brady on Foreseeing the Challenges of COVID-19, Celebrating the Company's 25th Anniversary

NAB 2022 Perspectives: Cobalt Digitals Suzana Brady on Foreseeing the Challenges...


BT Group Forms New Premium Sports Joint Venture With Warner Bros. Discovery, BT Sport

BT Group forms a new premium sports joint venture with Warner Bros. Discovery an...


SVG Returns to Sydney for SVG Australia Summit on June 1

SVG Returns to Sydney for SVG Australia Summit on June 1 Register now to attend event at Telstra Customer Insight Centre in Sydney By SVG Staff Friday, May 1...


NAB 2022 Perspectives: Vizrt CTO Gerhard Lang on the Future of Adaptive Graphics and AI

NAB 2022 Perspectives: Vizrt CTO Gerhard Lang on the Future of Adaptive Graphics...


Families in Recovery: Susan Ford on Her Mother's Legacy and the Founding of the Betty Ford Center

Families in Recovery: Susan Ford on Her Mother's Legacy and the Founding of ...


Progress to Participate in the 17th Annual Needham Technology & Media Conference

BURLINGTON, Mass., May 13, 2022 (GLOBE NEWSWIRE) -- Progress (Nasdaq: PRGS), the trusted provider of infrastructure software, today announced that Anthony Folge...


Become a Grouping Groupie

Recently, I did some mix consulting on a 60-track project centered around Ukrainian relief-and as someone who usually works with far fewer tracks, it reminded m...


Broom, Broom: WeRide Revs Up Self-Driving Street Sweepers Powered by NVIDIA

When it comes to safety, efficiency and sustainability, autonomous vehicles are delivering a clean sweep. Autonomous vehicle company and NVIDIA Inception membe...


WRAL-TV's Brain Game Wraps Season 26

Tune in to watch the final show of Brain Game s 26th season on Saturday, May 14, 2022, at noon on WRAL-TV. WRAL-TV Local Production Producer Scott Reid wrote t...


Meet the 20 Mediamakers Selected for the new Sundance Institute Humanities Sustainability Fellowship

-- Pilot Program Directs Individual Support to Pandemic-Affected Nonfiction St...


Prosperous Collaboration

As the global leader in tactical radio, broadband networking and integrated vision solutions, L3Harris Technologies is well positioned to provide advanced capab...


SPIE Astronomical Telescopes + Instrumentation 2022

2:40 - 3:00 PM PT in room 520c The Nancy Grace Roman Space Telescope (RST) is a Hubble-size telescope with a large field of view for large surveys of the sky, ...


The Power of Convergence

L3Harris Technologies has led the way in offering solutions for converging traditional Land Mobile Radio (LMR) communications and LTE carriers with the latest i...


10 Questions with the Creator: Shon Bollock + Impermanence: Rafting the Grand Canyon

GoPro Family member Shon Bollock recently set out to document he and his father ...