Sony Pixel Power calrec Sony

Pinterest Boosts Home Feed Engagement 16% With Switch to GPU Acceleration of Recommenders

04/08/2022

Pinterest has engineered a way to serve its photo-sharing community more of the images they love.

The social-image service, with more than 400 million monthly active users, has trained bigger recommender models for improved accuracy at predicting people's interests.

Pinterest handles hundreds of millions of user requests an hour on any given day. And it must also narrow down relevant images from roughly 300 billion images on the site to roughly 50 for each person.

The last step - ranking the most relevant and engaging content for everyone using Pinterest - required a leap in acceleration to run heftier models, with minimal latency, for better predictions.

Pinterest has improved the accuracy of its recommender models powering people's home feeds and other areas, increasing engagement by as much as 16%.

The leap was enabled by switching from CPUs to NVIDIA GPUs, which could easily be applied next to other areas, including advertising images, according to Pinterest.

Normally we would be happy with a 2% increase, and 16% is just a beginning for home feeds. We see additional gains - it opens a lot of doors for opportunities, said Pong Eksombatchai, a software engineer at Pinterest.

Transformer models capable of better predictions are shaking up industries from retail to entertainment and advertising. But their leaps in performance gains of the past few years have come with a need to serve models that are some 100x bigger as their number of model parameters and computations skyrockets.

Huge Inference Gains, Same Infrastructure Cost Like many, Pinterest engineers wanted to tap into state-of-the-art recommender models to increase engagement. But serving these massive models on CPUs presented a 100x increase in cost and latency. That wasn't going to maintain its magical user experience - fresh and more appealing images - occurring within a fraction of a second.

If that latency happened, then obviously our users wouldn't like that very much because they would have to wait forever, said Eksombatchai. We are pretty close to the limit of what we can do on CPU basically.

The challenge was to serve these hundredfold larger recommender models within the same cost and latency constraints.

Working with NVIDIA, Pinterest engineers began architectural changes to optimize their inference pipeline and recommender models to enable the transition from CPU to GPU cloud instances. The technology transition began late last year and required major changes to how the company manages workloads. The result is a 100x gain in inference efficiency on the same IT budget, meeting their goals.

We are starting to use really, really big models now. And that is where the GPU comes in - to help make these models possible, Eksombatchai said.

Tapping Into cuCollections Switching from CPUs to GPUs required rethinking its inference systems architecture. Among other issues, engineers had to change how they send workloads to their inference servers. Fortunately, there are tools to assist in making the transition easier.

The Pinterest inference server built for CPUs had to be altered because it was set up to send smaller batch sizes to its servers. GPUs can handle much larger workloads, so it's necessary to set up larger batch requests to increase efficiency.

One area where this comes into play is with its embedding table lookup module. Embedding tables are used to track interactions between various context-specific features and interests of user profiles. They can track where you navigate, and what people Pin on Pinterest, share or numerous other actions, helping refine predictions on what users might like to click on next.

They are used to incrementally learn user preference based on context in order to make better content recommendations to those using Pinterest. Its embedding table lookup module required two computation steps repeated hundreds of times because of the number of features tracked.

Pinterest engineers greatly reduced this number of operations using a GPU-accelerated concurrent hash table from NVIDIA cuCollections. And they set up a custom consolidated embedding lookup module so they could merge requests into a single lookup. Better results were seen immediately.

Using cuCollections helped us to remove bottlenecks, said Eksombatchai.

Enlisting CUDA Graphs Pinterest relied on CUDA Graphs to eliminate what was remaining of the small batch operations, further optimizing its inference models.

CUDA Graphs helps reduce the CPU interactions when launching on GPUs. They're designed to enable workloads to be defined as graphs rather than single operations. They provide a mechanism to launch multiple GPU operations through a single CPU operation, reducing CPU overheads.

Pinterest enlisted CUDA Graphs to represent the model inference process as a static graph of operation instead of as those individually scheduled. This enabled the computation to be handled as a single unit without any kernel launching overhead.

The company now supports CUDA Graph as a new backend of its model server. When a model is first loaded, the model server runs the model inference once to build the graph instance. This graph can then be run repeatedly in inference to show content on its app or site.

Implementing CUDA Graphs helped Pinterest to significantly reduce inference latency of its recommender models, according to its engineers.

GPUs have enabled Pinterest to do something that was impossible with CPUs on the same budget, and by doing this they can make changes that have a direct impact on various business metrics.

Learn about Pinterest's GPU-driven inference and optimizations at its GTC session, Serving 100x Bigger Recommender Models, and in the Pinterest Engineering blog.

Register for GTC, running Sept. 19-22, for free to attend sessions with NVIDIA and dozens of industry leaders.
LINK: https://blogs.nvidia.com/blog/2022/08/04/pinterest-gpu-acceleration-re...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

03/04/2026

TNT Sports and CBS Sports To Reunite Michigan's Iconic Fab Five' for Special NCAA Men's Final Four Altcast on truTV and HBO Max

Michigan's Fab Five will reunite for an alternate presentation of the Mich...

03/04/2026

NAB 2026: Avid To Showcase Content Core and AI Workflow Innovations

Avid will exhibit at NAB Show 2026 (April 18-22, Booth N2226, Las Vegas Convention Center), demonstrating its Content Core platform and new AI-driven workflow c...

03/04/2026

MRMC Appoints Nick Barthee as Chief Operating Officer

Mark Roberts Motion Control (MRMC) has announced the appointment of Nick Barthee as Chief Operating Officer. The announcement follows MRMC's transition fro...

03/04/2026

Elite Media Technologies Selects Interra Systems' BATON for File-Based QC

Interra Systems has announced that Elite Media Technologies has selected its BATON file-based QC solution for media workflows. Elite Media Technologies speciali...

03/04/2026

Moldtelecom Deploys Ateme Technologies Across Full Streaming Workflow

Ateme has announced that Moldtelecom has deployed Ateme technologies across its streaming workflow, covering encoding, delivery, operations, and analytics. Mol...

03/04/2026

NAB 2026: Grass Valley To Demonstrate Framelight X Content Management

Grass Valley will demonstrate Framelight X, its content management platform, at NAB Show 2026. The platform connects capture, ingest, editing, and publishing in...

03/04/2026

NAB 2026: Encompass Digital Media and Techex Launch Cloud-Based Master Control Service for Live Events

Encompass Digital Media and Techex have announced a cloud-native Master Control ...

03/04/2026

Peacock Debuts Its New Vertical-Video Experience for Live NBA Games on Monday

Live Vertical Video automatically track the action on the court via AI technology and delivers a fully optimized, 9 16 live feed for viewers...

03/04/2026

Illinois Creative Team Captures Men's Final Four Run With Trust, Timing, and a Few Water Guns

As the Illini make their first trip to college basketball's biggest stage si...

03/04/2026

Hook 'Em: University of Texas Athletics Produces Digital Content for a First-Person Experience

After last summer's Softball National Championship victory and last week'...

03/04/2026

Don't Be Lame: Arizona Men's Basketball Social Team Aims To Catch the Attention of Wildcat Fans

The University of Arizona's Men's Basketball team has only loss twice th...

03/04/2026

During Packed Weekend, Van Wagner Covers In-Venue Shows for Championships Across Indianapolis

Eight games across four tournaments will be played in three venues; accommodatio...

03/04/2026

Ottawa Senators and Bell Media Extend Regional Broadcast Rights Agreement

The Ottawa Senators and Bell Media have announced a long-term rights extension for regional Ottawa Senators games on TSN and RDS. TSN Radio 1200 remains the exc...

03/04/2026

ESPN's Women's Final Four Playbook: Bigger Compound, Bigger Trucks, Biggest Production Yet

Massive production in Phoenix running out of Flagship Mobile unit, Features 50+ ...

03/04/2026

Electro-Harmonix release EHX Classics Bundle

Iconic guitar pedals now available in plug-in form Guitar effects experts Electro-Harmonix have teamed up with MixWave to turn a collection of their most pr...

03/04/2026

FAC launch Bandit 2

New multi-band AUv3 plug-in announced Fred Anton Corvest (FAC) offer an extensive range of AUv3 plug-ins and iOS/iPadOS Apps, and their multiband effects pr...

03/04/2026

Pulsar-23: 1984 from SOMA Laboratory

Just 84 units to be released in the US Experimental synthesizer and sound-machine extraordinaires SOMA Laboratory have revealed an upcoming special-edition ...

03/04/2026

Iconic Instruments release Model 350 Tube Preamp

Emulates the input section of an Ampex 350 One of the latest arrivals to the Iconic Instruments range delivers a new tube preamp plug-in inspired by the cir...

03/04/2026

TelevisaUnivision and Nielsen Agree to New Media Intelligence Deal Covering Streaming, National and Local TV, and Radio

New York April 2, 2026 TelevisaUnivision, the world's leading Spanish-la...

03/04/2026

2026 NAB Show Exhibitor Insight: Techex

Share Copy link Facebook X Linkedin Bluesky Email...

03/04/2026

TelevisaUnivision Signs New Nielsen Media Intelligence Deal

Share Copy link Facebook X Linkedin Bluesky Email...

03/04/2026

The WNET Group, JIB Launch NHK World-Japan in New York

Share Copy link Facebook X Linkedin Bluesky Email...

03/04/2026

NAB Leadership Foundation Welcomes New Board Members

Share Copy link Facebook X Linkedin Bluesky Email...

03/04/2026

EverPass Media Expands Distribution Deal with Netflix

Share Copy link Facebook X Linkedin Bluesky Email...

03/04/2026

Versant Acquires AI-Data Platform StockStory

Share Copy link Facebook X Linkedin Bluesky Email...

03/04/2026

CVP Grows European Footprint with Strategic Expansion in...

CVP, one of Europe's leading suppliers of professional video and broadcast solutions, today announces the launch of its new German operation and the formati...

03/04/2026

MRMC Announces Appointment of Chief Operating Officer

Mark Roberts Motion Control (MRMC) today announces the appointment of Nick Barthee as Chief Operating Officer, strengthening its leadership as the company conti...

03/04/2026

Net Insight Introduces Programmable Trust Boundaries for...

Net Insight introduces programmable Trust Boundaries that make live media interconnection predictable as traffic moves between facilities, networks and cloud en...

03/04/2026

Winning in the new media economy: Avid showcases AI-powered, connected intelligence to unlock media value at NAB Show 2026

Winning in the new media economy: Avid showcases AI-powered, connected intellige...

03/04/2026

NUGEN Audio CEO Dr. Paul Tapper to Lead Presentation About Dialog Intelligibility and Loudness at NAB 2026

NUGEN Audio CEO Dr. Paul Tapper to Lead Presentation About Dialog Intelligibilit...

03/04/2026

NAB Show 2026: PlayBox Neo Highlights Workflow, Security, and IP Advances

NAB Show 2026: PlayBox Neo Highlights Workflow, Security, and IP Advances Brie Clayton April 2, 2026 0 Comments PlayBox Neo will showcase the latest i...

03/04/2026

For Taku Hirano, Everything Is Connected

For Taku Hirano, Everything Is Connected From touring and composition to teaching and instrument design, the in-demand percussionist sees it all as one body o...

03/04/2026

Berklee Honors Humberto Ramirez with Master of Latin Music Award

Berklee Honors Humberto Ramirez with Master of Latin Music Award The alumnus and acclaimed trumpeter is honored for his influence as a performer, composer, an...

03/04/2026

Competition Heats Up with Intrigue and Spices: Netflix Unveils Trailer for New Drama Made with Love'

Back to All News Competition Heats Up with Intrigue and Spices: Netflix Unveils...

02/04/2026

HBO and NFL Films Announce Hard Knocks: Training Camp with the Seattle Seahawks, Debuting August 11

HBO and NFL Films have announced Hard Knocks: Training Camp with the Seattle Sea...

02/04/2026

NAB 2026: Haivision Unveils Makito ONE Video Transport Platform

Haivision has announced the Makito ONE, a single-blade video encoding and decoding platform, at NAB Show 2026. The platform combines dual-channel video encoding...

02/04/2026

NAB 2026: Telestream Introduces UP.Lens Cloud-Based Multiviewer and Monitoring Service

Telestream has introduced UP.Lens, a cloud-based multiviewer and monitoring serv...

02/04/2026

NAB 2026: MRMC to Showcase Robotic Camera Technology and Mark 60th Anniversary

Mark Roberts Motion Control (MRMC) will exhibit at NAB Show 2026 (Booth C5220, April 19-22, Las Vegas Convention Center), marking the company's 60th anniver...

02/04/2026

NAB 2026: Net Insight Introduces Programmable Trust Boundaries for Live Media Interconnection

Net Insight has introduced programmable Trust Boundaries, a feature integrated i...

02/04/2026

NAB 2026: Bitmovin Adds SGAI Support to Playback Products

Bitmovin has announced support for SGAI (Server-Guided Ad Insertion) in its playback products, using HLS interstitials. SGAI combines elements of client-side an...

02/04/2026

Binghamton University Athletics Adds Riedel SimplyLive RiMotion R12 for Student-Run Productions

Riedel Communications' SimplyLive RiMotion R12 replay system is supporting B...

02/04/2026

NAB 2026: LTN and Ateme Announce Integration of Video Processing with IP Transport

LTN, a managed IP video transport company, and Ateme, a video compression and de...

02/04/2026

TDF Expands Channel Capacity on Terrestrial Broadcast Network with Harmonic

Harmonic has announced that TDF, a broadcast infrastructure operator in France, has deployed Harmonic's XOS Advanced Media Processor and ProStream X Video S...

02/04/2026

United Rugby Championship Reports First-Year Results with Eluvio Streaming Platform

Eluvio and the United Rugby Championship (URC) have announced first-year results...

02/04/2026

Kansas City Current and Scripps Sports Announce ION as Broadcast Home of 2026 Teal Rising Cup

The Kansas City Current and Scripps Sports have announced that ION will broadcas...