
Pinterest has engineered a way to serve its photo-sharing community more of the images they love.
The social-image service, with more than 400 million monthly active users, has trained bigger recommender models for improved accuracy at predicting people's interests.
Pinterest handles hundreds of millions of user requests an hour on any given day. And it must also narrow down relevant images from roughly 300 billion images on the site to roughly 50 for each person.
The last step - ranking the most relevant and engaging content for everyone using Pinterest - required a leap in acceleration to run heftier models, with minimal latency, for better predictions.
Pinterest has improved the accuracy of its recommender models powering people's home feeds and other areas, increasing engagement by as much as 16%.
The leap was enabled by switching from CPUs to NVIDIA GPUs, which could easily be applied next to other areas, including advertising images, according to Pinterest.
Normally we would be happy with a 2% increase, and 16% is just a beginning for home feeds. We see additional gains - it opens a lot of doors for opportunities, said Pong Eksombatchai, a software engineer at Pinterest.
Transformer models capable of better predictions are shaking up industries from retail to entertainment and advertising. But their leaps in performance gains of the past few years have come with a need to serve models that are some 100x bigger as their number of model parameters and computations skyrockets.
Huge Inference Gains, Same Infrastructure Cost Like many, Pinterest engineers wanted to tap into state-of-the-art recommender models to increase engagement. But serving these massive models on CPUs presented a 100x increase in cost and latency. That wasn't going to maintain its magical user experience - fresh and more appealing images - occurring within a fraction of a second.
If that latency happened, then obviously our users wouldn't like that very much because they would have to wait forever, said Eksombatchai. We are pretty close to the limit of what we can do on CPU basically.
The challenge was to serve these hundredfold larger recommender models within the same cost and latency constraints.
Working with NVIDIA, Pinterest engineers began architectural changes to optimize their inference pipeline and recommender models to enable the transition from CPU to GPU cloud instances. The technology transition began late last year and required major changes to how the company manages workloads. The result is a 100x gain in inference efficiency on the same IT budget, meeting their goals.
We are starting to use really, really big models now. And that is where the GPU comes in - to help make these models possible, Eksombatchai said.
Tapping Into cuCollections Switching from CPUs to GPUs required rethinking its inference systems architecture. Among other issues, engineers had to change how they send workloads to their inference servers. Fortunately, there are tools to assist in making the transition easier.
The Pinterest inference server built for CPUs had to be altered because it was set up to send smaller batch sizes to its servers. GPUs can handle much larger workloads, so it's necessary to set up larger batch requests to increase efficiency.
One area where this comes into play is with its embedding table lookup module. Embedding tables are used to track interactions between various context-specific features and interests of user profiles. They can track where you navigate, and what people Pin on Pinterest, share or numerous other actions, helping refine predictions on what users might like to click on next.
They are used to incrementally learn user preference based on context in order to make better content recommendations to those using Pinterest. Its embedding table lookup module required two computation steps repeated hundreds of times because of the number of features tracked.
Pinterest engineers greatly reduced this number of operations using a GPU-accelerated concurrent hash table from NVIDIA cuCollections. And they set up a custom consolidated embedding lookup module so they could merge requests into a single lookup. Better results were seen immediately.
Using cuCollections helped us to remove bottlenecks, said Eksombatchai.
Enlisting CUDA Graphs Pinterest relied on CUDA Graphs to eliminate what was remaining of the small batch operations, further optimizing its inference models.
CUDA Graphs helps reduce the CPU interactions when launching on GPUs. They're designed to enable workloads to be defined as graphs rather than single operations. They provide a mechanism to launch multiple GPU operations through a single CPU operation, reducing CPU overheads.
Pinterest enlisted CUDA Graphs to represent the model inference process as a static graph of operation instead of as those individually scheduled. This enabled the computation to be handled as a single unit without any kernel launching overhead.
The company now supports CUDA Graph as a new backend of its model server. When a model is first loaded, the model server runs the model inference once to build the graph instance. This graph can then be run repeatedly in inference to show content on its app or site.
Implementing CUDA Graphs helped Pinterest to significantly reduce inference latency of its recommender models, according to its engineers.
GPUs have enabled Pinterest to do something that was impossible with CPUs on the same budget, and by doing this they can make changes that have a direct impact on various business metrics.
Learn about Pinterest's GPU-driven inference and optimizations at its GTC session, Serving 100x Bigger Recommender Models, and in the Pinterest Engineering blog.
Register for GTC, running Sept. 19-22, for free to attend sessions with NVIDIA and dozens of industry leaders.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
09/10/2026
September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026
New Sports Intelligence helps providers better unders...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
24/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
24/09/2026
Viewers watching videos from the Austrian Parliament online will soon find it easier to verify the authenticity of the content. Big Blue Marble, an internationa...
24/09/2026
nsign, the digital signage SaaS platform built around its Simplify Complexity principle, is now officially certified for BRAVIA Professional Displays from Son...
24/09/2026
Encompass Digital Media today announced the successful migration of multiple Viaplay free-to-air channels, including TV3, TV6, TV8 and TV10, to its Altitude Sch...
24/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
24/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
24/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
24/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
24/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
24/09/2026
Music Supervisor, Composer, and Mixing Engineer Santiago Uribe has built a career around producing music for film and television, contributing to more than 40 p...
24/09/2026
The North American Broadcasters Association (NABA) will hold a full-day cybersecurity summit focused on defending against growing cyber threats facing the broad...
24/09/2026
RT Radio 1 Folk Awards Tickets on Sale
Dolores Keane to be inducted into the...
24/09/2026
A warped Manhattan is waiting in the cloud this week. Remedy Entertainment's CONTROL Resonant brings Dylan Faden's extraordinary abilities and a paranat...
23/09/2026
Four control rooms support B1G+ streams, videoboard shows, creative content, and...
23/09/2026
By Andrew Cohen, SVG Coorespondant
The Mountain West debuted its new Replay Operations Center at the start of this football season, bringing real-time collabor...
23/09/2026
The Taylorville, IL, native is pushing creative boundaries at Ball State, gaining reps across directing, technical directing, tape, and more than 100 ESPN+ broa...
23/09/2026
Alexander Heller, Nevada Jose, Will Brill, and Giselle Bonilla pose with cast members at The Musical premiere during the 2026 Sundance Film Festival at Eccles...
23/09/2026
Includes natural and processed patches
The Crow Hill Company's latest sample library captures a children's choir comprising a troupe of boys perform...
23/09/2026
Plug-in offers six bands of saturation
Kreuzberg Audio's product range includes a selection of plug-ins and virtual instruments aimed primarily at hard-...
23/09/2026
Latest DAW update now live
SoundBridge have announced that the latest update for the remote-collaboration-focused DAW is now available. The release of Sound...
23/09/2026
Koori Knockout returns home exclusively to NITV and SBS On Demand in 2026
11 September, 2026
Media releases
Fans can catch all the live action exclusively ...
23/09/2026
Rohde & Schwarz acquires NEOSAT and PHYTRONIC and strengthens its competencies i...
23/09/2026
1. ABOUT THE PROGRAMME
The National Film and Video Foundation (NFVF) invites applications from experienced producers who own or manage a South African product...
23/09/2026
The National Film and Video Foundation (NFVF) is pleased to announce the opening...
23/09/2026
Download Now!
To receive a short case study showcasing NHK Technologies, Inc. (NT) s audio setup, please enter the following details:
--
First Name* Fir...
23/09/2026
Nielsen CMI data reveals a changing fast-food landscape, with value, convenience...
23/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
23/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
23/09/2026
COW Jobs: Blender on Windows - Generalist - Remote
Brie Clayton September 23, 2026
0 Comments
Application Users - Blender on Windows - Generalist
Se...
23/09/2026
Version 1.8 recognised for new workflow tools, boosted control panel flexibility and ease of integration into IP networks...
23/09/2026
Hiltron Communications reports a successful 2026 International Broadcasting Convention, held at the RAI Amsterdam. Exhibiting on stand A37 in Hall 1, Hiltron ex...
23/09/2026
Reinforcing its long-term commitment to the Middle East and North Africa (MENA) broadcast market, LiveU is presenting the Q Era at CABSAT 2026, on Stand H1-D35 ...
23/09/2026
Agence France-Presse (AFP), a global news agency, and Dalet, a leading technology and service provider for media-rich organizations, today announced a partnersh...
23/09/2026
Berklee Connect Unlocks the Power of a Global Network Katie Vitolins BM '04 knows firsthand what Berklee's alumni community can make possible. Now she...
23/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
23/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
23/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
23/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
23/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
23/09/2026
Westminster Schools, a K through 12 school in Atlanta, Georgia with approximately 2,000 students, has transformed its student broadcast and digital storytelling...
23/09/2026
The 2026 edition of CABSAT and SATExpo may have a new home and dates in the diary, but it still retains a strong presence from UK companies in the GREAT Britain...
23/09/2026
Glensound will return to CABSAT with new developments in professional monitoring and Dante interfacing, alongside its established commentary, esports and parlia...
23/09/2026
September 23 2026, 17:00 (PDT) Dolby and Meta Expand Dolby Atmos and Dolby Vision Across Metas Ecosystem
Across Meta AI glasses, Instagram, and VR devices, ...
23/09/2026
A great watch - Radio Times
TV's most likeable proper bloke - Daily Telegraph
23rd September 2026, London: Guy Martin returns to free streaming service...
23/09/2026
Wednesday 23 September 2026
Sky Sports to show England Men's tour of South ...
23/09/2026
Comscore Partners with datafuelX to Bring Seamless Currency Adoption Into a Comp...
23/09/2026
Luxembourg, 23 September 2026 - SES today announced the appointment of Mr. Michel Scholer, Secretary General of the Luxembourg Government and Chief of Staff to ...