Sony Pixel Power calrec Sony

Pinterest Boosts Home Feed Engagement 16% With Switch to GPU Acceleration of Recommenders

04/08/2022

Pinterest has engineered a way to serve its photo-sharing community more of the images they love.

The social-image service, with more than 400 million monthly active users, has trained bigger recommender models for improved accuracy at predicting people's interests.

Pinterest handles hundreds of millions of user requests an hour on any given day. And it must also narrow down relevant images from roughly 300 billion images on the site to roughly 50 for each person.

The last step - ranking the most relevant and engaging content for everyone using Pinterest - required a leap in acceleration to run heftier models, with minimal latency, for better predictions.

Pinterest has improved the accuracy of its recommender models powering people's home feeds and other areas, increasing engagement by as much as 16%.

The leap was enabled by switching from CPUs to NVIDIA GPUs, which could easily be applied next to other areas, including advertising images, according to Pinterest.

Normally we would be happy with a 2% increase, and 16% is just a beginning for home feeds. We see additional gains - it opens a lot of doors for opportunities, said Pong Eksombatchai, a software engineer at Pinterest.

Transformer models capable of better predictions are shaking up industries from retail to entertainment and advertising. But their leaps in performance gains of the past few years have come with a need to serve models that are some 100x bigger as their number of model parameters and computations skyrockets.

Huge Inference Gains, Same Infrastructure Cost Like many, Pinterest engineers wanted to tap into state-of-the-art recommender models to increase engagement. But serving these massive models on CPUs presented a 100x increase in cost and latency. That wasn't going to maintain its magical user experience - fresh and more appealing images - occurring within a fraction of a second.

If that latency happened, then obviously our users wouldn't like that very much because they would have to wait forever, said Eksombatchai. We are pretty close to the limit of what we can do on CPU basically.

The challenge was to serve these hundredfold larger recommender models within the same cost and latency constraints.

Working with NVIDIA, Pinterest engineers began architectural changes to optimize their inference pipeline and recommender models to enable the transition from CPU to GPU cloud instances. The technology transition began late last year and required major changes to how the company manages workloads. The result is a 100x gain in inference efficiency on the same IT budget, meeting their goals.

We are starting to use really, really big models now. And that is where the GPU comes in - to help make these models possible, Eksombatchai said.

Tapping Into cuCollections Switching from CPUs to GPUs required rethinking its inference systems architecture. Among other issues, engineers had to change how they send workloads to their inference servers. Fortunately, there are tools to assist in making the transition easier.

The Pinterest inference server built for CPUs had to be altered because it was set up to send smaller batch sizes to its servers. GPUs can handle much larger workloads, so it's necessary to set up larger batch requests to increase efficiency.

One area where this comes into play is with its embedding table lookup module. Embedding tables are used to track interactions between various context-specific features and interests of user profiles. They can track where you navigate, and what people Pin on Pinterest, share or numerous other actions, helping refine predictions on what users might like to click on next.

They are used to incrementally learn user preference based on context in order to make better content recommendations to those using Pinterest. Its embedding table lookup module required two computation steps repeated hundreds of times because of the number of features tracked.

Pinterest engineers greatly reduced this number of operations using a GPU-accelerated concurrent hash table from NVIDIA cuCollections. And they set up a custom consolidated embedding lookup module so they could merge requests into a single lookup. Better results were seen immediately.

Using cuCollections helped us to remove bottlenecks, said Eksombatchai.

Enlisting CUDA Graphs Pinterest relied on CUDA Graphs to eliminate what was remaining of the small batch operations, further optimizing its inference models.

CUDA Graphs helps reduce the CPU interactions when launching on GPUs. They're designed to enable workloads to be defined as graphs rather than single operations. They provide a mechanism to launch multiple GPU operations through a single CPU operation, reducing CPU overheads.

Pinterest enlisted CUDA Graphs to represent the model inference process as a static graph of operation instead of as those individually scheduled. This enabled the computation to be handled as a single unit without any kernel launching overhead.

The company now supports CUDA Graph as a new backend of its model server. When a model is first loaded, the model server runs the model inference once to build the graph instance. This graph can then be run repeatedly in inference to show content on its app or site.

Implementing CUDA Graphs helped Pinterest to significantly reduce inference latency of its recommender models, according to its engineers.

GPUs have enabled Pinterest to do something that was impossible with CPUs on the same budget, and by doing this they can make changes that have a direct impact on various business metrics.

Learn about Pinterest's GPU-driven inference and optimizations at its GTC session, Serving 100x Bigger Recommender Models, and in the Pinterest Engineering blog.

Register for GTC, running Sept. 19-22, for free to attend sessions with NVIDIA and dozens of industry leaders.
LINK: https://blogs.nvidia.com/blog/2022/08/04/pinterest-gpu-acceleration-re...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

12/08/2026

ACLU Requests ABC Station Probe Documents from FCC

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

Roger Keating To Retire from Hearst Television

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

Netflix Closes U.S. Upfronts, Nearly Doubles Ad Commitments

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

CBS Pittsburgh Debuts New AR/VR News Studio

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

Matthews Intros T-Go Extreme Rigging Solutions

Matthews Studio Equipment introduces T-Go Mounting Solutions extreme camera rigging systems, engineered for the most demanding environments in motion picture pr...

12/08/2026

Anton Bauers EDEN Becomes Only Mobile Power Station in it...

Anton/Bauer, a Videndum brand and the industry leader in mobile power solutions for broadcast and cinematic production, announces that the EDEN Mobile Power Sta...

12/08/2026

TAG Video Systems Cuts Hardware Costs for Customers with...

TAG Video Systems, the global leader in software-based IP monitoring and multiviewer solutions, today announced a memory usage optimization that lowers the tota...

12/08/2026

Unified Streaming Launches Trusted Media - C2PA in Dynami...

Unified Streaming announces Trusted Media, a new solution that enables broadcasters, streaming platforms, and premium content owners to attach verifiable authen...

12/08/2026

Tedial Powers the AI-Driven Media Supply Chain at IBC 202...

Combining intelligent automation, composable business services and user-centric experiences The media industry is entering a new phase where AI intelligence is...

12/08/2026

DPA Microphones Appoints Raul Contreras as West Coast Reg...

DPA Microphones welcomes Raul Contreras as its new West Coast Regional Sales Manager. In this role, Contreras will oversee sales and customer relationships thro...

12/08/2026

Weather is Not a Factor for Marshall Electronics New CV57...

Marshall Electronics' first all-weather, all-IP 4K POV camera, the CV574-WP, makes its European debut at IBC 2026 (Stand 10.C11). Built for the elements, th...

12/08/2026

A double off-switch helps cells respond to stress

LA JOLLA, CA-Scientists at Scripps Research have discovered that two seemingly unrelated cellular enzymes become locked together during times of stress, simulta...

11/08/2026

Apple To Bring Friday Night Baseball Live to Apple Immersive on Vision Pro Beginning Aug. 28

Weekly immersive broadcasts will feature 8K 3D video, a 180-degree field of view...

11/08/2026

Looking for a New Cameraperson? ProductionHUB Guide Lays Out Considerations, Pitfalls

By Briana Brady, Social Media Manager, Production Hub Sports content is having ...

11/08/2026

SVG Sit-Down: Backlight CEO Kathleen Barrett on Building Media Infrastructure for a Global, AI-Driven Sports Landscape

She addresses why media organizations need more than asset storage, how sports t...

11/08/2026

FloSports Dennis LeMire on Implementing Cloud-Based Workflows on Lower Tier Sports

Remote commentary has improved significantly on these broadcasts At a clip of ...

11/08/2026

Miami HEAT's Revamped IP-Based Control Room Coordinates Workflows With Meinberg Intelligent Modular Synchronization System

A pair of LANTIME IMS M2000 PTP Grandmasters deliver resilient timing infrastruc...

11/08/2026

LTN Expands Live Event Master Control Capabilities for Sports Organizations

LTN has announced expanded capabilities for its Live Event Master Control offering, providing sports broadcasters, leagues, rights holders, and content owners w...

11/08/2026

WTA Ventures Appoints IMG as Managed Production Services Partner

WTA Ventures has appointed IMG as its managed production services partner in a multi-year agreement commencing with the 2027 season. The partnership is the late...

11/08/2026

New York Jets and CBS New York Extend Multi-Year Partnership

The New York Jets and CBS New York have agreed to a multi-year extension of their partnership, keeping CBS New York as the official broadcast home of the team. ...

11/08/2026

Nielsen Acquires DoubleVerify to Create New Combined Media Intelligence Platform

Nielsen Holdings and DoubleVerify have announced a definitive agreement under which Nielsen will acquire DoubleVerify in an all-cash transaction with an enterpr...

11/08/2026

AES Elects David v.R. Bowles as President-Elect for 2027, Unveils Other Election Results

The Audio Engineering Society has announced the results of its 2026 Board of Dir...

11/08/2026

SVG Sit-Down Creator Sports Network's Barrick Prince on Building the Next Layer of the Live-Sports Rights Stack

The CSN co-founder details its network and affiliate' model, how creator wi...

11/08/2026

Gravity Media Providing Host Broadcast Operations for Esports World Cup 2026

Gravity Media is providing host broadcast operations for the Esports World Cup (EWC) 2026, supporting ESL FACEIT Group (EFG) in delivering the tournament to glo...

11/08/2026

TAG Video Systems Reduces Memory Requirements for Compressed Workflows

TAG Video Systems has released a memory usage optimization for its MCM software that reduces the cost per channel by up to two-thirds for compressed workflows. ...

11/08/2026

SMT Expands LED Production and Scoring Services at 2026 Cincinnati Open

SMT is expanding its technology partnership with the Cincinnati Open this year, adding new LED displays, production capabilities, and fan-facing experiences at ...

11/08/2026

Pac-12 to Stream Fall Olympic Sports Home Events Free on YouTube

The Pac-12 has announced that home Olympic sports broadcasts throughout the fall season will be available free on the conference's YouTube channel at youtub...

11/08/2026

Case Study: Real Life Network Taps LiveU for Broadcast-Grade Streaming

Spreading a message of faith requires both widespread accessibility and uncompromising visual quality. Real Life Network (RLN), a free, faith-based digital stre...

11/08/2026

Tennessee Titans' New Nissan Stadium Will Live Up to Its Music City Location

Taking the synergy of sports and entertainment a step further, the NFL venue in Nashville will house iterations of two iconic music clubs The marriage of Taylo...

11/08/2026

The Crow Hill Company introduce Pocket Strings

Free library captures pro classical string section There's no shortage of freebies in The Crow Hill Company's line-up, with their Vaults series offe...

11/08/2026

Emergence Audio unveil Envoy

Percussion instrument introduces all-new engine Emergence Audio have just introduced a instrument that brings together a vast collection of percussive analo...

11/08/2026

Boris FX reveal Sequoia 2026.5

Introduces new all-in-one Spatial Panner tool Boris FX have recently announced the latest major update for their mastering and broadcast-focused DAW softwar...

11/08/2026

Rohde & Schwarz installs millimeter wave security scanners at Airports of Thailand (AOT) Airports

Rohde & Schwarz installs millimeter wave security scanners at Airports of Thaila...

11/08/2026

Dolby Acquires VVC Patents From Florida Atlantic University

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

Alyson Stewart Joins Zixi as Senior Director, Sales

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

FCC Issues Alert Over Scammers Impersonating Its Commissioners

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

Comcast, Disney Ink Deal to End NFL Network Blackout

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

farmerswife and Cirkus are Exhibiting at IBC 2026

farmerswife and Cirkus will return to IBC 2026 to showcase new tools designed to help broadcast, media and post-production teams manage workflows with greater s...

11/08/2026

LiveU Powers Cross-Venue Coverage of Glasgow Commonwealth...

LiveUs LU900Q intelligent production unit played a central role in the host broadcast operation for the Games in Glasgow (July 23 to August 2, 2026). The host b...

11/08/2026

Jigsaw24 Appoints James Morse as Client Director to Drive...

Jigsaw24 has appointed James Morse as Client Director, Media Sales, as it deepens its focus on sports, live events and integrated production. His appointment co...

11/08/2026

Net Insight enables one of Europes largest broadcast grad...

Net Insight today announced that DMC Production Norway has selected its Open Live Media solution to centralize the production of Blinkfestivalen 2026. Combining...

11/08/2026

Vivaro Supports Record World Cup Audiences with the Appea...

Modular HEVC and JPEG XS workflows enabled resilient, ultra-low-latency delivery for leading linear and digital media platforms across all 104 matches Appear A...

11/08/2026

Homecoming Artist Spotlight: Fabiola Mndez

Homecoming Artist Spotlight: Fabiola M ndez The first cuatrista to graduate from Berklee talks about the community that shaped her career ahead of her Homecom...

11/08/2026

FOR-A To Highlight MixBoard, Viztrik AiDi Enhancement At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

AMWA and EBU to Host Demos at IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

Dalet Solution Suites Enable Media Teams to Move Like a S...

Dalet, a leading technology and service provider for media-rich organizations, today announced Dalet Solution Suites, a new portfolio of cloud-native solutions ...

11/08/2026

Mediagenix Helps Broadcasters Prepare for Brazil DTV Futu...

Mediagenix, a global leader in smart content solutions to profitably connect the right content to the right audience, will showcase how media companies can prep...