Sony Pixel Power calrec Sony

What Is a SuperNIC?

20/11/2023

Generative AI is the latest turn in the fast-changing digital landscape. One of the groundbreaking innovations making it possible is a relatively new term: SuperNIC.

What Is a SuperNIC? SuperNIC is a new class of network accelerators designed to supercharge hyperscale AI workloads in Ethernet-based clouds. It provides lightning-fast network connectivity for GPU-to-GPU communication, achieving speeds reaching 400Gb/s using remote direct memory access (RDMA) over converged Ethernet (RoCE) technology.

SuperNICs combine the following unique attributes:

High-speed packet reordering to ensure that data packets are received and processed in the same order they were originally transmitted. This maintains the sequential integrity of the data flow.

Advanced congestion control using real-time telemetry data and network-aware algorithms to manage and prevent congestion in AI networks.

Programmable compute on the input/output (I/O) path to enable customization and extensibility of network infrastructure in AI cloud data centers.

Power-efficient, low-profile design to efficiently accommodate AI workloads within constrained power budgets.

Full-stack AI optimization, including compute, networking, storage, system software, communication libraries and application frameworks.

NVIDIA recently unveiled the world's first SuperNIC tailored for AI computing, based on the BlueField-3 networking platform. It's a part of the NVIDIA Spectrum-X platform, where it integrates seamlessly with the Spectrum-4 Ethernet switch system.

Together, the NVIDIA BlueField-3 SuperNIC and Spectrum-4 switch system form the foundation of an accelerated computing fabric specifically designed to optimize AI workloads. Spectrum-X consistently delivers high network efficiency levels, outperforming traditional Ethernet environments.

In a world where AI is driving the next wave of technological innovation, the BlueField-3 SuperNIC is a vital cog in the machinery, said Yael Shenhav, vice president of DPU and NIC products at NVIDIA. SuperNICs ensure that your AI workloads are executed with efficiency and speed, making them foundational components for enabling the future of AI computing.

The Evolving Landscape of AI and Networking The AI field is undergoing a seismic shift, thanks to the advent of generative AI and large language models. These powerful technologies have unlocked new possibilities, enabling computers to handle new tasks.

AI success relies heavily on GPU-accelerated computing to process mountains of data, train large AI models, and enable real-time inference. This new compute power has opened new possibilities, but it has also challenged Ethernet cloud networks.

Traditional Ethernet, the technology that underpins internet infrastructure, was conceived to offer broad compatibility and connect loosely coupled applications. It wasn't designed to handle the demanding computational needs of modern AI workloads, which involve tightly coupled parallel processing, rapid data transfers and unique communication patterns - all of which demand optimized network connectivity.

Foundational network interface cards (NICs) were designed for general-purpose computing, universal data transmission and interoperability. They were never designed to cope with the unique challenges posed by the computational intensity of AI workloads.

Standard NICs lack the requisite features and capabilities for efficient data transfer, low latency and the deterministic performance crucial for AI tasks. SuperNICs, on the other hand, are purpose-built for modern AI workloads.

SuperNIC Advantages in AI Computing Environments Data processing units (DPUs) deliver a wealth of advanced features, offering high throughput, low-latency network connectivity and more. Since their introduction in 2020, DPUs have gained popularity in the realm of cloud computing, primarily due to their capacity to offload, accelerate and isolate data center infrastructure processing.

Although DPUs and SuperNICs share a range of features and capabilities, SuperNICs are uniquely optimized for accelerating networks for AI. The chart below shows how they compare:

Distributed AI training and inference communication flows depend heavily on network bandwidth availability for success. SuperNICs, distinguished by their sleek design, scale more effectively than DPUs, delivering an impressive 400Gb/s of network bandwidth per GPU.

The 1:1 ratio between GPUs and SuperNICs within a system can significantly enhance AI workload efficiency, leading to greater productivity and superior outcomes for enterprises.

The sole purpose of SuperNICs is to accelerate networking for AI cloud computing. Consequently, it achieves this goal using less computing power than a DPU, which requires substantial computational resources to offload applications from a host CPU.

The reduced computing requirements also translate to lower power consumption, which is especially crucial in systems containing up to eight SuperNICs.

Additional distinguishing features of the SuperNIC include its dedicated AI networking capabilities. When tightly integrated with an AI-optimized NVIDIA Spectrum-4 switch, it offers adaptive routing, out-of-order packet handling and optimized congestion control. These advanced features are instrumental in accelerating Ethernet AI cloud environments.

Revolutionizing AI Cloud Computing The NVIDIA BlueField-3 SuperNIC offers several benefits that make it key for AI-ready infrastructure:

Peak AI workload efficiency: The BlueField-3 SuperNIC is purpose-built for network-intensive, massively parallel computing, making it ideal for AI workloads. It ensures that AI tasks run efficiently - without bottlenecks.

Consistent and predictable performance: In multi-tenant data centers where numerous tasks are processed simultaneously, the BlueField-3 SuperN
LINK: https://blogs.nvidia.com/blog/what-is-a-supernic/...
See more stories from nvidia

More from Nvidia

01/03/2024

Live at GTC: Hear From Industry Leaders Using AI to Drive Innovation and Agility

Interest in new AI applications reached a fever pitch last year as business leaders began exploring AI pilot programs. This year, they're focused on strateg...

01/03/2024

What Is Trustworthy AI?

Artificial intelligence, like any transformative technology, is a work in progress - continually growing in its capabilities and its societal impact. Trustworth...

29/02/2024

Battle.net Leaps Into the Cloud With GeForce NOW

GFN Thursday celebrates this leap day with the addition of a popular game store to the cloud. Stream the first titles from Blizzard Entertainment's Battle....

28/02/2024

What Is Sovereign AI?

Nations have long invested in domestic infrastructure to advance their economies, control their own data and take advantage of technology opportunities in areas...

28/02/2024

Time to Skill Up: Game Reviewer Ralph Panebianco Wields NVIDIA RTX for the Win

Editor's note: This post is part of our weekly In the NVIDIA Studio series, which celebrates featured artists, offers creative tips and tricks, and demonstr...

28/02/2024

And Action! Cuebric CEO Provides Insights Into Filmmaking Using AI

These days, just about everyone is a content creator. But can generative AI help make people create high-quality films and other content affordably? Find out fr...

27/02/2024

Meet the Omnivore: Mode Maison Harnesses OpenUSD to Drive Innovations in Retail With High-Fidelity Digital Twins

Editor's note: This post is a part of our Meet the Omnivore series, which fe...

27/02/2024

Rack n' Roll: NVIDIA Grace Hopper Systems Gather at GTC

The spirit of software legend Grace Hopper will live on at NVIDIA GTC. Accelerated systems using powerful processors - named in honor of the pioneer of program...

26/02/2024

NVIDIA RTX 500 and 1000 Professional Ada Generation Laptop GPUs Drive AI-Enhanced Workflows From Anywhere

With generative AI and hybrid work environments becoming the new standard, nearl...

22/02/2024

FOMO Alert: Discover 7 Unmissable Reasons to Attend GTC 2024

I just got back from GTC and . In four weeks, those will be among the most powerful words in your industry. But you won't be able to use them if you have...

22/02/2024

Time to Play: GeForce NOW Now Offers 1,800 Games to Stream

Top-tier games from publishing partners Bandai Namco Entertainment and Inflexion Games are joining GeForce NOW this week as the cloud streaming service's fo...

22/02/2024

Into the Omniverse: Rhino 3D Launches OpenUSD Features to Enhance 3D Modeling and Development

Editor's note: This post is part of Into the Omniverse, a series focused on ...

22/02/2024

Add It to the Toolkit: February Studio Driver and NVIDIA App Beta Now Available

Editor's note: This post is part of our weekly In the NVIDIA Studio series, which celebrates featured artists, offers creative tips and tricks, and demonstr...

21/02/2024

Shining Brighter Together: Google's Gemma Optimized to Run on NVIDIA GPUs

NVIDIA, in collaboration with Google, today launched optimizations across all NVIDIA AI platforms for Gemma - Google's state-of-the-art new lightweight 2 bi...

16/02/2024

AI's Hottest Ticket: NVIDIA GTC Brings Together Automotive Leaders and Visionaries Transforming the Future of Transportation

Generative AI and software-defined computing are transforming the automotive lan...

15/02/2024

The Easiest Upgrade: Play at Ultimate Quality With GeForce NOW

GFN Thursday keeps its fourth anniversary celebrations rolling by bringing Ubisoft's Skull and Bones and Microsoft's Halo Infinite to the cloud this wee...

15/02/2024

NVIDIA Eos Revealed: Peek Into Operations of a Top 10 Supercomputer

Providing a peek at the architecture powering advanced AI factories, NVIDIA Thursday released a video that offers the first public look at Eos, its latest data-...

15/02/2024

Artistry With Adobe: Creator Esteban Toro Delivers Inspirational Master Class Powered by AI and RTX

Adobe is putting generative AI into the hands of creators with Adobe Firefly - p...

15/02/2024

Telco GPT: Survey Shows Scale of Industry's Enthusiasm and Adoption of Generative AI

It's been five years since the telecommunications industry first deployed 5G...

14/02/2024

Digitalization: A Game Changer for the Auto Industry

The fusion of the physical and digital worlds is reshaping the automotive industry. NVIDIA's automotive partners are using digitalization to transform every...

14/02/2024

How the Ohio Supercomputer Center Drives the Future of Computing

NASCAR races are all about speed, but even the fastest cars need to factor in safety, especially as rules and tracks change. The Ohio Supercomputer Center is re...

14/02/2024

Speak Like a Native: NVIDIA Parlays Win in Voice Challenge

Thanks to their work driving AI forward, Akshit Arora and Rafael Valle could someday speak to their spouses' families in their native languages. Arora and ...

13/02/2024

Say What? Chat With RTX Brings Custom Chatbot to NVIDIA RTX AI PCs

Chatbots are used by millions of people around the world every day, powered by NVIDIA GPU-based cloud servers. Now, these groundbreaking tools are coming to Win...

12/02/2024

NVIDIA RTX 2000 Ada Generation GPU Brings Performance, Versatility for Next Era of AI-Accelerated Design and Visualization

Generative AI is driving change across industries - and to take advantage of its...

12/02/2024

NVIDIA CEO: Every Country Needs Sovereign AI

Every country needs to own the production of their own intelligence, NVIDIA founder and CEO Jensen Huang told attendees Monday at the World Governments Summit i...

08/02/2024

National Institute of Standards and Technology Launches Artificial Intelligence Safety Institute Consortium

NVIDIA has joined the National Institute of Standards and Technology's new U...

08/02/2024

Devices for Days: With GeForce NOW, Every Device Is a Dream Gaming PC

The GeForce NOW anniversary celebrations continue with more games and a member-exclusive discount on the Logitech G Cloud. Among the six new titles coming to t...

07/02/2024

Beyond Data-Driven': How Energy-Efficient Computing for AI Is Propelling Innovation and Savings Across Industries

With advances in computing, sophisticated AI models and machine learning are hav...

06/02/2024

Twitch Streamer Mr_Vudoo Supercharges Gaming, Entertaining and Video Editing With RTX This Week In the NVIDIA Studio'

Editor's note: This post is part of our weekly In the NVIDIA Studio series, ...

05/02/2024

Canada Partners With NVIDIA to Supercharge Computing Power

AI is reshaping industries, society and the very fabric of innovation - and Canada is poised to play a key role in this global transformation, said NVIDIA fou...

05/02/2024

New Study Cites AI as Strategic Tool to Combat Climate Change

A new study underscores the potential of AI and accelerated computing to deliver energy efficiency and combat climate change, efforts in which NVIDIA has long b...

01/02/2024

GeForce NOW Leaps Into Its Fourth Year With 27 New Games and More Celebrations All Month Long

GeForce NOW is celebrating its fourth anniversary all month - plus an extra day ...

31/01/2024

Cardiac Clarity: Dr. Keith Channon Talks Revolutionizing Heart Health With AI

Here's some news to still beating hearts: AI is helping bring some clarity to cardiology. Caristo Diagnostics has developed an AI-powered solution for detec...

30/01/2024

Singtel, NVIDIA to Bring Sovereign AI to Southeast Asia

Asia's lion city is roaring ahead in AI. Singtel, a leading communications services provider based in Singapore, will bring the NVIDIA AI platform to busin...

30/01/2024

Behold the Magic Valley': Brandon Tieh's Stunning Scene Showcases Peak Creativity, Powered by RTX and AI

Editor's note: This post is part of our weekly In the NVIDIA Studio series, ...

29/01/2024

Boston Children's Researchers, in Joint Effort, Deploy AI Across Their Hip Clinic to Support Patients, Doctors

Hip disorders, comprising some of the world's most common joint diseases, ar...

25/01/2024

Sharper Image: GeForce NOW Update Delivers Stunning Visuals to Android Devices

This GFN Thursday levels up PC gaming on mobile with higher-resolution support on Android devices. This week also brings 10 new games to the GeForce NOW librar...

24/01/2024

High Can See Clearly Now: AI-Powered NVIDIA RTX Video HDR Transforms Standard Video Into Stunning High Dynamic Range

Editor's note: This post is part of our weekly In the NVIDIA Studio series, ...

24/01/2024

US National Science Foundation Launches National AI Research Resource Pilot

In a major stride toward building a shared national research infrastructure, the U.S. National Science Foundation has launched the National Artificial Intellige...

23/01/2024

NVIDIA DRIVE Partners Showcase Cutting-Edge Innovations in Automated and Autonomous Driving

The automotive industry is being transformed by the integration of cutting-edge ...

23/01/2024

How Amazon and NVIDIA Help Sellers Create Better Product Listings With AI

It's hard to imagine an industry more competitive - or fast-paced - than online retail. Sellers need to create attractive and informative product listings ...

18/01/2024

Dino-Mite: Capcom's Exoprimal' Joins GeForce NOW

Hold on to your seats - this GFN Thursday is unleashing dinosaurs, crowns and more in the cloud. Catch it all on Capcom's Exoprimal and Ubisoft's Princ...

18/01/2024

Buried Treasure: Startup Mines Clean Energy's Prospects With Digital Twins

Mark Swinnerton aims to fight climate change by transforming abandoned mines into storage tanks of renewable energy. The CEO of startup Green Gravity is protot...

17/01/2024

From Embers to Algorithms: How DigitalPath's AI is Revolutionizing Wildfire Detection

The AI Podcast DigitalPath's Ethan Higgins On Using AI to Fight Wildfires ...

16/01/2024

Starstruck: 3D Artist Brellias Brings Curiosity to Light This Week In the NVIDIA Studio'

Editor's note: This post is part of our weekly In the NVIDIA Studio series, ...

16/01/2024

Mori Speech AI Model Helps Preserve and Promote New Zealand Indigenous Language

Indigenous languages are under threat. Some 3,000 - three-quarters of the total - could disappear before the end of the century, or one every two weeks, accordi...

12/01/2024

NVIDIA CEO: This Year, Every Industry Will Become a Technology Industry'

This year, every industry will become a technology industry, NVIDIA founder and CEO Jensen Huang told attendees Wednesday during the annual J.P. Morgan Healthc...

11/01/2024

To the Cloud and Beyond: New Activision and Blizzard Games, Day Passes and G-SYNC Technology Coming to GeForce NOW

GFN Thursday recaps the latest cloud announcements from CES 2024 - Day Pass memb...

11/01/2024

AI Takes Center Stage: Survey Reveals Financial Industry's Top Trends for 2024

The financial services industry is undergoing a significant transformation with ...

10/01/2024

NVIDIA Remains Among Very Best Places to Work in US, Rising to No. 2 on Glassdoor's Annual List

NVIDIA continues to be among America's very best places to work as judged by...