
The NVIDIA Blackwell platform has been widely adopted by leading inference providers such as Baseten, DeepInfra, Fireworks AI and Together AI to reduce cost per token by up to 10x. Now, the NVIDIA Blackwell Ultra platform is taking this momentum further for agentic AI.
AI agents and coding assistants are driving explosive growth in software-programming-related AI queries: from 11% to about 50% last year, according to OpenRouter's State of Inference report. These applications require low latency to maintain real-time responsiveness across multistep workflows and long context when reasoning across entire codebases.
New SemiAnalysis InferenceX performance data shows that the combination of NVIDIA's software optimizations and the next-generation NVIDIA Blackwell Ultra platform has delivered breakthrough advances on both fronts. NVIDIA GB300 NVL72 systems now deliver up to 50x higher throughput per megawatt, resulting in 35x lower cost per token compared with the NVIDIA Hopper platform.
By innovating across chips, system architecture and software, NVIDIA's extreme codesign accelerates performance across AI workloads - from agentic coding to interactive coding assistants - while driving down costs at scale.
GB300 NVL72 Delivers up to 50x Better Performance for Low-Latency Workloads Recent analysis from Signal65 shows that NVIDIA GB200 NVL72 with extreme hardware and software codesign delivers more than 10x more tokens per watt, resulting in one-tenth the cost per token compared with the NVIDIA Hopper platform. These massive performance gains continue to expand as the underlying stack improves.
Continuous optimizations from the NVIDIA TensorRT-LLM, NVIDIA Dynamo, Mooncake and SGLang teams continue to significantly boost Blackwell NVL72 throughput for mixture-of-experts (MoE) inference across all latency targets. For instance, NVIDIA TensorRT-LLM library improvements have delivered up to 5x better performance on GB200 for low-latency workloads compared with just four months ago.
Higher-performance GPU kernels optimized for efficiency and low latency help make the most of Blackwell's immense compute capabilities and boost throughput.
NVIDIA NVLink Symmetric Memory enables direct GPU-to-GPU memory access for more efficient communication.
Programmatic dependent launch minimizes idle time by launching the next kernel's setup phase before the previous one completes.
Building on these software advances, GB300 NVL72 - which features the Blackwell Ultra GPU - pushes the throughput-per-megawatt frontier to 50x compared with the Hopper platform.
This performance gain translates into superior economics, with NVIDIA GB300 lowering costs compared with the Hopper platform across the entire latency spectrum. The most dramatic reduction occurs at low latency, where agentic applications operate: up to 35x lower cost per million tokens compared with the Hopper platform.
NVIDIA GB300 NVL72 and the codesigned software stack including NVIDIA Dynamo and TensorRT-LLM deliver 35x lower cost per token compared with NVIDIA Hopper platform. For agentic coding and interactive assistants workloads where every millisecond compounds across multistep workflows, this combination of relentless software optimization and next-generation hardware enables AI platforms to scale real-time interactive experiences to significantly more users.
GB300 NVL72 Delivers Superior Economics for Long-Context Workloads While both GB200 NVL72 and GB300 NVL72 efficiently deliver ultralow latency, the distinct advantages of GB300 NVL72 become most apparent in long-context scenarios. For workloads with 128,000-token inputs and 8,000-token outputs - such as AI coding assistants reasoning across codebases - GB300 NVL72 delivers up to 1.5x lower cost per token compared with GB200 NVL72.
NVIDIA GB300 NVL72 is ideal for low-latency, long-context workloads. Context grows as the agent reads in more of the code. This allows it to better understand the code base but also requires much more compute. Blackwell Ultra has 1.5x higher NVFP4 compute performance and 2x faster attention processing, enabling the agent to efficiently understand entire code bases.
Infrastructure for Agentic AI Leading cloud providers and AI innovators have already deployed NVIDIA GB200 NVL72 at scale, and are also deploying GB300 NVL72 in production. Microsoft, CoreWeave and OCI are deploying GB300 NVL72 for low-latency and long-context use cases such as agentic coding and coding assistants. By reducing token costs, GB300 NVL72 enables a new class of applications that can reason across massive codebases in real time.
As inference moves to the center of AI production, long-context performance and token efficiency become critical, said Chen Goldberg, senior vice president of engineering at CoreWeave. Grace Blackwell NVL72 addresses that challenge directly, and CoreWeave's AI cloud, including CKS and SUNK, is designed to translate GB300 systems' gains, building on the success of GB200, into predictable performance and cost efficiency. The result is better token economics and more usable inference for customers running workloads at scale.
NVIDIA Vera Rubin NVL72 to Bring Next-Generation Performance With NVIDIA Blackwell systems deployed at scale, continuous software optimizations will keep unlocking additional performance and cost improvements across the installed base.
Looking ahead, the NVIDIA Rubin platform - which combines six new chips to create one AI supercomputer - is set to deliver another round of massive performance leaps. For MoE inference, it delivers up to 10x higher throughput per megawatt compared with Blackwell, translating into one-tenth the cost per million tokens. And for the next wave of frontier AI models, Rubin can train large MoE models using just one-fourth the number of GPUs compared with Blackwell.
Learn more about th
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
02/05/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
01/05/2026
January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...
01/04/2026
January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION
Douyin Users Can Now Create And Share Videos With Stun...
07/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/03/2026
TNT Sports and the International Basketball Federation (FIBA) have reached a mul...
06/03/2026
OffBall and TOGETHXR, two influential young media companies in sports, announce a strategic and operational partnership in a shared push to scale and create inn...
06/03/2026
InfoComm 2026, a destination for AV, IT, broadcast, and AI-driven systems, annou...
06/03/2026
LTN and MediaKind announce a strategic partnership to integrate MediaKind's ...
06/03/2026
X Games and the Greater New Orleans Sports Foundation (GNOSF) announce that New Orleans, Louisiana, will host the first-ever X Games Championship event - the fi...
06/03/2026
As part of a busy start of the year at Chyron, the AXIS team developed a set of improvements for AXIS Maps. The features released empower users with more flexib...
06/03/2026
At the 2026 NAB Show, BeckTV, a premier systems integrator for the broadcast ind...
06/03/2026
At NAB Show 2026, Net Insight introduces Nimbra Live Intelligence, which definin...
06/03/2026
SES announces that it has added new Medium Earth Orbit (MEO) satellite capacity ...
06/03/2026
LucidLink, the cloud-native file streaming platform for instant, secure access to large files, announce LucidLink Connect, a new solution that enables real-time...
06/03/2026
Panasonic helped bring the world of Paddington: The Musical to life through imme...
06/03/2026
In-venue and creative video staffers at the professional and collegiate level ha...
06/03/2026
Ratings Roundup is a rundown of recent rating news and is derived from press releases and reports around the industry. In this week's edition, NASCAR Cup Se...
06/03/2026
At the 2026 NAB Show, Riedel Communications opens with a clear message to the North American market: production technology does not have to be complex.
This ye...
06/03/2026
Midco Sports isn't your typical regional sports network. Backed by nearly a ...
06/03/2026
The stories around the Paralympics are really touching and the athletes, the atmosphere it is all amazing and we want to use new technologies to help us tell th...
06/03/2026
Apple TV subscribers will have access to as many as 30 additional live feeds acr...
06/03/2026
Ten years after its release, South African hip-hop artist Kwesta's DaKAR II is still making waves. With 51.8 million streams on Spotify, the album continues...
06/03/2026
Statement on the appointment of Dr Nicholas Pappas AM as SBS Chair
Media releases
The SBS Board and Executive have welcomed the appointment of Dr Nicholas P...
06/03/2026
Nielsen Highlights Women's Sports Viewership Milestones Ahead of International Women's Day on March 8
New York March 5, 2026 According to Nielsen...
06/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/03/2026
Spanish FM and online broadcaster esRadio has selected DHD RX2 audio production consoles for use at its studio headquarters in Madrid. Part of the Libertad Digi...
06/03/2026
LucidLink, the cloud-native file streaming platform for instant, secure access to large files, today announced LucidLink Connect, a new solution that enables re...
06/03/2026
At the 2026 NAB Show, BeckTV, a premier systems integrator for the broadcast industry, is launching BeckFlow, the first web-based schematic documentation platfo...
06/03/2026
At NAB Show 2026, Net Insight introduces Nimbra Live Intelligence defining a new category and setting a new standard for live operations: the Open Media Platfor...
06/03/2026
At the 2026 NAB Show, Interra Systems will showcase its latest advancements in automated QC, real-time monitoring, and captioning reinforcing its position as ...
06/03/2026
At the 2026 NAB Show, Riedel Communications opens with a clear message to the North American market: production technology does not have to be complex. This yea...
06/03/2026
New partnership combines on-prem video processing with reliable IP transport to support the transition from C-Band satellite to IP distribution
LTN and MediaKi...
06/03/2026
06 Mar 2026
VEON and JazzWorld Advance Pakistan's Digital Financial Future ...
06/03/2026
Friday 6 March 2026
Teaser revealed for Saturday Night Live UKTurn on cookies to view this content. Go to Privacy options and select Accept All'.
Privacy...
06/03/2026
Back to All News
Announcing Barbara - Becoming Shirin David
Entertainment
06 March 2026
GlobalGermany
Link copied to clipboard
Available exclusively on N...
06/03/2026
Discover how the F1 sound team turned a real Grand Prix into a cinematic experience.
Director Joseph Kosinski and his team worked directly with the Formula On...
06/03/2026
Arvato Systems Joins Initiative D21 e. V.
Shaping digital transformation together
Collaboration in Germanys largest network for the digital society
Membersh...
06/03/2026
The Trustworthy Accountability Group (TAG) is a global initiative dedicated to c...
06/03/2026
We are deeply saddened to hear the very sad news of the death of our friend and colleague, John McHugh. John was an exceptionally talented creative leader who s...
06/03/2026
First exclusive look at RT 's promo as Ireland prepare to take on Czechia
Every Moment, Every Generation
https://youtu.be/2ijo96EadLU
36 years after Geor...
06/03/2026
A new clue to how the body detects physical force Scripps Research scientists offer new insight into how the body detects light touch and how disruptions in tha...
05/03/2026
More than 250 sports-graphics professionals packed into The Cutting Room in New ...
05/03/2026
Cosm announces that it will open its third immersive entertainment venue at downtown Atlanta's Centennial Yards on June 10, 2026. Its first public event wil...