NVIDIA to Share New Details on Grace CPU, Hopper GPU, NVLink Switch, Jetson Orin Module at Hot Chips
19/08/2022
Speaking at a virtual Hot Chips event, an annual gathering of processor and system architects, they'll disclose performance numbers and other technical details for NVIDIA's first server CPU, the Hopper GPU, the latest version of the NVSwitch interconnect chip and the NVIDIA Jetson Orin system on module (SoM).
The presentations provide fresh insights on how the NVIDIA platform will hit new levels of performance, efficiency, scale and security.
Specifically, the talks demonstrate a design philosophy of innovating across the full stack of chips, systems and software where GPUs, CPUs and DPUs act as peer processors. Together they create a platform that's already running AI, data analytics and high performance computing jobs inside cloud service providers, supercomputing centers, corporate data centers and autonomous systems.
Inside NVIDIA's First Server CPU Data centers require flexible clusters of CPUs, GPUs and other accelerators sharing massive pools of memory to deliver the energy-efficient performance today's workloads demand.
To meet that need, Jonathon Evans, a distinguished engineer and 15-year veteran at NVIDIA, will describe the NVIDIA NVLink-C2C. It connects CPUs and GPUs at 900 gigabytes per second with 5x the energy efficiency of the existing PCIe Gen 5 standard, thanks to data transfers that consume just 1.3 picojoules per bit.
NVLink-C2C connects two CPU chips to create the NVIDIA Grace CPU with 144 Arm Neoverse cores. It's a processor built to solve the world's largest computing problems.
For maximum efficiency, the Grace CPU uses LPDDR5X memory. It enables a terabyte per second of memory bandwidth while keeping power consumption for the entire complex to 500 watts.
One Link, Many Uses NVLink-C2C also links Grace CPU and Hopper GPU chips as memory-sharing peers in the NVIDIA Grace Hopper Superchip, delivering maximum acceleration for performance-hungry jobs such as AI training.
Anyone can build custom chiplets using NVLink-C2C to coherently connect to NVIDIA GPUs, CPUs, DPUs and SoCs, expanding this new class of integrated products. The interconnect will support AMBA CHI and CXL protocols used by Arm and x86 processors, respectively.
First memory benchmarks for Grace and Grace Hopper. To scale at the system level, the new NVIDIA NVSwitch connects multiple servers into one AI supercomputer. It uses NVLink, interconnects running at 900 gigabytes per second, more than 7x the bandwidth of PCIe Gen 5.
NVSwitch lets users link 32 NVIDIA DGX H100 systems into an AI supercomputer that delivers an exaflop of peak AI performance.
Alexander Ishii and Ryan Wells, both veteran NVIDIA engineers, will describe how the switch lets users build systems with up to 256 GPUs to tackle demanding workloads like training AI models that have more than 1 trillion parameters.
The switch includes engines that speed data transfers using the NVIDIA Scalable Hierarchical Aggregation Reduction Protocol. SHARP is an in-network computing capability that debuted on NVIDIA Quantum InfiniBand networks. It can double data throughput on communications-intensive AI applications.
NVSwitch systems enable exaflop-class AI supercomputers. Jack Choquette, a senior distinguished engineer with 14 years at the company, will provide a detailed tour of the NVIDIA H100 Tensor Core GPU, aka Hopper.
In addition to using the new interconnects to scale to new heights, it packs many advanced features that boost the accelerator's performance, efficiency and security.
Hopper's new Transformer Engine and upgraded Tensor Cores deliver a 30x speedup compared to the prior generation on AI inference with the world's largest neural network models. And it employs the world's first HBM3 memory system to deliver a whopping 3 terabytes of memory bandwidth, NVIDIA's biggest generational increase ever.
Among other new features:
Hopper adds virtualization support for multi-tenant, multi-user configurations.
New DPX instructions speed recurring loops for select mapping, DNA and protein-analysis applications.
Hopper packs support for enhanced security with confidential computing.
Choquette, one of the lead chip designers on the Nintendo64 console early in his career, will also describe parallel computing techniques underlying some of Hopper's advances.
Michael Ditty, chief architect for Orin and a 17-year tenure at the company, will provide new performance specs for NVIDIA Jetson AGX Orin, an engine for edge AI, robotics and advanced autonomous machines.
It integrates 12 Arm Cortex-A78 cores and an NVIDIA Ampere architecture GPU to deliver up to 275 trillion operations per second on AI inference jobs. That's up to 8x greater performance at 2.3x higher energy efficiency than the prior generation.
The latest production module packs up to 32 gigabytes of memory and is part of a compatible family that scales down to pocket-sized 5W Jetson Nano developer kits.
Performance benchmarks for NVIDIA Orin All the new chips support the NVIDIA software stack that accelerates more than 700 applications and is used by 2.5 million developers.
Based on the CUDA programming model, it includes dozens of NVIDIA SDKs for vertical markets like automotive (DRIVE) and healthcare (Clara), as well as technologies such as recommendation systems (Merlin) and conversational AI (Riva).
The NVIDIA AI platform is available from major cloud services and system makers.
For more details, read technical blogs on Grace and NVLink written by Hot Chips speakers.
LINK: | https://blogs.nvidia.com/blog/2022/08/19/grace-hopper-nvswitch-hot-chi... |
See more stories from nvidia |
North America Stories
25/04/2024
Inside the Archives: Highlighting the Importance of Preservation for the Festival's 40th Edition
Sundance Institute Founder Robert Redford during a press conference at the 1996 ...
25/04/2024
SNS Dealer Of The Year Awards: See The Full List Of Winners
alt= class=wp-image-12361 data-lazy-src=/wp-content/uploads/2024/04/NAB-booth-2024-960x540-1.jpg/> Set against a vibrant backdrop of innovation and collaboratio...
25/04/2024
Trends And Takeaways From NAB Show 2024
alt= class=wp-image-12356 data-lazy-src=/wp-content/uploads/2024/04/NAB-mod-win-960x540-1.jpg/>NAB's Eric Trabb (right) awards SNS with two NAB Show Product...
25/04/2024
Peacock Subs Jump 55% YoY to 34M in Q1 2024
PHILADELPHIA Comcast beat earnings estimates in its Q1 2024 financial report, as streaming losses continued to decline and Peacock's paid subscribers spiked...
25/04/2024
Seattle Kraken Inks Deals with Tegna and Prime Video
SEATTLE The Seattle Kraken have inked new multi-year agreements with Tegna and Prime Video that will expand access to their games over broadcast stations and st...
25/04/2024
Cintel Scanner G3 HDR+ Restores Egypt's Cinema Treasures to Their Former Glory
Cintel Scanner G3 HDR Restores Egypt's Cinema Treasures to Their Former Glo...
25/04/2024
Sinclair Names Kevin Coskren Chief Meteorologist at KTUL Tulsa
Sinclair Broadcast Group said it named Kevin Coskren chief meteorologist at KTUL, its ABC affiliate in Tulsa, Oklahoma....
25/04/2024
Attend The Business of TV News Event in D.C. on May 2
The Business of TV News, a new one-day event featuring Martha Raddatz, Shannon Bream, Glenn Kirschner and other major figures in television news, happens at Hot...
25/04/2024
Problematic FCC Conditions On Station Sale Could Create Detroit Drama
Conditions put on the proposed sale of WADL Detroit, to Mission Broadcasting have created a potential drama in the Motor City....
25/04/2024
TelevisaUnivision 1Q Loss Widens But DTC Business Expected To Turn Profit in Second Half
TelevisaUnivision reported a $52 million loss in the first quarter, up from $3 m...
25/04/2024
Comcast Earnings Flat As Video, Broadband Sub Losses Continue
Comcast reported flat first-quarter earnings as it reduced the red ink at Peacock but continued to lose video and broadband customers....
25/04/2024
Vevo Brings Music Videos To Telly's Dual Screen TVs
Music-video network Vevo said it launched its app on Telly, the company offering consumers free dual-screen TVs in return for data about what they're watchi...
25/04/2024
Future Today Redesigns Streaming App Interfaces
Future Today said it has introduced a redesigned user interface for about half of its 300 streaming apps, including Fawesome, HappyKids and iFood.TV....
25/04/2024
Deutsche Telekom Powers New MagentaTV Service With Broadp...
Broadpeak , a leading provider of content delivery network (CDN) and video streaming solutions for content providers and pay-TV operators worldwide, announced t...
25/04/2024
Lightware Enhances Microsoft Teams Rooms with Powerful BY...
Lightware Visual Engineering, a leading manufacturer of connectivity solutions for the professional integrated systems market and a pioneer in signal management...
25/04/2024
Net Insight secures collaboration with DMC Production to...
Net Insight has entered into a collaboration with DMC Production that positions Net Insight at the forefront of sports broadcasting in the Nordics. Net Insight ...
25/04/2024
GlobalM and scoopa announce strategic partnership to faci...
GlobalM has announced a strategic partnership with scoopa, the specialists in broadcast-quality content distribution, offering a complementary service for live ...
25/04/2024
DDish TV LLC Chooses PlayBox Neo Channel-in-a-Box for Bro...
PlayBox Neo announces the completion of a new multichannel playout system for the DDish direct-to-home satellite television network in Mongolia. Based in the na...
25/04/2024
Legendary Producer Garth Richardson Chooses PMC Monitors...
Canadian music producer and engineer Garth Richardson also known as Gggarth due to his stutter - has embraced immersive audio by installing a PMC monitoring s...
25/04/2024
Televisa transforms its broadcast ecosystem with proven t...
Leading video software provider Synamedia today announced that Televisa, the Mexican telecommunications and broadcasting company, has chosen Synamedia as its pa...
25/04/2024
OTTera partners with ThinkAnalytics to enhance personaliz...
OTTera, a leading provider of end-to-end OTT and FAST channel solutions, proudly announces its strategic partnership with ThinkAnalytics, a global leader in adv...
25/04/2024
Perfect Weather Forecast for American Tobacco Events Tonight and Saturday
The American Tobacco Campus will be hopping with activity tonight and this weekend with two fun events! Durham Night Market At last! The Durham Night Market i...
25/04/2024
Qurate Launches The Big Dish on The Roku Channel
WEST CHESTER, Pa. Video commerce provider Qurate Retail Group has launched The Big Dish, a new culinary-themed FAST channel on The Roku Channel....
25/04/2024
HPA Opens Submissions for 2024 HPA Engineering Excellence Awards
LOS ANGELES The Hollywood Professional Association has announced that submissions for the 2024 HPA Engineering Excellence Awards are now being accepted. This re...
25/04/2024
DV Earns MRC Accreditation for CTV Viewability
NEW YORK The digital media measurement and analytics firm DoubleVerify has announced that it has received Media Rating Council (MRC) accreditation for Video Vie...
25/04/2024
DAZN FAST Channels to Launch on Tubi
SAN FRANCISCO Fox Corp.'s ad-supported streaming service Tubi has announced a licensing agreement with the sports platform DAZN that will see DAZN Ringside ...
25/04/2024
IAB Makes Three Appointments to Its Leadership Team
NEW YORK In the runup to the 2024 IAB NewFronts, the IAB has announced three key appointments to its leadership team....
25/04/2024
Epic Games releases Unreal Engine 5.4 with new Motion Design Mode, Unreal VCam for Android, and more
Epic Games releases Unreal Engine 5.4 with new Motion Design Mode, Unreal VCam f...
25/04/2024
Content Creation, Production, Distribution Is In a State of Flux
Content Creation, Production, Distribution Is In a State of Flux Andy Marken April 24, 2024 0 Comments My empathy is creeping towards what I would de...
25/04/2024
Capitol Broadcasting Company to Air Carolina Panthers Games on Triangle's Strongest Broadcast Signal
The Carolina Panthers and Capitol Broadcasting Company (CBC) announced they have...
25/04/2024
Berklee Student Riko Sasaski Named 2024 Yamaha Young Performing Artist
Berklee Student Riko Sasaski Named 2024 Yamaha Young Performing Artist The accomplished saxophonist secured a spot among the elite winners of this year's ...
25/04/2024
Local News Close-Up: St. Louis Born and Bred
Stations everywhere take pride in having a main anchor who comes from the market they represent. That applies in St. Louis, too, but it also pertains to general...
25/04/2024
Edward Moody Joins WBTW Myrtle Beach Anchor Team
Edward Moody is joining the WBTW Myrtle Beach, South Carolina, anchor crew, and will anchor the 5, 6 and 11 p.m. newscasts alongside Trish Williford. He comes f...
25/04/2024
MTV Moving VMAs To New UBS Arena in New York
MTV said the 2024 Video Music Awards will return to New York and take place at the new UBS Arena....
25/04/2024
Offbeat Comedy The Outlaws' Returns to Prime Video Next Month
Season three of comedy The Outlaws premieres on Prime Video May 31. Stephen Merchant co-created the show, and stars. There are five episodes....
25/04/2024
Bidders Interested in Buying Bounce, Says Scripps CEO Adam Symson
The E.W. Scripps Co. is evaluating offers for Bounce, its multicast channel for African-American viewers, according to a report from CNBC....
25/04/2024
Paramount Plus Renews Dora'
Paramount Plus has ordered a second season for Dora, the animated preschool show based on Dora the Explorer. The show, featuring Dora on a rainforest adventure ...
25/04/2024
Tribeca Festival 2024 Announces Audio Storytelling and Games Lineup
April 25th, 2024 Press Materials Available Here TRIBECA FESTIVAL 2024 ANNOUNCES AUDIO STORYTELLING AND GAMES LINEUP Audio Storytelling Program Features 10th ...
25/04/2024
NFL Draft 2024: Verizon Expands Broadband Capacity To Handle the Spike in Demand
NFL Draft 2024: Verizon Expands Broadband Capacity To Handle the Spike in Demand Mobile cells will help accommodate first responders, social media, sports betti...
25/04/2024
NFL Draft 2024: NFL Media Teams With The Fantasy Footballers on Hybrid, REMI Production of Post-First-Round Draft Show on NFL+
NFL Draft 2024: NFL Media Teams With The Fantasy Footballers on Hybrid, REMI Pro...
25/04/2024
NFL Draft 2024: ESPN Motors Into Detroit With Trio of Simultaneous Live Presentations
NFL Draft 2024: ESPN Motors Into Detroit With Trio of Simultaneous Live Presenta...
25/04/2024
Let the Pleasure Begin: Doctor Climax' and Its Steamy Q&A Column Debut June 13
Back to All News Let the Pleasure Begin: Doctor Climax' and Its Steamy Q&A...
25/04/2024
Netflix Joins 'The Thursday Murder Club'
Back to All News Netflix Joins The Thursday Murder Club Entertainment 25 April 2024 Global Link copied to clipboard Writer, Director: Chris Columbus Prod...
25/04/2024
Into the Omniverse: Unlocking the Future of Manufacturing With OpenUSD on Siemens Teamcenter X
Editor's note: This post is part of Into the Omniverse, a series focused on ...
25/04/2024
Blast From the Past: Stream StarCraft' and Diablo' on GeForce NOW
Support for Battle.net on GeForce NOW expands this GFN Thursday, as titles from the iconic StarCraft and Diablo series come to the cloud. StarCraft Remastered,...
24/04/2024
Mundo Hispano Digital Launches MundoNow Connect
ATLANTA Mundo Hispano Digital has launched a new advertising product, MundoNow Connect, that is designed to help advertisers reach Hispanic audiences on connect...
24/04/2024
Epic Games Releases Unreal Engine 5.4
Epic Games has released a major new version of Unreal Engine, which has become a mainstay in virtual production, that includes new features and improvements to ...
24/04/2024
NAB Show Welcomes Creators to Las Vegas
The National Association of Broadcasters welcomed the industry to its annual extravaganza last month in Las Vegas. The sights and sounds were similar to previou...
24/04/2024
Chptr, Gray Television Launch on Video Obituary Platform
NEW YORK Chptr and Gray Television have announced that they are introducing a new video solution for funeral homes and communities that will allow funeral direc...