Turning Data Centers into AI Factories': NVIDIA CEO Introduces Hopper Architecture, H100 GPU, New Supercomputers and Software

Promising to transform trillion-dollar industries and address the grand challenges of our time, NVIDIA founder and CEO Jensen Huang Tuesday shared a vision of an era where intelligence is created on an industrial scale and woven into real and virtual worlds.

Kicking off NVIDIA's GTC conference, Huang introduced new silicon - including the new Hopper GPU architecture and new H100 GPU, new AI and accelerated computing software and powerful new data-center-scale systems.

Companies are processing, refining their data, making AI software, becoming intelligence manufacturers, Huang said, speaking from a virtual environment in the NVIDIA Omniverse real-time 3D collaboration and simulation platform as he described how AI is racing in every direction.

And all of it will be brought together by Omniverse to speed collaboration between people and AIs, better model and understand the real world, and serve as a proving ground for new kinds of robots, the next wave of AI.

Huang shared his vision with a gathering that has become one of the world's most important AI conferences, bringing together leading developers, scientists and researchers.

The conference features more 1,600 speakers including from companies such as American Express, DoorDash, LinkedIn, Pinterest, Salesforce, ServiceNow, Snap and Visa, as well as 200,000 registered attendees.

Huang's presentation began with a spectacular flythrough of NVIDIA's new campus, rendered in Omniverse, including buzzing labs working on advanced robotics projects.

He shared how the company's work with the broader ecosystem is saving lives by advancing healthcare and drug discovery, and even helping save our planet.

Scientists predict that a supercomputer a billion times larger than today's is needed to effectively simulate regional climate change, Huang said.

NVIDIA is going to tackle this grand challenge with our Earth-2, the world's first AI digital twin supercomputer, and invent new AI and computing technologies to give us a billion-X before it's too late, he said.

New Silicon - NVIDIA H100: A New Engine of the World's AI Infrastructure To power these ambitious efforts, Huang introduced the NVIDIA H100 built on the Hopper architecture, as the new engine of the world's AI infrastructures.

AI applications like speech, conversation, customer service and recommenders are driving fundamental changes in data center design, he said.

AI data centers process mountains of continuous data to train and refine AI models, Huang said. Raw data comes in, is refined, and intelligence goes out - companies are manufacturing intelligence and operating giant AI factories.

The factory operation is 24/7 and intense, Huang said. Minor improvements in quality drive a significant increase in customer engagement and company profits, Huang explained.

H100 will help these factories move faster. The massive 80 billion transistor chip uses TSMC's 4N process.

Hopper H100 is the biggest generational leap ever - 9x at-scale training performance over A100 and 30x large-language-model inference throughput, Huang said.

Hopper is packed with technical breakthroughs, including a new Transformer Engine to speed up these networks 6x without losing accuracy.

Transformer model training can be reduced from weeks to days Huang said.

H100 is in production, with availability starting in Q3, Huang announced.

Huang also announced the Grace CPU Superchip, NVIDIA's first discrete data center CPU for high-performance computing.

It comprises two CPU chips connected over a 900 gigabytes per second NVLink chip-to-chip interconnect to make a 144-core CPU with 1 terabyte per second of memory bandwidth, Huang explained.

Grace is the ideal CPU for the world's AI infrastructures, Huang said.

Huang also announced new Hopper GPU-based AI supercomputers - DGX H100, H100 DGX POD and DGX SuperPOD.

To connect it all, NVIDIA's new NVLink high-speed interconnect technology will be coming to all future NVIDIA chips - CPUs, GPUs, DPUs and SOCs, Huang said.

He also announced NVIDIA will make NVLink available to customers and partners to build companion chips.

NVLink opens a new world of opportunities for customers to build semi-custom chips and systems that leverage NVIDIA's platforms and ecosystems, Huang said.

New Software - AI Has Fundamentally Changed Software Thanks to acceleration unleashed by accelerated computing, the progress of AI is stunning, Huang declared.

AI has fundamentally changed what software can make and how you make software, Huang said.

Transformers, Huang explained, have opened self-supervised learning and unblocked the need for human-labeled data. As a result, Transformers are being unleashed in a growing array of fields.

Transformers made self-supervised learning possible, and AI jumped to warp speed, Huang said.

Google BERT for language understanding, NVIDIA MegaMolBART for drug discovery, and DeepMind AlphaFold2 are all breakthroughs traced to Transformers, Huang said.

Huang walked through new deep learning models for natural language understanding, physics, creative design, character animation and even - with NVCell - chip layout.

AI is racing in every direction - new architectures, new learning strategies, larger and more robust models, new science, new applications, new industries - all at the same time, Huang said.

NVIDIA is all hands on deck to speed new breakthroughs in AI and speed the adoption of AI and machine learning to every industry, Huang said.

The NVIDIA AI platform is getting major updates, Huang said, including Triton Inference Server, the NeMo Megatron 0.9 framework for training large language models, and the Maxine framework for audio and video quality enhancement.

The platform includes NVIDIA AI Enterprise 2.0, an end-to-end, cloud-native suite of

LINK:	https://blogs.nvidia.com/blog/2022/03/22/ai-factories-hopper-h100-nvid...
	See more stories from nvidia

Most recent headlines