Sony Pixel Power calrec Sony

Oracle Cloud Infrastructure Expands NVIDIA GPU-Accelerated Instances for AI, Digital Twins and More

31/07/2024

Enterprises are rapidly adopting generative AI, large language models (LLMs), advanced graphics and digital twins to increase operational efficiencies, reduce costs and drive innovation.

However, to adopt these technologies effectively, enterprises need access to state-of-the-art, full-stack accelerated computing platforms. To meet this demand, Oracle Cloud Infrastructure (OCI) today announced NVIDIA L40S GPU bare-metal instances available to order and the upcoming availability of a new virtual machine accelerated by a single NVIDIA H100 Tensor Core GPU. This new VM expands OCI's existing H100 portfolio, which includes an NVIDIA HGX H100 8-GPU bare-metal instance.

Paired with NVIDIA networking and running the NVIDIA software stack, these platforms deliver powerful performance and efficiency, enabling enterprises to advance generative AI.

NVIDIA L40S Now Available to Order on OCI The NVIDIA L40S is a universal data center GPU designed to deliver breakthrough multi-workload acceleration for generative AI, graphics and video applications. Equipped with fourth-generation Tensor Cores and support for the FP8 data format, the L40S GPU excels in training and fine-tuning small- to mid-size LLMs and in inference across a wide range of generative AI use cases.

For example, a single L40S GPU (FP8) can generate up to 1.4x more tokens per second than a single NVIDIA A100 Tensor Core GPU (FP16) for Llama 3 8B with NVIDIA TensorRT-LLM at an input and output sequence length of 128.

The L40S GPU also has best-in-class graphics and media acceleration. Its third-generation NVIDIA Ray Tracing Cores (RT Cores) and multiple encode/decode engines make it ideal for advanced visualization and digital twin applications.

The L40S GPU delivers up to 3.8x the real-time ray-tracing performance of its predecessor, and supports NVIDIA DLSS 3 for faster rendering and smoother frame rates. This makes the GPU ideal for developing applications on the NVIDIA Omniverse platform, enabling real-time, photorealistic 3D simulations and AI-enabled digital twins. With Omniverse on the L40S GPU, enterprises can develop advanced 3D applications and workflows for industrial digitalization that will allow them to design, simulate and optimize products, processes and facilities in real time before going into production.

OCI will offer the L40S GPU in its BM.GPU.L40S.4 bare-metal compute shape, featuring four NVIDIA L40S GPUs, each with 48GB of GDDR6 memory. This shape includes local NVMe drives with 7.38TB capacity, 4th Generation Intel Xeon CPUs with 112 cores and 1TB of system memory.

These shapes eliminate the overhead of any virtualization for high-throughput and latency-sensitive AI or machine learning workloads with OCI's bare-metal compute architecture. The accelerated compute shape features the NVIDIA BlueField-3 DPU for improved server efficiency, offloading data center tasks from CPUs to accelerate networking, storage and security workloads. The use of BlueField-3 DPUs furthers OCI's strategy of off-box virtualization across its entire fleet.

OCI Supercluster with NVIDIA L40S enables ultra-high performance with 800Gbps of internode bandwidth and low latency for up to 3,840 GPUs. OCI's cluster network uses NVIDIA ConnectX-7 NICs over RoCE v2 to support high-throughput and latency-sensitive workloads, including AI training.

We chose OCI AI infrastructure with bare-metal instances and NVIDIA L40S GPUs for 30% more efficient video encoding, said Sharon Carmel, CEO of Beamr Cloud. Videos processed with Beamr Cloud on OCI will have up to 50% reduced storage and network bandwidth consumption, speeding up file transfers by 2x and increasing productivity for end users. Beamr will provide OCI customers video AI workflows, preparing them for the future of video.

Single-GPU H100 VMs Coming Soon on OCI The VM.GPU.H100.1 compute virtual machine shape, accelerated by a single NVIDIA H100 Tensor Core GPU, is coming soon to OCI. This will provide cost-effective, on-demand access for enterprises looking to use the power of NVIDIA H100 GPUs for their generative AI and HPC workloads.

A single H100 provides a good platform for smaller workloads and LLM inference. For example, one H100 GPU can generate more than 27,000 tokens per second for Llama 3 8B (up to 4x more throughput than a single A100 GPU at FP16 precision) with NVIDIA TensorRT-LLM at an input and output sequence length of 128 and FP8 precision.

The VM.GPU.H100.1 shape includes 2 3.4TB of NVMe drive capacity, 13 cores of 4th Gen Intel Xeon processors and 246GB of system memory, making it well-suited for a range of AI tasks.

Oracle Cloud's bare-metal compute with NVIDIA H100 and A100 GPUs, low-latency Supercluster and high-performance storage delivers up to 20% better price-performance for Altair's computational fluid dynamics and structural mechanics solvers, said Yeshwant Mummaneni, chief engineer of data management analytics at Altair. We look forward to leveraging these GPUs with virtual machines for the Altair Unlimited virtual appliance.

GH200 Bare-Metal Instances Available for Validation OCI has also made available the BM.GPU.GH200 compute shape for customer testing. It features the NVIDIA Grace Hopper Superchip and NVLink-C2C, a high-bandwidth, cache-coherent 900GB/s connection between the NVIDIA Grace CPU and NVIDIA Hopper GPU. This provides over 600GB of accessible memory, enabling up to 10x higher performance for applications running terabytes of data compared to the NVIDIA A100 GPU.

Optimized Software for Enterprise AI Enterprises have a wide variety of NVIDIA GPUs to accelerate their AI, HPC and data analytics workloads on OCI. However, maximizing the full potential of these GPU-accelerated compute instances requires an optimized software layer.

NVIDIA NIM, part of the NVIDIA AI Enterprise software platform available on the OC
LINK: https://blogs.nvidia.com/blog/oracle-cloud-infrastructure-ai-gpu-digit...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

14/04/2026

Sinclair's WTOV Taps Brightline for Lighting Upgrade

Share Copy link Facebook X Linkedin Bluesky Email...

14/04/2026

Grass Valley Showcases Alliance Ecosystem at 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

14/04/2026

FCC Selects New Lead Administrator for U.S. Cyber Trust Mark Program

Share Copy link Facebook X Linkedin Bluesky Email...

14/04/2026

Gray Media Names Jim Hays GM of WTHI

Share Copy link Facebook X Linkedin Bluesky Email...

14/04/2026

NAB Blasts CTA in FCC Sports Probe Comments

Share Copy link Facebook X Linkedin Bluesky Email...

14/04/2026

Wowza to Showcase AI-Powered Video Workflows and Emerging...

Wowza will return to NAB Show 2026 with a set of live demonstrations focused on how video infrastructure is evolving for a new generation of AI-powered and oper...

14/04/2026

Stegawave Debuts Real-Time Forensic Watermarking to Tackle Piracy in Live Sports Streaming

Stegawave Debuts Real-Time Forensic Watermarking to Tackle Piracy in Live Sports...

14/04/2026

Living in Boston: A Guide for Incoming Boston Conservatory Students

Living in Boston: A Guide for Incoming Boston Conservatory Students From navigating the T to balancing school with professional gigs, a current student shar...

14/04/2026

Just What Is Genre These Days, Anyway?

Just What Is Genre These Days, Anyway? Understanding the business and art of genre-bending in 2026. April 10, 2026 By Bryan Parys Illustration by Jack Fla...

14/04/2026

Lenora Helm Hammonds Is Turning Passion Into Plan A

Lenora Helm Hammonds Is Turning Passion Into Plan A The dean of the Professional Education Division has seen the industry from all sides. Now shes bringing it...

14/04/2026

How Michelle Zalabak Found Her Dream Career in Music and Finance

How Michelle Zalabak Found Her Dream Career in Music and Finance The Warner Music Group deal analysis manager helps determine what artist catalogs are worth a...

13/04/2026

ToolsOnAir Composition Builder 2026 Boilerplate

ToolsOnAir Composition Builder 2026 Boilerplate More Details: The Composition Builder 2026 application for macOS enables TV stations and Live Event broadcast...

13/04/2026

ToolsOnAr just:live pro 2026 Boilerplate

ToolsOnAr just:live pro 2026 Boilerplate More Details: just:live pro 2026 is a Multi-Channel Live Production Playout solution for video and static or real-ti...

13/04/2026

ToolsOnAr just:play pro 2026 Boilerplate

ToolsOnAr just:play pro 2026 Boilerplate More Details: just:play pro 2026 is a Multi-Channel automated 24/7 Master Control playout solution with SD, HD and U...

13/04/2026

ToolsOnAr live:cut 2026 Boilerplate

ToolsOnAr live:cut 2026 Boilerplate More Details: live:cut is an option to just:in mac pro 2025 and enables multicamera production workflows for up to 16 cam...

13/04/2026

ToolsOnAir Just In Mac Lite NDI 2026 Boilerplate

ToolsOnAir Just In Mac Lite NDI 2026 Boilerplate More Details: The Just In Mac Lite NDI application is a streamlined media capture solution designed specific...

13/04/2026

ToolsOnAir Just In Mac Lite 2026 Boilerplate

ToolsOnAir Just In Mac Lite 2026 Boilerplate More Details: The Just In Mac Lite application is a streamlined media capture solution designed specifically for...

13/04/2026

ToolsOnAir just:in mac pro 2026 Boilerplate

ToolsOnAir just:in mac pro 2026 Boilerplate More Details: just:in mac pro is a macOS-based client-server multichannel capture solution to record SDI, HDMI, N...

13/04/2026

Jnger Audio Joins EBU ADM Implementers Group as Founding Member

Telos Alliance has announced that J nger Audio has joined the EBU ADM Implementers Group (ADM-IG) as a founding member. The group is focused on advancing ADM an...

13/04/2026

NAB 2026: Grass Valley to Showcase Alliance Partner Ecosystem

Grass Valley will demonstrate its Alliance Partner ecosystem at NAB Show 2026 (Booth C2408, Central Hall, April 19-22), showing AMPP integrations across live pr...

13/04/2026

NAB 2026: Media Links to Demonstrate IP Transport Solutions

Media Links will exhibit at NAB Show 2026 (Booth W2033), demonstrating IP transport solutions for live production including hitless protection technology, Xscen...

13/04/2026

NBC Sports Partners with Overtime for OT7 Football League and Navy All-American Bowl

NBC Sports has announced a programming, distribution, and sales partnership with...

13/04/2026

FloSports Promotes Jayar Donlan from COO to President

FloSports has promoted Chief Operating Officer Jayar Donlan to President, effective immediately. In his new role, Donlan will lead the company's commercial,...

13/04/2026

MASV Case Study: PanCam Pictures Uses MASV for Remote Post-Production at Senior Bowl 2026

PanCam Pictures, the documentary production company founded by Paul Camarata, us...

13/04/2026

NAB 2026: Mimir to Showcase Cloud Production Platform

Mimir will exhibit at NAB Show 2026 (North Hall, Booth N2850), demonstrating its cloud-native media production platform with new capabilities including Mimir Cu...

13/04/2026

NAB 2026: BBright Adds RIST Protocol Support to IP Gateway

BBright has announced that its IP Gateway now supports the Reliable Internet Stream Transport (RIST) protocol. The addition will be introduced at NAB Show 2026 ...

13/04/2026

Net Insight Awarded ESA NAVISP Development Project for PNT Technology

Net Insight has been awarded a development project through the European Space Agency's Navigation Innovation and Support Program (NAVISP), with co-funding f...

13/04/2026

NAB 2026: intoPIX to Showcase JPEG XS, IPMX, and SMPTE 2110 Solutions

intoPIX will exhibit at NAB Show 2026, marking the company's 20th anniversary. The company will demonstrate its JPEG XS compression portfolio and IPMX-appro...

13/04/2026

Inside the Launch of BravesVision: How Braves, Raycom Sports Pulled Off One of the Most Ambitious Efforts in Regional-Sports-Media History

Starting from scratch, the team built an in-house content platform comprising ga...

13/04/2026

NAB 2026: AI Will Make Its Presence Felt in Audio Offerings, Presentations

Here's a look at some of the new products and updates, along with audio-centric conferences, that attendees will find next week at the show When the 2026 N...

13/04/2026

NAB 2026: Avid to Demonstrate Integrated Newsroom Capabilities

Avid will launch new integrated newsroom capabilities for Avid for News at NAB Show 2026 (Booth N2226, April 18-22), demonstrating how Avid Content Core connect...

13/04/2026

NAB 2026: Synamedia Launches Cloud-Controlled Edge Playout Version of Quortex PowerVu

Synamedia has announced a new version of Quortex PowerVu, an IP-native, software...

13/04/2026

NAB 2026: Mediaproxy Adds AI Brand and Advertisement Tracking to LogServer

Mediaproxy has developed a suite of AI-powered tools for brand and advertisement tracking, integrated into its LogServer compliance logging and analysis platfor...

13/04/2026

NAB 2026: Disguise to Demonstrate Media Server and Software Integrations

Disguise will demonstrate its media servers and software at NAB Show 2026, appearing across five partner booths in Central Hall: MRMC, B&H, Planar, CarbonBlack,...

13/04/2026

NAB 2026: OpenDrives Introduces Edge Hybrid Cloud-Edge Performance Accelerator

OpenDrives is introducing OpenDrives Edge at NAB Show 2026, a hybrid cloud-edge performance accelerator for distributed video and rich media workflows. The prod...

13/04/2026

ESPN Returns to The Shed for 2026 WNBA Draft, Expanding Camera Arsenal and Deepening Fan Coverage

The show will deploy 18 cameras across two sets and the draft floor, including a...

13/04/2026

Musik Hack update SweetEQ

Intuitive EQ plug-in gets an upgrade Following its official launch back in February 2026, Musik Hack's intuitive EQ plug-in has been treated to its firs...

13/04/2026

Vintage Vault 5 from UVI

Flagship soft synth collection expanded The latest version of UVI's flagship vintage-inspired soft synth collection has just arrived, expanding the suit...

13/04/2026

Sonuscore launch Lux Orchestral Strings Elements

Free version of innovative string library arrives Released in October 2025, Lux Orchestral Strings was said to be Sonuscore's most ambitious library to ...

13/04/2026

Girls' Research Camp at SGL Carbon in Meitingen inspires young women to pursue STEM careers

The Girls' Research Camp is part of the Technology - Future in Bavaria edu...

13/04/2026

Rohde & Schwarz transforms submarine communications for realtime underwater dominance at UDT 2026

Rohde & Schwarz transforms submarine communications for real time underwater dom...

13/04/2026

Rohde & Schwarz enables Pulsar signal simulation to support next-generation navigation devices

Rohde & Schwarz enables Pulsar signal simulation to support next-generation navi...

13/04/2026

When Missiles Move at 5X the Speed of Sound, Timing Is Everything

L3Harris is accelerating the development of infrared payloads for Space Development Agency's Tranche 2 Tracking Layer, to help meet urgent national defense ...

13/04/2026

US Army Selects L3Harris for Next-Generation Night-Vision System

By leveraging cutting-edge unfilmed Gen III image intensifier technology, NOVA delivers unmatched clarity, range, and reliability in low-light environments - en...