Sony Pixel Power calrec Sony

Oracle Cloud Infrastructure Expands NVIDIA GPU-Accelerated Instances for AI, Digital Twins and More

31/07/2024

Enterprises are rapidly adopting generative AI, large language models (LLMs), advanced graphics and digital twins to increase operational efficiencies, reduce costs and drive innovation.

However, to adopt these technologies effectively, enterprises need access to state-of-the-art, full-stack accelerated computing platforms. To meet this demand, Oracle Cloud Infrastructure (OCI) today announced NVIDIA L40S GPU bare-metal instances available to order and the upcoming availability of a new virtual machine accelerated by a single NVIDIA H100 Tensor Core GPU. This new VM expands OCI's existing H100 portfolio, which includes an NVIDIA HGX H100 8-GPU bare-metal instance.

Paired with NVIDIA networking and running the NVIDIA software stack, these platforms deliver powerful performance and efficiency, enabling enterprises to advance generative AI.

NVIDIA L40S Now Available to Order on OCI The NVIDIA L40S is a universal data center GPU designed to deliver breakthrough multi-workload acceleration for generative AI, graphics and video applications. Equipped with fourth-generation Tensor Cores and support for the FP8 data format, the L40S GPU excels in training and fine-tuning small- to mid-size LLMs and in inference across a wide range of generative AI use cases.

For example, a single L40S GPU (FP8) can generate up to 1.4x more tokens per second than a single NVIDIA A100 Tensor Core GPU (FP16) for Llama 3 8B with NVIDIA TensorRT-LLM at an input and output sequence length of 128.

The L40S GPU also has best-in-class graphics and media acceleration. Its third-generation NVIDIA Ray Tracing Cores (RT Cores) and multiple encode/decode engines make it ideal for advanced visualization and digital twin applications.

The L40S GPU delivers up to 3.8x the real-time ray-tracing performance of its predecessor, and supports NVIDIA DLSS 3 for faster rendering and smoother frame rates. This makes the GPU ideal for developing applications on the NVIDIA Omniverse platform, enabling real-time, photorealistic 3D simulations and AI-enabled digital twins. With Omniverse on the L40S GPU, enterprises can develop advanced 3D applications and workflows for industrial digitalization that will allow them to design, simulate and optimize products, processes and facilities in real time before going into production.

OCI will offer the L40S GPU in its BM.GPU.L40S.4 bare-metal compute shape, featuring four NVIDIA L40S GPUs, each with 48GB of GDDR6 memory. This shape includes local NVMe drives with 7.38TB capacity, 4th Generation Intel Xeon CPUs with 112 cores and 1TB of system memory.

These shapes eliminate the overhead of any virtualization for high-throughput and latency-sensitive AI or machine learning workloads with OCI's bare-metal compute architecture. The accelerated compute shape features the NVIDIA BlueField-3 DPU for improved server efficiency, offloading data center tasks from CPUs to accelerate networking, storage and security workloads. The use of BlueField-3 DPUs furthers OCI's strategy of off-box virtualization across its entire fleet.

OCI Supercluster with NVIDIA L40S enables ultra-high performance with 800Gbps of internode bandwidth and low latency for up to 3,840 GPUs. OCI's cluster network uses NVIDIA ConnectX-7 NICs over RoCE v2 to support high-throughput and latency-sensitive workloads, including AI training.

We chose OCI AI infrastructure with bare-metal instances and NVIDIA L40S GPUs for 30% more efficient video encoding, said Sharon Carmel, CEO of Beamr Cloud. Videos processed with Beamr Cloud on OCI will have up to 50% reduced storage and network bandwidth consumption, speeding up file transfers by 2x and increasing productivity for end users. Beamr will provide OCI customers video AI workflows, preparing them for the future of video.

Single-GPU H100 VMs Coming Soon on OCI The VM.GPU.H100.1 compute virtual machine shape, accelerated by a single NVIDIA H100 Tensor Core GPU, is coming soon to OCI. This will provide cost-effective, on-demand access for enterprises looking to use the power of NVIDIA H100 GPUs for their generative AI and HPC workloads.

A single H100 provides a good platform for smaller workloads and LLM inference. For example, one H100 GPU can generate more than 27,000 tokens per second for Llama 3 8B (up to 4x more throughput than a single A100 GPU at FP16 precision) with NVIDIA TensorRT-LLM at an input and output sequence length of 128 and FP8 precision.

The VM.GPU.H100.1 shape includes 2 3.4TB of NVMe drive capacity, 13 cores of 4th Gen Intel Xeon processors and 246GB of system memory, making it well-suited for a range of AI tasks.

Oracle Cloud's bare-metal compute with NVIDIA H100 and A100 GPUs, low-latency Supercluster and high-performance storage delivers up to 20% better price-performance for Altair's computational fluid dynamics and structural mechanics solvers, said Yeshwant Mummaneni, chief engineer of data management analytics at Altair. We look forward to leveraging these GPUs with virtual machines for the Altair Unlimited virtual appliance.

GH200 Bare-Metal Instances Available for Validation OCI has also made available the BM.GPU.GH200 compute shape for customer testing. It features the NVIDIA Grace Hopper Superchip and NVLink-C2C, a high-bandwidth, cache-coherent 900GB/s connection between the NVIDIA Grace CPU and NVIDIA Hopper GPU. This provides over 600GB of accessible memory, enabling up to 10x higher performance for applications running terabytes of data compared to the NVIDIA A100 GPU.

Optimized Software for Enterprise AI Enterprises have a wide variety of NVIDIA GPUs to accelerate their AI, HPC and data analytics workloads on OCI. However, maximizing the full potential of these GPU-accelerated compute instances requires an optimized software layer.

NVIDIA NIM, part of the NVIDIA AI Enterprise software platform available on the OC
LINK: https://blogs.nvidia.com/blog/oracle-cloud-infrastructure-ai-gpu-digit...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

14/11/2026

Marcelo Dai's Live Session Captured with URSA Cine Immersive

Marcelo Dai's Live Session Captured with URSA Cine Immersive Brie Clayton November 14, 2026 0 Comments Artist takes viewers on an immersive journe...

14/11/2026

Political Ads Spiked a Week Before Midterm Elections, Nielsen Says

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

14/11/2026

FCC Sends 2027 Upper C-Band Auction Plan Into Motion

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

14/11/2026

ZEISS Showcases Latest Cine Lenses at TorunCAMERIMAGE 202...

Newest Lenses, Horizon Anamorphic Seminar & Guided Lens Character Experience Highlight Creative Possibilities At the 2026 Toru CAMERIMAGE Film Festival, ZEISS...

14/11/2026

Sonnet Announces Black Friday Sale on Select Products

Sonnet Announces Black Friday Sale on Select Products Brie Clayton November 14, 2026 0 Comments WHAT: Sonnet Technologies is having a sale on a select...

14/11/2026

Berklee Alumni Shine at the 2026 Latin Grammy Awards

Berklee Alumni Shine at the 2026 Latin Grammy Awards This year's winners included songwriters, engineers, and performers who contributed to acclaimed reco...

13/11/2026

E1 Series Brings Its Remote-First Broadcast Model to Miami for Season Finale

The UIM E1 Series wraps its third season this week with the Bombay Sapphire E1 Miami GP, Nov. 11-14, on Biscayne Bay at the Miami Seaplane Base on Watson Island...

13/11/2026

SVG GameDay, Ep. 39: Carolina Hurricanes Christine Williams & Jason Danby - Celebrating a Stanley Cup in Raleigh

In-venue and creative video staffers at the professional and collegiate level ha...

13/11/2026

Benson Boone to Headline Entertainment at Discover NHL Winter Classic

Singer-songwriter Benson Boone will headline entertainment for the Discover NHL Winter Classic between the Utah Mammoth and Colorado Avalanche at Rice-Eccles St...

13/11/2026

Blackmagic Design Announces Ambisonic Microphone for Immersive Spatial Audio

Blackmagic Design has announced the Blackmagic Ambisonic Microphone, a 7th order ambisonic microphone array that captures spatial audio for immersive video prod...

13/11/2026

The Studio B&H and Riedel to Power SMPTE MTS Solutions Hub

SMPTE has announced that The Studio B&H and Riedel Communications will provide the video infrastructure and communications technology for the Solutions Hub at t...

13/11/2026

HPA Sets 2027 Tech Retreat Theme Around a Changing Industry

The Hollywood Professional Association (HPA) has announced the theme and program focus for the 2027 HPA Tech Retreat, which takes place Feb. 14-18, 2027, in La ...

13/11/2026

Football Manager 27 Touch Joins Apple Arcade, with Plants vs. Zombies, Prince of Persia Added Dec. 3

Football Manager 27 Touch is available on Apple Arcade starting today. The game ...

13/11/2026

MotoGP and ESPN Announce Two-Year Media Rights Agreement for U.S. and Latin America

MotoGP has announced a two-year media rights agreement with ESPN covering the Un...

13/11/2026

Apple Sports Adds UFC Ahead of UFC 334

Apple Sports, the free iPhone app, has added the Ultimate Fighting Championship (UFC) to its lineup of supported sports, in time for Saturday's UFC 334. The...

13/11/2026

NBA Names Fanatics Studios Multiyear Creative and Event Production Partner for NBA All-Star

The NBA and Fanatics Studios, the joint venture between Fanatics and entertainme...

13/11/2026

From ManningCast to McAfee to Star Wars: ESPN, Disney Pull Back the Curtain on Super Bowl LXI Plans

ESPN held its annual EDGE Innovation Conference last night and offered up an ove...

13/11/2026

Battle in the Bronx: YES Network Presents 2026 Cortaca Jug at Yankee Stadium

Regional sports network gives Ithaca College, SUNY Cortland students a platform to thrive One of the biggest games in Division III college football will be pla...

13/11/2026

HLabs reveal the CL089

Studer-inspired 500-series PWM compressor unveiled The HLabs range already includes a couple of Studer-inspired offerings in the form of the PRE169 and EQ16...

13/11/2026

Freedom of Choice White Paper

Download Now! To view the white paper, please enter the following details: -- First Name* First Name Company* Country* Please select your countryA...

13/11/2026

Cruz Schedules Confirmation Vote for FCC Nominee Thumann-Severs

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Yamaha Acquires Virtual Production Specialist Disguise

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

MyStation App Emulates TV Network' Marketplace

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Blue Lucy integrates with Comcast Technology Solutions Vi...

Blue Lucy, the workflow orchestration and integration platform for broadcasters, rights owners and localisation companies, today announced an integration with c...

13/11/2026

Krotos announces Black Friday offers on Studio Pro and Studio Max

Krotos announces Black Friday offers on Studio Pro and Studio Max Brie Clayton November 12, 2026 0 Comments First-year annual plans start at US$195.99...

13/11/2026

Blackmagic Design Announces Blackmagic Ambisonic Microphone

Blackmagic Design Announces Blackmagic Ambisonic Microphone Brie Clayton November 12, 2026 0 Comments New 7th order ambisonic microphone with 108 MEMS...

13/11/2026

Meet the Berklee Student Setting Planetary Motion to Music

Meet the Berklee Student Setting Planetary Motion to Music With his compositional platform SoniKosmos, Javier Roqueni aims to make the universe the ultimate i...

13/11/2026

Hub: Despite AI, More Viewers Still Rely on Word of Mouth and Trailers to Find New TV Shows

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , er...

13/11/2026

Jack Smith Joins Madhive as Chief Product and Technology Officer

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Operative Names Brian Beirne as Senior VP, Commercial Growth

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Former FCC Chair Tom Wheeler to Advise AI Startup

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

IEEE Broadcast Technology Society Honors Dr. Yiyan Wu with the 2026 Jules Cohen Award

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , er...

13/11/2026

Vizrt Acquires Chyron

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Samsung Ads to Offer 3 New Interactive Formats

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

HPA Retreat to Explore Changing Shape of Industry

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

The Studio B&H, Riedel to Equip SMPTE Media Tech Summit

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Tegna Promotes 3 Sales Executives to President and GM

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Amagi and Golden Times Media Technology to Bring Chinese...

Amagi, the media industry cloud company, today announced a partnership with Golden Times Media Technology (stock code 920021.BJ), a Beijing-based media and tech...

13/11/2026

CGI and Cedar Broadcast and Communications deploy advance...

CGI (TSX: GIB.A) (NYSE: GIB), one of the largest independent IT and business consulting services firms in the world, together with its Malaysian partner, Cedar ...

13/11/2026

The Studio BH and Riedel Communications Power the SMPTE...

SMPTE, the home for media professionals, technologists and engineers, today announced that The Studio B&H and Riedel Communications will provide the video infra...

13/11/2026

iWedia Brings Software-First DRAM Optimization to Android...

iWedia, a global leader in connected TV software solutions, will present its software-first approach to DRAM optimization at Android TV APAC Summit 2026 in Bang...

13/11/2026

Apple HomeView available today - UPDATE - Posted on 13 November 2026

Beginning today, November 13, Apple HomeView is available for purchase at Apple Store locations, on the Apple Store online, and in the Apple Store app in select...

13/11/2026

How AI Is Helping Care Teams Get Patients the Right Care, Sooner

From pediatric research to smart hospitals, AI is helping care teams spend less time on routine tasks and more time with patients. Health systems and startups...

12/11/2026

The Software-Defined Shift: A Discussion on the Technologies Reshaping Live Sports Production

Industry leaders examine how Dynamic Media Facility, Media eXchange Layer, and c...

12/11/2026

SVG Students to Watch: Addison Carnow, University of North Carolina

The junior Tar Heel is embracing the technical and creative challenges of live production while emerging as a leader and mentor in the control room...

12/11/2026

Gracenote Survey: 78% of Viewers 18-24 Want a Single Program Guide Across Streaming Services

Gracenote, Nielsen's content intelligence business, has released its fifth a...

12/11/2026

RTL Deutschland and NHL Expand Partnership, Bringing NHL Monday Night Hockey to Free-to-Air TV in Germany

RTL Deutschland will bring the NHL to free-to-air TV in Germany starting Nov. 30...

12/11/2026

Clear-Com Supports Global Student Broadcast On Air 2026 With Station-IC, Eclipse HX and FreeSpeak Cell

Clear-Com supported On Air 2026, a 24-hour student-led broadcast connecting 45 u...