Sony Pixel Power calrec Sony

Oracle Cloud Infrastructure Expands NVIDIA GPU-Accelerated Instances for AI, Digital Twins and More

31/07/2024

Enterprises are rapidly adopting generative AI, large language models (LLMs), advanced graphics and digital twins to increase operational efficiencies, reduce costs and drive innovation.

However, to adopt these technologies effectively, enterprises need access to state-of-the-art, full-stack accelerated computing platforms. To meet this demand, Oracle Cloud Infrastructure (OCI) today announced NVIDIA L40S GPU bare-metal instances available to order and the upcoming availability of a new virtual machine accelerated by a single NVIDIA H100 Tensor Core GPU. This new VM expands OCI's existing H100 portfolio, which includes an NVIDIA HGX H100 8-GPU bare-metal instance.

Paired with NVIDIA networking and running the NVIDIA software stack, these platforms deliver powerful performance and efficiency, enabling enterprises to advance generative AI.

NVIDIA L40S Now Available to Order on OCI The NVIDIA L40S is a universal data center GPU designed to deliver breakthrough multi-workload acceleration for generative AI, graphics and video applications. Equipped with fourth-generation Tensor Cores and support for the FP8 data format, the L40S GPU excels in training and fine-tuning small- to mid-size LLMs and in inference across a wide range of generative AI use cases.

For example, a single L40S GPU (FP8) can generate up to 1.4x more tokens per second than a single NVIDIA A100 Tensor Core GPU (FP16) for Llama 3 8B with NVIDIA TensorRT-LLM at an input and output sequence length of 128.

The L40S GPU also has best-in-class graphics and media acceleration. Its third-generation NVIDIA Ray Tracing Cores (RT Cores) and multiple encode/decode engines make it ideal for advanced visualization and digital twin applications.

The L40S GPU delivers up to 3.8x the real-time ray-tracing performance of its predecessor, and supports NVIDIA DLSS 3 for faster rendering and smoother frame rates. This makes the GPU ideal for developing applications on the NVIDIA Omniverse platform, enabling real-time, photorealistic 3D simulations and AI-enabled digital twins. With Omniverse on the L40S GPU, enterprises can develop advanced 3D applications and workflows for industrial digitalization that will allow them to design, simulate and optimize products, processes and facilities in real time before going into production.

OCI will offer the L40S GPU in its BM.GPU.L40S.4 bare-metal compute shape, featuring four NVIDIA L40S GPUs, each with 48GB of GDDR6 memory. This shape includes local NVMe drives with 7.38TB capacity, 4th Generation Intel Xeon CPUs with 112 cores and 1TB of system memory.

These shapes eliminate the overhead of any virtualization for high-throughput and latency-sensitive AI or machine learning workloads with OCI's bare-metal compute architecture. The accelerated compute shape features the NVIDIA BlueField-3 DPU for improved server efficiency, offloading data center tasks from CPUs to accelerate networking, storage and security workloads. The use of BlueField-3 DPUs furthers OCI's strategy of off-box virtualization across its entire fleet.

OCI Supercluster with NVIDIA L40S enables ultra-high performance with 800Gbps of internode bandwidth and low latency for up to 3,840 GPUs. OCI's cluster network uses NVIDIA ConnectX-7 NICs over RoCE v2 to support high-throughput and latency-sensitive workloads, including AI training.

We chose OCI AI infrastructure with bare-metal instances and NVIDIA L40S GPUs for 30% more efficient video encoding, said Sharon Carmel, CEO of Beamr Cloud. Videos processed with Beamr Cloud on OCI will have up to 50% reduced storage and network bandwidth consumption, speeding up file transfers by 2x and increasing productivity for end users. Beamr will provide OCI customers video AI workflows, preparing them for the future of video.

Single-GPU H100 VMs Coming Soon on OCI The VM.GPU.H100.1 compute virtual machine shape, accelerated by a single NVIDIA H100 Tensor Core GPU, is coming soon to OCI. This will provide cost-effective, on-demand access for enterprises looking to use the power of NVIDIA H100 GPUs for their generative AI and HPC workloads.

A single H100 provides a good platform for smaller workloads and LLM inference. For example, one H100 GPU can generate more than 27,000 tokens per second for Llama 3 8B (up to 4x more throughput than a single A100 GPU at FP16 precision) with NVIDIA TensorRT-LLM at an input and output sequence length of 128 and FP8 precision.

The VM.GPU.H100.1 shape includes 2 3.4TB of NVMe drive capacity, 13 cores of 4th Gen Intel Xeon processors and 246GB of system memory, making it well-suited for a range of AI tasks.

Oracle Cloud's bare-metal compute with NVIDIA H100 and A100 GPUs, low-latency Supercluster and high-performance storage delivers up to 20% better price-performance for Altair's computational fluid dynamics and structural mechanics solvers, said Yeshwant Mummaneni, chief engineer of data management analytics at Altair. We look forward to leveraging these GPUs with virtual machines for the Altair Unlimited virtual appliance.

GH200 Bare-Metal Instances Available for Validation OCI has also made available the BM.GPU.GH200 compute shape for customer testing. It features the NVIDIA Grace Hopper Superchip and NVLink-C2C, a high-bandwidth, cache-coherent 900GB/s connection between the NVIDIA Grace CPU and NVIDIA Hopper GPU. This provides over 600GB of accessible memory, enabling up to 10x higher performance for applications running terabytes of data compared to the NVIDIA A100 GPU.

Optimized Software for Enterprise AI Enterprises have a wide variety of NVIDIA GPUs to accelerate their AI, HPC and data analytics workloads on OCI. However, maximizing the full potential of these GPU-accelerated compute instances requires an optimized software layer.

NVIDIA NIM, part of the NVIDIA AI Enterprise software platform available on the OC
LINK: https://blogs.nvidia.com/blog/oracle-cloud-infrastructure-ai-gpu-digit...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

09/04/2026

BIA Increases 2026 Local Ad Forecast to $184.5 Billion

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

Yospace surpasses 10 billion ads stitched in a single mon...

Yospace exceeded 10 billion dynamically stitched ads in a single month, reaching 11.6 billion as ad-supported streaming surged. Driven by a packed global sports...

09/04/2026

Bitmovin Expands Live Encoding and Observability Solution...

Bitmovin has expanded its Live Encoding and Observability solutions to provide true end to end, real time insights across live streaming workflows, from encodin...

09/04/2026

Leyra Powers the Launch of Icelandic Broadcaster RUVs Str...

Leyra has announced the launch of Icelandic public broadcaster R V's streaming service on Samsung and LG Smart TVs. R V is the first public broadcaster to d...

09/04/2026

3Play Media Launches AI Dubbing Solution for YouTube Crea...

3Play Media, a global leader in video accessibility and localization, today announced an AI Dubbing solution purpose-built for YouTube creators. The company, wh...

09/04/2026

Big Blue Marble Recognized as AWS Managed Services Provid...

Big Blue Marble, a provider of broadcast-grade, cloud-native video solutions, has been recognized as an Amazon Web Services (AWS) Managed Services Provider (MSP...

09/04/2026

PDC Cleeng and Urban Zoo partner to launch new global str...

The Professional Darts Corporation (PDC) has officially launched its revamped global streaming service, PDC TV, in collaboration with Cleeng and sports technolo...

09/04/2026

Cleeng launches industry first cross-platform AI agents t...

Cleeng, the Subscriber Retention Management (SRM ) pioneer, today announced a raft of new AI agents for its AI Assistant to accelerate decision-making and autom...

09/04/2026

Hearst Taps Merzigo to Expand Presence on YouTube, Facebook

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

Fox Jumps Into Prediction Markets with Kalshi Integration

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

NAB Show: Kokusai Denki To Feature New, Affordable 4K Broadcast Camera

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

Corus Taps Appear for IP-First Operations

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

2026 NAB Show Exhibitor Insights: Big Blue Marble

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

FCC Extends Audible Crawl Rule Waiver for 18 Months

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

Pliant Technologies Showcases Expanded Accessories at NAB...

New Charging, Connectivity, and Mounting Solutions Now Available LAS VEGAS, APRIL 8, 2026 Pliant Technologies will highlight a range of new accessories at th...

09/04/2026

Media Links Brings Ultra Resilient IP Transport Proven at...

As live production continues its shift to IP, the challenge is no longer adoption it's reliability. At NAB Show 2026 (Booth W2033), Media Links will demon...

09/04/2026

QuickLink Launches StudioPro Town Hall at 2026 NAB Show

QuickLink, a leading provider of award-winning video production and remote guest contribution solutions, launches its new AI-powered add-on for its StudioPro p...

09/04/2026

The Hive Group Releases White Paper on the FCC Upper C-Ba...

The Hive Group has published a new white paper, No Safe Harbor: Why the FCC's Upper C-Band Auction Demands Early Action from Broadcasters ahead of NAB Sho...

09/04/2026

Saranyu Technologies Renews VisualOn Optimizer VoD Subscr...

Saranyu Technologies today announced the renewal of its Optimizer VoD subscription with VisualOn. The announcement coincides with NAB Show 2026, taking place Ap...

09/04/2026

Time for some fresh air: Tracks & Trails is back

Doireann N Ghlac in returns as presenter, with the first episode airing this Friday at 8.30pm on RT One and RT Player The beloved walking series Tracks & T...

09/04/2026

Strength and Destiny Collide: Samson: A Tyndalston Story' Arrives in the Cloud

A timeless story of grit, faith and rebellion takes center stage as Samson: A Ty...

09/04/2026

April 08, 2026

New technique for synthesizing branched molecules could accelerate the development of future medicines Scripps Research chemists solve a longstanding problem in...

08/04/2026

SVG College Sports Media Awards 2026: Entry Deadline is Monday, April 13

The deadline to enter the 18th Annual SVG College Sports Media Awards in association with NACDA is rapidly approaching! Submit your entries to this year's c...

08/04/2026

SVG Campus Shot Callers: Trever Sheets, Senior Director, ACC Network, Virginia Tech

The Pittsburgh product helps lead more than 100 annual ESPN broadcasts as part o...

08/04/2026

SVG Sit-Down: Harmonic's Jean Macher on Turning Live Sports Content Into a Smarter Monetization Engine

Dynamic ad insertion, AI-based technologies, programmatic advertising are some o...

08/04/2026

Announcing the 2026 Fellows for the Sundance Institute Cultural Impact Residency on Sundance Collab

Seven Fellows Selected for Second Year of Residency in Honor of Social Justice L...

08/04/2026

From Tokyo to the World: Watch Bad Bunny's Billions Club Live Concert on Spotify

On March 7, Bad Bunny made history with his first-ever performance in Asia, taki...

08/04/2026

De Tokio para el mundo: Mira el concierto Billions Club Live de Bad Bunny en Spotify

El 7 de marzo, Bad Bunny hizo historia con su primera presentaci n en Asia, subi...

08/04/2026

Tube Lab from Fuse Audio Labs

New channel strip plug-in revealed The latest plug-in to be added to the Fuse Audio Labs line-up emulates a selection of vintage hardware units, combining c...

08/04/2026

Blue Cat Audio release Axiom 2.3

Guitar & bass multi-effects software overhauled Blue Cat Audio's flagship guitar and bass multi-effects software has recently received a significant upd...

08/04/2026

Merging Technologies launch Pyramix 16

PanNoir mixer integration, Dolby Atmos Renderer & more Merging Technologies have just launched Pyramix 16, the latest major update to their renowned DAW sof...

08/04/2026

Updating QUARTZ Router Module Firmware Over-The-Air

Applicable Products Part number Description QUARTZ-22-LTE (EU) Dual Port Dual SIM LTE Router (EU) QUARTZ-COMPACT-11-LTE (EU) Single Port Compact LTE ...

08/04/2026

YEP September 2025 Newsletter (2)

The September 19, 2025 YEP Newsletter highlights a group visit to the Academy Museum of Motion Pictures, where participants explored exhibits showcasing the art...

08/04/2026

Proven On Orbit: L3Harris Congratulates Missile Defense Agency for Receiving Top Defense Honor for HBTSS

The L3Harris HBTSS satellite is proven on orbit, successfully demonstrating trac...

08/04/2026

From Earth to Mars: Resilient Communications Powering the Space Economy

Image Credit: NASA. Artist rendering of a space communications satellite in orbit, representative of the resilient, multiband infrastructure supporting mission ...

08/04/2026

Precision in Practice: Flight Test Confirms Key Air-to-Air Capabilities

Latest evaluation validates image quality, Inertial Navigation System performance and long-range tracking in operational flight conditions....

08/04/2026

Gen Alpha Leads Shift to AI-Powered Entertainment Search, Discovery and Recommendations

New Gracenote study finds behavioral change well underway, but trust in AI-gener...

08/04/2026

Media Links to Focus on IP Transport Solutions at 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Telestream and Mimir Integration Facilitates Real-Time Pr...

Integration eliminates ingest bottlenecks by ensuring content is immediately usable across cloud and hybrid editorial workflows. See it at NAB 2026. Nevada Cit...

08/04/2026

Dalet Announces Commercial Availability of Dalia Bringing...

Dalet, a leading technology and service provider for media-rich organizations, today announced the commercial availability of Dalia, its media-aware, agentic AI...

08/04/2026

Synamedia unveils Senza Ignite to transform deployed devi...

Leading video software provider Synamedia today announced Senza Ignite, a cloud-based platform that transforms existing connected devices through a single firmw...

08/04/2026

Appear works with Corus to transform national news contri...

Modernised architecture increases operational control and agility, while reducing cost and simplifying nationwide media transport across affiliates and news bur...

08/04/2026

LynTec to Showcase High Density Power Control Solutions f...

Company to Feature DMX Dual Relay, High-Density 48-Channel Relay Panels, and New Private Label Power Program LynTec, a leading manufacturer of innovative ele...

08/04/2026

BCE integrates BCNEXXT Vipe to power cloud playout in Med...

Broadcasting Center Europe (BCE), a European media technology and services partner, today announces a technology partnership with BCNEXXT, a Netherlands-based c...