Sony Pixel Power calrec Sony

Oracle Cloud Infrastructure Expands NVIDIA GPU-Accelerated Instances for AI, Digital Twins and More

31/07/2024

Enterprises are rapidly adopting generative AI, large language models (LLMs), advanced graphics and digital twins to increase operational efficiencies, reduce costs and drive innovation.

However, to adopt these technologies effectively, enterprises need access to state-of-the-art, full-stack accelerated computing platforms. To meet this demand, Oracle Cloud Infrastructure (OCI) today announced NVIDIA L40S GPU bare-metal instances available to order and the upcoming availability of a new virtual machine accelerated by a single NVIDIA H100 Tensor Core GPU. This new VM expands OCI's existing H100 portfolio, which includes an NVIDIA HGX H100 8-GPU bare-metal instance.

Paired with NVIDIA networking and running the NVIDIA software stack, these platforms deliver powerful performance and efficiency, enabling enterprises to advance generative AI.

NVIDIA L40S Now Available to Order on OCI The NVIDIA L40S is a universal data center GPU designed to deliver breakthrough multi-workload acceleration for generative AI, graphics and video applications. Equipped with fourth-generation Tensor Cores and support for the FP8 data format, the L40S GPU excels in training and fine-tuning small- to mid-size LLMs and in inference across a wide range of generative AI use cases.

For example, a single L40S GPU (FP8) can generate up to 1.4x more tokens per second than a single NVIDIA A100 Tensor Core GPU (FP16) for Llama 3 8B with NVIDIA TensorRT-LLM at an input and output sequence length of 128.

The L40S GPU also has best-in-class graphics and media acceleration. Its third-generation NVIDIA Ray Tracing Cores (RT Cores) and multiple encode/decode engines make it ideal for advanced visualization and digital twin applications.

The L40S GPU delivers up to 3.8x the real-time ray-tracing performance of its predecessor, and supports NVIDIA DLSS 3 for faster rendering and smoother frame rates. This makes the GPU ideal for developing applications on the NVIDIA Omniverse platform, enabling real-time, photorealistic 3D simulations and AI-enabled digital twins. With Omniverse on the L40S GPU, enterprises can develop advanced 3D applications and workflows for industrial digitalization that will allow them to design, simulate and optimize products, processes and facilities in real time before going into production.

OCI will offer the L40S GPU in its BM.GPU.L40S.4 bare-metal compute shape, featuring four NVIDIA L40S GPUs, each with 48GB of GDDR6 memory. This shape includes local NVMe drives with 7.38TB capacity, 4th Generation Intel Xeon CPUs with 112 cores and 1TB of system memory.

These shapes eliminate the overhead of any virtualization for high-throughput and latency-sensitive AI or machine learning workloads with OCI's bare-metal compute architecture. The accelerated compute shape features the NVIDIA BlueField-3 DPU for improved server efficiency, offloading data center tasks from CPUs to accelerate networking, storage and security workloads. The use of BlueField-3 DPUs furthers OCI's strategy of off-box virtualization across its entire fleet.

OCI Supercluster with NVIDIA L40S enables ultra-high performance with 800Gbps of internode bandwidth and low latency for up to 3,840 GPUs. OCI's cluster network uses NVIDIA ConnectX-7 NICs over RoCE v2 to support high-throughput and latency-sensitive workloads, including AI training.

We chose OCI AI infrastructure with bare-metal instances and NVIDIA L40S GPUs for 30% more efficient video encoding, said Sharon Carmel, CEO of Beamr Cloud. Videos processed with Beamr Cloud on OCI will have up to 50% reduced storage and network bandwidth consumption, speeding up file transfers by 2x and increasing productivity for end users. Beamr will provide OCI customers video AI workflows, preparing them for the future of video.

Single-GPU H100 VMs Coming Soon on OCI The VM.GPU.H100.1 compute virtual machine shape, accelerated by a single NVIDIA H100 Tensor Core GPU, is coming soon to OCI. This will provide cost-effective, on-demand access for enterprises looking to use the power of NVIDIA H100 GPUs for their generative AI and HPC workloads.

A single H100 provides a good platform for smaller workloads and LLM inference. For example, one H100 GPU can generate more than 27,000 tokens per second for Llama 3 8B (up to 4x more throughput than a single A100 GPU at FP16 precision) with NVIDIA TensorRT-LLM at an input and output sequence length of 128 and FP8 precision.

The VM.GPU.H100.1 shape includes 2 3.4TB of NVMe drive capacity, 13 cores of 4th Gen Intel Xeon processors and 246GB of system memory, making it well-suited for a range of AI tasks.

Oracle Cloud's bare-metal compute with NVIDIA H100 and A100 GPUs, low-latency Supercluster and high-performance storage delivers up to 20% better price-performance for Altair's computational fluid dynamics and structural mechanics solvers, said Yeshwant Mummaneni, chief engineer of data management analytics at Altair. We look forward to leveraging these GPUs with virtual machines for the Altair Unlimited virtual appliance.

GH200 Bare-Metal Instances Available for Validation OCI has also made available the BM.GPU.GH200 compute shape for customer testing. It features the NVIDIA Grace Hopper Superchip and NVLink-C2C, a high-bandwidth, cache-coherent 900GB/s connection between the NVIDIA Grace CPU and NVIDIA Hopper GPU. This provides over 600GB of accessible memory, enabling up to 10x higher performance for applications running terabytes of data compared to the NVIDIA A100 GPU.

Optimized Software for Enterprise AI Enterprises have a wide variety of NVIDIA GPUs to accelerate their AI, HPC and data analytics workloads on OCI. However, maximizing the full potential of these GPU-accelerated compute instances requires an optimized software layer.

NVIDIA NIM, part of the NVIDIA AI Enterprise software platform available on the OC
LINK: https://blogs.nvidia.com/blog/oracle-cloud-infrastructure-ai-gpu-digit...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

07/05/2026

L3Harris Red Wolf + SKY RAIDER II INTERNATIONAL: Unmatched Flexibility for Kinetic Strike, EW, ISR and Support Missions

Two multi-role L3Harris products - the Red Wolf launched effects vehicle and SK...

07/05/2026

US Air Force Selects L3Harris to Develop Digital Infrastructure for its Advanced Battle Management System Network

L3Harris will be developing key features of a secure and resilient digital infra...

07/05/2026

New Nielsen Report Shows The Profound Impact of Asian Influence on Sports and Pop Culture

Alysa Liu and Shohei Ohtani Help Drive Viewership as 91 of the Top 100 Broadcast...

07/05/2026

IAB Tech Lab Introduces Standardized Signals For CTV Ad Portfolio

Share Copy link Facebook X Linkedin Bluesky Email...

07/05/2026

Cobalt Digital Wins Two Future Best of Show Awards at 202...

Cobalt Digital Wins Two Future Best of Show Awards at 2026 NAB Show Manufacturer Recognized by TV Tech and TVBEurope for Innovation in signal processing Cobal...

07/05/2026

FOR-A delivers creativity practicality and technical exce...

Software and hardware platforms, AI power and user-friendliness on show...

07/05/2026

Intinor brings advanced IP transport diagnostics and HDR...

Intinor will demonstrate its latest technical enhancements for the Direkt series at BroadcastAsia 2026. With a continued focus on reliable contribution and remo...

07/05/2026

Bitmovin Powers Global Film Streaming Platform MUBI

Bitmovin has announced that MUBI has chosen Bitmovin as its cloud VOD encoding partner, replacing MUBI's legacy on premises encoding setup to improve scalab...

07/05/2026

Meet Graduates from Berklees Class of 2026

Meet Graduates from Berklees Class of 2026 Members of this years graduating class reflect on their proudest moments at Berklee and look ahead to whats next. ...

07/05/2026

Convergence is Now Established Reality,' Says NAB 2026 Report

Share Copy link Facebook X Linkedin Bluesky Email...

07/05/2026

Interra Systems to Showcase Best in Class QC Monitoring a...

At BroadcastAsia 2026, Interra Systems will demonstrate its latest innovations in automated quality control (QC), real-time monitoring, and captioning. The comp...

07/05/2026

PlayBox Neo shines a spotlight on delivering Secure Scala...

At this year's Broadcast Asia, PlayBox Neo is set to unveil recent innovations across its PlayBox Neo Suite and integrated range of broadcast media solution...

07/05/2026

BFBS selects Synamedia to deliver New Digital Platform fo...

Strategic three-year partnership marks delivery phase of BFBS' next-generation media vision Media organisation and military charity BFBS (British Forces Br...

07/05/2026

Amagi Unlocks New Opportunities for CTV Performance with...

Amagi, the agentic industry cloud platform for unified broadcast, streaming, and monetization, today announced the availability of its In-Content Ads offering v...

07/05/2026

Lightware Introduces Rack Taurus For Clean Centralized AV...

Lightware Visual Engineering has developed Rack Taurus for rack-based environments such as education and corporate training spaces. It enables clean and simple ...

07/05/2026

Jigsaw24 Showcases End-to-End Media Workflows at MPTS 202...

Jigsaw24, the UK's leading media equipment supplier and systems integrator, will showcase its expanded end-to-end workflow capabilities at MPTS 2026, signal...

07/05/2026

Ease Live Granted US Patent for Technology Powering Perfe...

Ease Live, an Evertz company, today announced that it has been granted a US Patent for its proprietary graphical overlay technology, the foundation for interact...

07/05/2026

Leader prepares advanced Test and Measurement showcase fo...

Test & measurement innovator Leader Electronics of Europe will present an extensive range of Leader, PHABRIX and LeaderPhabrix test and measurement solutions at...

07/05/2026

LiveU Signals a New Era of Live Broadcasting at Broadcast...

At Broadcast Asia 2026 (Stand 5H3 8), LiveU is redefining live production with its most powerful IP-video EcoSystem to date built to help broadcasters and con...

07/05/2026

Colorfront Streaming Server Awarded Trusted Partner Network Gold Logo Certification

January 8, 2024 Colorfront (colorfront.com), a leader in high-performance, on-s...

07/05/2026

Colorfront Unleashes New Opportunities for Content Owners Plus Other Ground-Breaking Visual Experiences at Nab 2024

March 20, 2024 NAB 2024, Las Vegas - Colorfront (colorfront.com), the multi-awa...

07/05/2026

Colorfront Delivers Innovations for HDR Cinema at Cinemacon 2025

April 1, 2025 CINEMACON, APRIL 1, 2025 - Colorfront (colorfront.com), the multi-award-winning developer of high-performance dailies/transcoding/streaming syste...

07/05/2026

Colorfront to Showcase Advanced HDR Cinema Mastering Solutions at CineEurope 2025

June 15, 2025 Colorfront (colorfront.com), an Academy and Emmy Award-winning de...

07/05/2026

Colorfront at ICTA Barcelona Cinema Technology Summit

June 15, 2025 Colorfront participated in the ICTA Barcelona Cinema Technology Summit on Sunday, June 15, 2025. Held at The Phenomena Experience, the event feat...

07/05/2026

Colorfront Does IBC 2024 Live From Stockholm!

July 1, 2025 Colorfront (colorfront.com), the multi-award-winning developer of high-performance dailies/transcoding/streaming systems for motion pictures, OTT,...

07/05/2026

Colorfront Transkoder Delivers a Masterful Performance at Annapurna Studios

July 1, 2025 Passion and dedication will take you places. Come with us on a short trip to the heart of India, where Annapurna Studios is living-up to the inspi...

07/05/2026

Colorfront Opens a New Chapter in Color Tools For Cinema & Television

July 3, 2025 Colorfront (colorfront.com), the multi-award-winning developer of high-performance dailies/transcoding/streaming systems for motion pictures, OTT,...

07/05/2026

Colorfront at IBC 2025: Advanced Tools Make Easy Work of Critical Mastering Tasks and More!

September 1, 2025 IBC 2025, Amsterdam - Colorfront (colorfront.com) - the Acade...

07/05/2026

Colorfront Introduces Colorfront Immersive Utility, a New Mac App for Creating Apple Immersive Video

April 17, 2026 LOS ANGELES - April 17, 2026 - Colorfront today announced Colorf...

07/05/2026

Colorfront Delivers Even More AI Automation Power and Extends Technology Partnerships with Dolby Apple

April 23, 2026 NAB 2026, Las Vegas - the Academy and Emmy Award-winning develop...

07/05/2026

CNN Founder Ted Turner Dies at 87

Share Copy link Facebook X Linkedin Bluesky Email...

07/05/2026

FCC Urges Appeals Court to Toss Challenges to Nexstar-Tegna Deal

Share Copy link Facebook X Linkedin Bluesky Email...

07/05/2026

Carr Announces FCC Staff Promotions

Share Copy link Facebook X Linkedin Bluesky Email...

07/05/2026

Recreating the 1974 Doctor Who Time Tunnel in After Effects

Recreating the 1974 Doctor Who Time Tunnel in After Effects Graham Quince May 6, 2026 0 Comments The Time Tunnel from Doctor Who titles is one of th...

07/05/2026

Red Chillies Entertainment and Netflix Present the Trailer of 'Kartavya;' Saif Ali Khan Starrer streaming from 15th May

Back to All News Red Chillies Entertainment and Netflix Present the Trailer of ...

07/05/2026

When the host grabs the mic: keeping sound clean on 'Family Feud'

Production sound mixer Dirk Sciarrotta has mixed Family Feud for 28 seasons. Thats up to 200 syndicated episodes per year, plus primetime celebrity specials - a...

07/05/2026

The mic Broadway's biggest shows have trusted for 20+ years

As audience expectations have evolved, Owen has stopped trying to hide microphones or excuse amplification. Instead, he treats sound as a fully immersive part o...

07/05/2026

Well known Irish faces pushed to the edge in new series of Uncharted with Ray Goggins

Well known Irish faces pushed to the edge in new series of Uncharted with Ray G...

07/05/2026

Powerful four generation story A Traveller Family airs on RT One and RT Player this Monday night

RT will premiere A Traveller Family, a compelling new documentary exploring the...

07/05/2026

Linked and Loaded: Gaijin Single Sign-On Now Available on GeForce NOW

Less typing, more tanking. Faster logins mean more time in the gaming action - and this week provides GeForce NOW members with a smoother path straight into th...

06/05/2026

Wisycom RF Solutions Support Gravity Medias Live Cycling and Marathon Broadcasts

Gravity Media Chief RF Communications Engineer Glenn Willems uses Wisycom RF over Fiber and wireless solutions across major cycling events and international mar...

06/05/2026

Sennheiser Spectera Module Now Available in Bitfocus Companion and Buttons

A Sennheiser Spectera module is now available in Bitfocus Companion and Buttons, enabling direct integration of Spectera with the two software platforms. The mo...

06/05/2026

Ted Turner, Cable Television Pioneer, Sports Broadcasting Hall of Famer, Dead at 87

Ted Turner, the visionary media entrepreneur whose appetite for disruption helpe...

06/05/2026

FIFA World Cup 2026: Peacock Launches Visin de Campo (aka Pitchside Live), Will Stream All 104 Matches in Spanish

Peacock is going all-in on the beautiful game - streaming all 104 FIFA World Cup...