Puget Systems Returns to SIGGRAPH 2024 to Demonstrate its On-Premises Generative AI and Machine Learning Custom Server

Puget Systems Returns to SIGGRAPH 2024 to Demonstrate its On-Premises Generative AI and Machine Learning Custom Server

Brie Clayton July 25, 2024

0 Comments

Puget Systems to Debut Newest Custom LLM AI Training and Inference Server with Support for Up to Eight NVIDIA RTX Ada Generation GPUs, NVIDIA L40S GPUs or NVIDIA H100 Tensor Core GPUs, and NVIDIA Networking Platforms

Puget Systems today announced it is returning to SIGGRAPH 2024 in Denver later this month to debut its newest custom Generative AI and Machine Learning server. With support for up to eight NVIDIA RTX Ada Generation GPUs, NVIDIA L40S GPUs or NVIDIA H100 Tensor Core GPUs with H100 NVL, the newest LLM AI Training and Inference Servers from Puget Systems are optimized for maximum GPU performance in a 4U server in on-premises local data center deployments.

To demonstrate the power of its newest specialized AI Training and Inference servers, the team from Puget Systems will be on hand at SIGGRAPH 2024 in booth #536 to showcase a sophisticated, GPU-intensive, real-time AI image generation solution that uses a StreamDiffusion pipeline. The demonstration will be run locally on the Puget Systems server to showcase how these complex, hardware-intensive workflows which require powerful GPUs, such as the NVIDIA RTX 6000 Ada Generation GPU, to generate high-quality imagery with smooth frame rates are possible using Puget Systems' custom, localized hardware.

Attendees at SIGGRAPH 2024 will see how the Puget Systems Generative AI and Machine Learning Server can pass a source image into a Stream Diffusion operator in TouchDesigner with a GUI to control the Stream Diffusion parameters, such as the Acceleration Library, Resolution, Steps, and Prompt. Additionally, various input methods, including webcams, visual noise, Adobe Photoshop (for live AI painting), and a mouse pointer for physical fluid simulation, can be selected in the GUI. The interpretation of the input image then creates an AI-generated output image in real time at high frame rates.

The Puget Systems AI Training and Inference Server: Flexible, Scalable, Powerful The Puget Systems AI Training and Inference Servers are rack-mount workstations specifically designed for GPU-intensive generative AI workflows, much like the StreamDiffusion demo shown in Puget Systems' booth at SIGGRAPH 2024.

The newest Puget Systems AI Training and Inference Servers offer AMD's EYPC line of processors, which are designed for demanding server workloads, offering up to 128 cores with support for 1.5TB DDR5 ECC RAM and 128 PCIe Gen 5 lanes. The servers use a pair of those CPUs to enable up to eight dual-width GPUs in a 4U rack mount chassis, and several hot-swap drive bays are easily accessible on the front, along with a pair of USB ports.

With support for up to eight NVIDIA GPUs with up to 752GB of total VRAM, this server is ideal for machine learning, AI, and rendering workloads. Additionally, for enterprise or data center customers, the Puget Systems AI Training and Inference Server also offers support for the NVIDIA L40S or NVIDIA H100 NVL Tensor Core GPU. The NVIDIA H100 NVL GPU is ideal for LLM inference with its high compute density, memory bandwidth, and energy efficiency, and NVIDIA NVLink architecture. It also delivers extraordinary acceleration to power the world's highest-performing elastic data centers for AI, data analytics, and high-performance computing (HPC) applications. Select Puget Servers also support the NVIDIA BlueField networking platform, including the NVIDIA BlueField-3 DPU.

For more information, please visit here or contact one of Puget Systems' expert tech consultants.

July 25, 2024Dejero to bring even smarter' mobile internet connectivity solutions to IBC that simplify remote broadcast and media production workflowsAlgorithm improvements to renowned Smart Blending Technology further strengthen connection stability of

July 24, 2024Create with Maxon: Product Visualization from Brief to Render - Week 5July 29, 2024, 12:00PM-1:00PM Creating the Final Look in Post (5/5) -

Enjoying the news? Sign up for the Creative COW Newsletter! Sign up for the Creative COW newsletter and get weekly updates on industry news, forum highlights, jobs, inspirational tutorials, tips, burning questions, and more! Receive bulletins from the largest, longest-running community dedicated to supporting professionals working in film, video, and audio.

Enter your email address, and your first and last name below!

-- Sign up: * indicates required

Email Address *

Name

--

LINK:	https://creativecow.net/puget-systems-returns-to-siggraph-2024-to-demo...
	See more stories from creativecow

Most recent headlines