Sony Pixel Power calrec Sony

Unveiling a New Era of Local AI With NVIDIA NIM Microservices and AI Blueprints

08/01/2025

Over the past year, generative AI has transformed the way people live, work and play, enhancing everything from writing and content creation to gaming, learning and productivity. PC enthusiasts and developers are leading the charge in pushing the boundaries of this groundbreaking technology.

Countless times, industry-defining technological breakthroughs have been invented in one place - a garage. This week marks the start of the RTX AI Garage series, which will offer routine content for developers and enthusiasts looking to learn more about NVIDIA NIM microservices and AI Blueprints, and how to build AI agents, creative workflow, digital human, productivity apps and more on AI PCs. Welcome to the RTX AI Garage.

This first installment spotlights announcements made earlier this week at CES, including new AI foundation models available on NVIDIA RTX AI PCs that take digital humans, content creation, productivity and development to the next level.

These models - offered as NVIDIA NIM microservices - are powered by new GeForce RTX 50 Series GPUs. Built on the NVIDIA Blackwell architecture, RTX 50 Series GPUs deliver up to 3,352 trillion AI operations per second of performance, 32GB of VRAM and feature FP4 compute, doubling AI inference performance and enabling generative AI to run locally with a smaller memory footprint.

NVIDIA also introduced NVIDIA AI Blueprints - ready-to-use, preconfigured workflows, built on NIM microservices, for applications like digital humans and content creation.

NIM microservices and AI Blueprints empower enthusiasts and developers to build, iterate and deliver AI-powered experiences to the PC faster than ever. The result is a new wave of compelling, practical capabilities for PC users.

Fast-Track AI With NVIDIA NIM There are two key challenges to bringing AI advancements to PCs. First, the pace of AI research is breakneck, with new models appearing daily on platforms like Hugging Face, which now hosts over a million models. As a result, breakthroughs quickly become outdated.

Second, adapting these models for PC use is a complex, resource-intensive process. Optimizing them for PC hardware, integrating them with AI software and connecting them to applications requires significant engineering effort.

NVIDIA NIM helps address these challenges by offering prepackaged, state-of-the-art AI models optimized for PCs. These NIM microservices span model domains, can be installed with a single click, feature application programming interfaces (APIs) for easy integration, and harness NVIDIA AI software and RTX GPUs for accelerated performance.

At CES, NVIDIA announced a pipeline of NIM microservices for RTX AI PCs, supporting use cases spanning large language models (LLMs), vision-language models, image generation, speech, retrieval-augmented generation (RAG), PDF extraction and computer vision.

The new Llama Nemotron family of open models provide high accuracy on a wide range of agentic tasks. The Llama Nemotron Nano model, which will be offered as a NIM microservice for RTX AI PCs and workstations, excels at agentic AI tasks like instruction following, function calling, chat, coding and math.

Soon, developers will be able to quickly download and run these microservices on Windows 11 PCs using Windows Subsystem for Linux (WSL).

To demonstrate how enthusiasts and developers can use NIM to build AI agents and assistants, NVIDIA previewed Project R2X, a vision-enabled PC avatar that can put information at a user's fingertips, assist with desktop apps and video conference calls, read and summarize documents, and more. Sign up for Project R2X updates.

By using NIM microservices, AI enthusiasts can skip the complexities of model curation, optimization and backend integration and focus on creating and innovating with cutting-edge AI models.

What's in an API? An API is the way in which an application communicates with a software library. An API defines a set of calls that the application can make to the library and what the application can expect in return. Traditional AI APIs require a lot of setup and configuration, making AI capabilities harder to use and hampering innovation.

NIM microservices expose easy-to-use, intuitive APIs that an application can simply send requests to and get a response. In addition, they're designed around the input and output media for different model types. For example, LLMs take text as input and produce text as output, image generators convert text to image, speech recognizers turn speech to text and so on.

The microservices are designed to integrate seamlessly with leading AI development and agent frameworks such as AI Toolkit for VSCode, AnythingLLM, ComfyUI, Flowise AI, LangChain, Langflow and LM Studio. Developers can easily download and deploy them from build.nvidia.com.

By bringing these APIs to RTX, NVIDIA NIM will accelerate AI innovation on PCs.

Enthusiasts are expected to be able to experience a range of NIM microservices using an upcoming release of the NVIDIA ChatRTX tech demo.

A Blueprint for Innovation By using state-of-the-art models, prepackaged and optimized for PCs, developers and enthusiasts can quickly create AI-powered projects. Taking things a step further, they can combine multiple AI models and other functionality to build complex applications like digital humans, podcast generators and application assistants.

NVIDIA AI Blueprints, built on NIM microservices, are reference implementations for complex AI workflows. They help developers connect several components, including libraries, software development kits and AI models, together in a single application.

AI Blueprints include everything that a developer needs to build, run, customize and extend the reference workflow, which includes the reference application and source code, sample data, and documentation for customization and orchestration of
LINK: https://blogs.nvidia.com/blog/rtx-ai-garage-ces-pc-nim-blueprints/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

19/08/2026

Imagine Communications Steve Reynolds on Kaseya Centers Hybrid IP Build and the Growth of ST 2110

As the cost of IP nears price parity with traditional SDI, Reynolds argues that ...

19/08/2026

European Athletics Championships 2026: BBC, Event Organizers Bring Birmingham Action to Viewers in Style

A private 5G bubble was chosen instead of traditional broadcast RF for the race ...

19/08/2026

Filipiana Sets the Class Divide on a Golf Course in the Philippines

(L-R) Rafael Manuel and Isabel Sicat attend the Filipi ana premiere during the 2026 Sundance Film Festival at The Ray Theatre on January 23, 2026, in Park Cit...

19/08/2026

MPG launch Save Our Studios survey

Studio owners invited to have their say on rates cuts The Music Producers Guild (MPG) are inviting UK-based studios to take part in an in-depth survey that ...

19/08/2026

Harrison unveil the Flex-10

Vintage-inspired desktop interface revealed Harrison's latest hardware offering sees them head into the world of audio interfaces, delivering a 10-in/12...

19/08/2026

Minimal Audio release Lucid

Granular effect remains locked to scale and tempo Described as your dream granular effect , Minimal Audio's latest creation is capable of turning any s...

19/08/2026

Audio Modeling open PolySWAM pre-orders

First polyphonic SWAM instrument incoming Audio Modeling's latest physical-modelling orchestral instrument is just around the corner, and is now availab...

19/08/2026

FOX and NBCUniversal Score with FIFA World Cup 2026 Success in Nielsen's June Gauge Reports

World Cup Games Generate 84 Billion Minutes Across FOX, Fox Sports 1 and NBCU...

19/08/2026

The Gauge: Poland | July 2026

July brought typical peak-holiday drops in viewership, driven primarily by viewers stepping away from screens and a visible decline in reach across both traditi...

19/08/2026

Carr Calls ABC Suit 'Meritless

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Henry Alexander Joins BCE as Sales Director

Henry joins BCE as the company accelerates its commercial strategy and expands its international presence across the media, broadcast and technology markets. He...

19/08/2026

iWedia Announces Advanced Android DRAM Optimisation Proce...

iWedia, a leading provider of software solutions for connected TV devices, today announced a major milestone in Android platform optimization with the successfu...

19/08/2026

NTP Technology announces ST 2110-30-RAVENNA 128-channel A...

NTP Technology announces that ST 2110-30 audio-over-IP connectivity with AES67 and RAVENNA capabilities is now available for the brand's world-class audio i...

19/08/2026

ORF goes full IP with Net Insight in nationwide network o...

Net Insight has been selected to provide its Nimbra platform by the service provider Big Blue Marble, formerly ORS Group, as the core media transport solution f...

19/08/2026

Coventry City Trophy Parade Extends LiveU LIQ Beyond the...

LiveU has supported Coventry City FC and several other top-flight UK football clubs through one of their most demanding live production challenges of the year, ...

19/08/2026

Nature Seekers Documentary Shot with Blackmagic URSA Cine 12K LF

Nature Seekers Documentary Shot with Blackmagic URSA Cine 12K LF Brie Clayton August 18, 2026 0 Comments Filming endangered turtles required camera...

19/08/2026

Neyrinck Brings D-Control Consoles Back to Life on Apple Silicon with D-Control Basic

Neyrinck Brings D-Control Consoles Back to Life on Apple Silicon with D-Control ...

19/08/2026

ABC Files First Amendment Lawsuit Against FCC

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Nielsen: Fox and NBCUniversal Score with FIFA World Cup 2026

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

ESPN Co-Founder Bill Rasmussen Dies At 93

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Study: NBA Ad Revenue Hit $2.1 Billion Last Season

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Nexstar's WNCN Donates ENG Van for Training

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Riedel Brings Professional Live Production Into the Class...

Riedel Communications today announced that Edith Cowan University (ECU) in Perth, Australia, implemented a comprehensive communications infrastructure that brin...

19/08/2026

QuickLink Showcases New 4K Capabilities Across StudioEdge...

QuickLink, a leading provider of award-winning video production and remote guest contribution solutions, will spotlight a major leap forward in remote guest con...

19/08/2026

EMAM together with PlayBox Neo and SNEWS launch combined...

Integrated platform melds media asset management, playout automation and newsroom workflows EMAM, PlayBox Neo and SNEWS have officially launched Nuvex, a conne...

19/08/2026

Screen Australia releases the Private Investment Toolkit to strengthen screen industry financing pathways

Screen Australia releases the Private Investment Toolkit to strengthen screen in...

19/08/2026

Do Aussies truly value local content? Unpacking Screen Currency 2026 with Deirdre Brennan

Do Aussies truly value local content? Unpacking Screen Currency 2026 with Deirdr...

19/08/2026

U&alibi re-commissions Bookish for Christmas Special and Series 3

There's an early Christmas gift for Bookish fans, as UKTV confirms the re-commission of the hit U&alibi drama, created by and starring Mark Gatiss. Viewers ...

19/08/2026

Sky gives sports fans the chance to watch multiple live sports events simultaneously on the big screen for the first time

Wednesday 19 August 2026 Sky gives sports fans the chance to watch multiple liv...

19/08/2026

RT TO AIR HISTORIC KATIE TAYLOR FIGHT IN CROKE PARK

On Saturday September 5 Katie Taylor will step into the ring for the fight of her life against Flora Pili in front of 80,000 fans in Croke Park. A legendary fig...

18/08/2026

SportStream 2026 Virtual Event Set for September 15-17

SportStream 2026, a free three-day virtual event, will take place September 15-17. One registration provides access to all three days of live programming and on...

18/08/2026

IBC 2026: BeckTV to Debut BeckFlow Documentation Platform

BeckTV will introduce BeckFlow to the European market at IBC2026, demonstrated on the Providius stand (10.F53). BeckFlow is a web-based schematic documentation...

18/08/2026

IBC 2026: Boland Communications to Introduce ST 2110 Option for 4K Monitors

Boland Communications will introduce a SMPTE ST 2110 input option for its 4K monitors at IBC2026, along with a new 55-inch super-narrow bezel display for video ...

18/08/2026

Seattle Seahawks Integrate Dolby OptiView with Dolby Vision for Fan Streaming

Dolby Laboratories and the Seattle Seahawks have announced a partnership integrating Dolby OptiView into the Seahawks' live streaming coverage, making the S...

18/08/2026

Insights from BMG's Graham Taylor on the Role of a Sports Producer in Live Broadcast Production

For BMG Executive Producer of Sports Production, Graham Taylor, producing live s...

18/08/2026

TMRW Sports Names Rufus Hack as President of Golf

TMRW Sports has appointed Rufus Hack as President of Golf, a newly created role in which he will lead the company's golf businesses including TGL presented ...

18/08/2026

SMT To Deliver Race Technology for Freedom 250 IndyCar Broadcast

SMT will provide race technology for FOX Sports' coverage of the Freedom 250 Grand Prix of Washington, D.C. on August 23, when the NTT INDYCAR SERIES races ...

18/08/2026

HMA's Creator Collective Pairs Digital Creators, Beat Writers in New Model for Local-Sports Coverage

The live, YouTube-native roundtables combine fan voices, credentialed reporters,...

18/08/2026

Behind The Mic: FOX Sports Shares Broadcast Lineup for 2026 NFL Season and College Football Season

Behind The Mic provides a roundup of recent news regarding on-air talent, includ...

18/08/2026

Miami Heats Ed Filomia on Rebuilding Kaseya Centers Video Infrastructure and 29 Years With the Heat

The industry legend sounds off on replacing the Heat's iconic Medusa score...

18/08/2026

Bill Rasmussen, ESPN Founder and Sports Broadcasting Hall of Famer, Dies at 93

William F. Rasmussen, the sports fan-turned broadcaster and entrepreneur whose out-of-the-box idea of a 24-hour cable sports network, ESPN, changed forever the ...

18/08/2026

DAZN Completes Acquisition of ViewLift

DAZN Group has completed its acquisition of ViewLift, a provider of streaming and digital solutions for sports content owners. The acquisition was first announc...

18/08/2026

American Association of Professional Baseball Adds SI TV as Broadcast Partner

The American Association of Professional Baseball (AAPB) has added SI TV, Sports Illustrated's 24/7 streaming channel, as a broadcast partner for the remain...

18/08/2026

Esports Foundation Postpones Inaugural Esports Nations Cup to November 2027

The Esports Foundation has announced that the inaugural Esports Nations Cup (ENC), originally scheduled for November 2026 in Riyadh, will be postponed to Novemb...

18/08/2026

Diversified Launches Global Managed Services Practice

Diversified has announced a new Global Managed Services Practice, consolidating the company's managed services capabilities into one organization. Rob Mello...

18/08/2026

Appear Completes REMI Proof of Concept with Thoroughbred Racing Productions

Appear has completed a proof of concept with Thoroughbred Racing Productions (TRP), demonstrating multi-camera remote live production over bonded 5G cellular an...