Sony Pixel Power calrec Sony

NVIDIA NIM Microservices Now Available to Streamline Agentic Workflows on RTX AI PCs and Workstations

25/03/2025

Generative AI is unlocking new capabilities for PCs and workstations, including game assistants, enhanced content-creation and productivity tools and more.

NVIDIA NIM microservices, available now, and AI Blueprints, coming in April, accelerate AI development and improve its accessibility. Announced at the CES trade show in January, NVIDIA NIM provides prepackaged, state-of-the-art AI models optimized for the NVIDIA RTX platform, including the NVIDIA GeForce RTX 50 Series and, now, the new NVIDIA Blackwell RTX PRO GPUs. The microservices are easy to download and run. They span the top modalities for PC development and are compatible with top ecosystem applications and tools.

The experimental System Assistant feature of Project G-Assist was also released today. Project G-Assist showcases how AI assistants can enhance apps and games. The System Assistant allows users to run real-time diagnostics, get recommendations on performance optimizations, or control system software and peripherals - all via simple voice or text commands. Developers and enthusiasts can extend its capabilities with a simple plug-in architecture and new plug-in builder.

Amid a pivotal moment in computing - where groundbreaking AI models and a global developer community are driving an explosion in AI-powered tools and workflows - NIM microservices, AI Blueprints and G-Assist are helping bring key innovations to PCs. This RTX AI Garage blog series will continue to deliver updates, insights and resources to help developers and enthusiasts build the next wave of AI on RTX AI PCs and workstations.

Ready, Set, NIM! Though the pace of innovation with AI is incredible, it can still be difficult for the PC developer community to get started with the technology.

Bringing AI models from research to the PC requires curation of model variants, adaptation to manage all of the input and output data, and quantization to optimize resource usage. In addition, models must be converted to work with optimized inference backend software and connected to new AI application programming interfaces (APIs). This takes substantial effort, which can slow AI adoption.

NVIDIA NIM microservices help solve this issue by providing prepackaged, optimized, easily downloadable AI models that connect to industry-standard APIs. They're optimized for performance on RTX AI PCs and workstations, and include the top AI models from the community, as well as models developed by NVIDIA.

NIM microservices support a range of AI applications, including large language models (LLMs), vision language models, image generation, speech processing, retrieval-augmented generation (RAG)-based search, PDF extraction and computer vision. Ten NIM microservices for RTX are available, supporting a range of applications, including language and image generation, computer vision, speech AI and more. Get started with these NIM microservices today:

Language and Reasoning: Deepseek-R1-distill-llama-8B, Mistral-nemo-12B-instruct, Llama3.1-8B-instruct

Image Generation: Flux.dev

Audio: Riva Parakeet-ctc-0.6B-asr, Maxine Studio Voice

RAG: Llama-3.2-NV-EmbedQA-1B-v2

Computer Vision and Understanding: NV-CLIP, PaddleOCR, Yolo-X-v1

NIM microservices are also available through top AI ecosystem tools and frameworks.

For AI enthusiasts, AnythingLLM and ChatRTX now support NIM, making it easy to chat with LLMs and AI agents through a simple, user-friendly interface. With these tools, users can create personalized AI assistants and integrate their own documents and data, helping automate tasks and enhance productivity.

For developers looking to build, test and integrate AI into their applications, FlowiseAI and Langflow now support NIM and offer low- and no-code solutions with visual interfaces to design AI workflows with minimal coding expertise. Support for ComfyUI is coming soon. With these tools, developers can easily create complex AI applications like chatbots, image generators and data analysis systems.

In addition, Microsoft VS Code AI Toolkit, CrewAI and Langchain now support NIM and provide advanced capabilities for integrating the microservices into application code, helping ensure seamless integration and optimization.

Visit the NVIDIA technical blog and build.nvidia.com to get started.

NVIDIA AI Blueprints Will Offer Pre-Built Workflows NVIDIA AI Blueprints, coming in April, give AI developers a head start in building generative AI workflows with NVIDIA NIM microservices.

Blueprints are ready-to-use, extensible reference samples that bundle everything needed - source code, sample data, documentation and a demo app - to create and customize advanced AI workflows that run locally. Developers can modify and extend AI Blueprints to tweak their behavior, use different models or implement completely new functionality.

PDF to podcast AI Blueprint coming soon. The PDF to podcast AI Blueprint will transform documents into audio content so users can learn on the go. By extracting text, images and tables from a PDF, the workflow uses AI to generate an informative podcast. For deeper dives into topics, users can then have an interactive discussion with the AI-powered podcast hosts.

The AI Blueprint for 3D-guided generative AI will give artists finer control over image generation. While AI can generate amazing images from simple text prompts, controlling image composition using only words can be challenging. With this blueprint, creators can use simple 3D objects laid out in a 3D renderer like Blender to guide AI image generation. The artist can create 3D assets by hand or generate them using AI, place them in the scene and set the 3D viewport camera. Then, a prepackaged workflow powered by the FLUX NIM microservice will use the current composition to generate high-quality images that match the 3D scene.

NVIDIA NIM on RTX With Windows Subsystem for Linux One of the key tech
LINK: https://blogs.nvidia.com/blog/rtx-ai-garage-nim-blueprints-g-assist/...
See more stories from nvidia

North America Stories

26/03/2026

Audio-Technica and Extron Announce Microsoft Teams-Certified Enterprise Solutions

Extron and Audio-Technica have announced that their Design Solutions devices, Ce...

26/03/2026

SPORTEL Asia Returns to Singapore with 370 Participants from 35 Countries

SPORTEL Asia took place March 24-25 at the Orchard Hotel Singapore, drawing 370 participants representing more than 220 companies from 35 countries. Approximate...

26/03/2026

NAB 2026: LTN to Showcase Satellite-to-IP Migration Solutions

LTN will demonstrate satellite-to-IP migration solutions for broadcasters, cable networks, MVPDs, and station groups at NAB Show 2026 (Booth W2100). The C-Ban...

26/03/2026

Seattle Mariners Upgrade Center Field Video Display at T-Mobile Park with Daktronics

The Seattle Mariners have partnered with Daktronics to install an upgraded outfi...

26/03/2026

Esports Nations Cup 2026 Names National Team Partners Across 100+ Countries

The Esports Foundation (EF) has awarded National Team Partner status to organizations and individuals across more than 100 countries and territories for the Esp...

26/03/2026

NAB 2026: Telestream Expands Vantage Integration with Adobe Premiere, Media Encoder, and Frame.io

Telestream has announced expanded integration between its Vantage workflow platf...

26/03/2026

NAB 2026: FOR-A Brings Nippon TV's viztrick AiDi AI Production Tool to Market with NVIDIA

FOR-A Corporation has announced a partnership with Nippon TV and NVIDIA to distr...

26/03/2026

CBS Sports Reaches New Long-Term Multiplatform Rights Agreement with the WNBA

CBS Sports and the WNBA have expanded their partnership through a new long-term, multiplatform rights agreement. CBS Sports will feature up to 20 regular-season...

26/03/2026

Zac Brown Band to Perform Sunday Night Baseball Open on NBC and Peacock

Zac Brown Band will star in the Sunday Night Baseball show open on NBC and Peacock, NBC Sports announced. The open was filmed at American Family Field, home of ...

26/03/2026

2026 MLB Season Opens With Full Slate of National Games

Major League Baseball opens the 2026 season with nationally televised games across multiple media partners. Fans can visit MLB.com/Watch for a complete schedule...

26/03/2026

DIRECTV Adds Nine MLB Team Channels for 2026 Season

DIRECTV has announced an agreement to carry nine new MLB-operated team channels, covering the Cincinnati Reds, Detroit Tigers (Detroit SportsNet), Kansas City R...

26/03/2026

Nationals.TV Now Available on Charter, Comcast, Cox, DIRECTV, Verizon Fios and More

Nationals.TV, the Washington Nationals' local broadcast channel, is now avai...

26/03/2026

MLB.TV Launches on the ESPN App Starting Opening Day

Starting Thursday, March 26, MLB.TV will be available on the ESPN App, giving fans access to more than 2,000 out-of-market regular season games. Fans can also r...

26/03/2026

Why YEP Changed My Career (And Why It Might Change Yours)

By Matt Klein Hello to everyone reading this - whether you're a current YEP, HPA member, or just YEP-curious. I'm Matt Klein, one of the co-chairs of t...

26/03/2026

CBS Sports Inks New WNBA Deal

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

Apogee Insight Acquires PMA Research

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

NBC Announces Exclusive Coverage of Sail4th 250 Tall Ships in NYC

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

UK Group of media tech companies take the spotlight at NA...

28 participating companies, from start-ups to blue-chips, lead the UK Group as part of the GREAT Britain and Northern Ireland presence across all the Halls at N...

26/03/2026

Arkona Unveils BLADE//planner and Major Usability Enhancements at NAB 2026

Arkona Unveils BLADE//planner and Major Usability Enhancements at NAB 2026 Brie Clayton March 26, 2026 0 Comments New graphical configuration tool and...

26/03/2026

Bitfocus showcases complete control at NAB Show 2026

Bitfocus showcases complete control at NAB Show 2026 Brie Clayton March 26, 2026 0 Comments Continuing development drives advances in security, availa...

26/03/2026

Allen Media Group To Deploy Anoki ContextIQ

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

LG Announces New Premium FAST Channels

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

IABM to Host Breakfast Event at 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

Nexstar Defends Tegna Deal in Calif. Court Filing

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

Nevion introduces powerful new Panel Builder to enhance VideoIPath broadcast control capability

Nevion introduces powerful new Panel Builder to enhance VideoIPath broadcast con...

26/03/2026

2026 Oscar Nominated Films Powered by Blackmagic Design

2026 Oscar Nominated Films Powered by Blackmagic Design Brie Clayton March 25, 2026 0 Comments DaVinci Resolve Studio used on 27 of this year's no...

26/03/2026

Leader to present full suite of advanced Test & Measurement solutions at NAB Show 2026

Leader to present full suite of advanced Test & Measurement solutions at NAB Sho...

26/03/2026

Boston Conservatory to Present New England and Collegiate Premiere of Groundbreaking Opera Time to Act

Boston Conservatory to Present New England and Collegiate Premiere of Groundbrea...

26/03/2026

Have a Wish Worth Dying For? Netflix's First Korean YA Horror Series If Wishes Could Kill' Premieres April 24

Back to All News Have a Wish Worth Dying For? Netflix's First Korean YA Hor...

26/03/2026

'The Truthers,' Starring Jose Coronado and Stphanie Magnin, Premieres on Netflix on 24 July

Back to All News The Truthers, Starring Jose Coronado and St phanie Magnin, Pre...

26/03/2026

Into the Omniverse: NVIDIA GTC Showcases Virtual Worlds Powering the Physical AI Era

Editor's note: This post is part of Into the Omniverse, a series focused on ...

26/03/2026

Game On: Five New Titles Now Streaming on GeForce NOW

That gaming backlog won't clear itself - GeForce NOW is here to help. Stream the latest titles straight from the cloud across a variety of devices. This we...

25/03/2026

In The Hot Seat: The Art of Directing a Premier League Match

Live match directors Sarah Cheadle (Sky Sports), Rob Levi (TNT Sports), and Andrew Swift (BBC Sport) sit down with the Premier League's Rachel Nightingale t...

25/03/2026

SVG Students To Watch: Kyle Maier, St. Bonaventure University

The senior from Upstate New York is manning the mic while also interning for the athletic department's sports-information team In the live-sports-video ind...

25/03/2026

NAB 2026: Synamedia Launches Edge Watermarking Solution, Marks 10 Years of ContentArmor

Synamedia has announced ContentArmor Edge Watermarking, a server-side solution t...

25/03/2026

SES Taps K2 Space to Build meoSphere MEO Satellite Network

SES has announced meoSphere, a medium Earth orbit (MEO) satellite network targeted for operation by 2030. The first phase will pair SES-developed software-defin...

25/03/2026

Reuters and TVU Networks Begin Satellite-to-IP Migration for Live News Distribution

TVU Networks is working with Reuters on a phased migration from satellite to a c...

25/03/2026

Nielsen Names Three Senior Hires in Sports, Advertising, and Publishing Roles

Nielsen has announced three senior appointments. Seth Ladetsky has been named Head of Global Sports. Trevor Fellows will lead Nielsen's advertiser and agenc...

25/03/2026

Anoki and Amagi Bring Scene-Level Intelligence to In-Content CTV Ads

Anoki and Amagi have launched In-Scene Ads powered by Anoki ContextIQ across Amagi's portfolio of in-content ad formats for Free Ad-supported Streaming TV (...

25/03/2026

NAB 2026: Arkona to Unveil BLADE//planner and Platform Updates

Arkona Technologies will announce a series of enhancements to its BLADE//runner platform at NAB 2026 (Booth C.1808). The updates focus on usability and workflow...

25/03/2026

San Diego Padres Partners With Daktronics to Enhance Petco Park

Daktronics has installed two tower displays and a video wall in the Lexus Club at Petco Park in San Diego ahead of the 2026 season. Continuing to improve the ...

25/03/2026

NAB 2026: MultiDyne Marks 50th Anniversary

MultiDyne Video & Fiber Optic Systems is celebrating its 50th anniversary as NAB Show 2026 approaches. The company was founded in 1976 by Vincent Jachetta, an N...

25/03/2026

NAB 2026: IPC to Debut with One Connect Intercom Platform and New One Link Keypanels

IPC, a provider of integrated communication solutions, will make its NAB 2026 de...

25/03/2026

ESPN Tops 2026 Sports Emmy Nominations With 63 Nods

Live production categories were led by NBC, FOX, and ESPN's NFL coverage...

25/03/2026

Atlanta Braves and Spectrum Reach Multiyear Distribution Agreement for BravesVision

The Atlanta Braves and Spectrum have announced a multiyear distribution agreemen...

25/03/2026

The AI Doc Asks the Question No One Wants to Answer

(L-R) Charlie Tyrell and Daniel Roher attend The AI Doc: Or How I Became An Apocaloptimist Premiere during the 2026 Sundance Film Festival at The Ray Theatre ...

25/03/2026

L3Harris, RFTEQ Sign Agreement to Advance Sovereign Electronic Warfare Capability in Australia

L3Harris Technologies and RFTEQ Pty Ltd signed a memorandum of understanding to ...

25/03/2026

L3Harris to Provide Autonomous Underwater Capability for US Navy Submarines

L3Harris delivers combat-ready Torpedo Tube Launch and Recovery system, which deploys and retrieves Iver4 900 autonomous underwater vehicles through submarine t...

25/03/2026

Nielsen Names New Senior Leaders Supporting Sports, Advertising and Publishing Clients

The company expands leadership team under Chief Revenue Officer Amilcar Perez S...