Sony Pixel Power calrec Sony

NVIDIA NIM Microservices Now Available to Streamline Agentic Workflows on RTX AI PCs and Workstations

25/03/2025

Generative AI is unlocking new capabilities for PCs and workstations, including game assistants, enhanced content-creation and productivity tools and more.

NVIDIA NIM microservices, available now, and AI Blueprints, coming in April, accelerate AI development and improve its accessibility. Announced at the CES trade show in January, NVIDIA NIM provides prepackaged, state-of-the-art AI models optimized for the NVIDIA RTX platform, including the NVIDIA GeForce RTX 50 Series and, now, the new NVIDIA Blackwell RTX PRO GPUs. The microservices are easy to download and run. They span the top modalities for PC development and are compatible with top ecosystem applications and tools.

The experimental System Assistant feature of Project G-Assist was also released today. Project G-Assist showcases how AI assistants can enhance apps and games. The System Assistant allows users to run real-time diagnostics, get recommendations on performance optimizations, or control system software and peripherals - all via simple voice or text commands. Developers and enthusiasts can extend its capabilities with a simple plug-in architecture and new plug-in builder.

Amid a pivotal moment in computing - where groundbreaking AI models and a global developer community are driving an explosion in AI-powered tools and workflows - NIM microservices, AI Blueprints and G-Assist are helping bring key innovations to PCs. This RTX AI Garage blog series will continue to deliver updates, insights and resources to help developers and enthusiasts build the next wave of AI on RTX AI PCs and workstations.

Ready, Set, NIM! Though the pace of innovation with AI is incredible, it can still be difficult for the PC developer community to get started with the technology.

Bringing AI models from research to the PC requires curation of model variants, adaptation to manage all of the input and output data, and quantization to optimize resource usage. In addition, models must be converted to work with optimized inference backend software and connected to new AI application programming interfaces (APIs). This takes substantial effort, which can slow AI adoption.

NVIDIA NIM microservices help solve this issue by providing prepackaged, optimized, easily downloadable AI models that connect to industry-standard APIs. They're optimized for performance on RTX AI PCs and workstations, and include the top AI models from the community, as well as models developed by NVIDIA.

NIM microservices support a range of AI applications, including large language models (LLMs), vision language models, image generation, speech processing, retrieval-augmented generation (RAG)-based search, PDF extraction and computer vision. Ten NIM microservices for RTX are available, supporting a range of applications, including language and image generation, computer vision, speech AI and more. Get started with these NIM microservices today:

Language and Reasoning: Deepseek-R1-distill-llama-8B, Mistral-nemo-12B-instruct, Llama3.1-8B-instruct

Image Generation: Flux.dev

Audio: Riva Parakeet-ctc-0.6B-asr, Maxine Studio Voice

RAG: Llama-3.2-NV-EmbedQA-1B-v2

Computer Vision and Understanding: NV-CLIP, PaddleOCR, Yolo-X-v1

NIM microservices are also available through top AI ecosystem tools and frameworks.

For AI enthusiasts, AnythingLLM and ChatRTX now support NIM, making it easy to chat with LLMs and AI agents through a simple, user-friendly interface. With these tools, users can create personalized AI assistants and integrate their own documents and data, helping automate tasks and enhance productivity.

For developers looking to build, test and integrate AI into their applications, FlowiseAI and Langflow now support NIM and offer low- and no-code solutions with visual interfaces to design AI workflows with minimal coding expertise. Support for ComfyUI is coming soon. With these tools, developers can easily create complex AI applications like chatbots, image generators and data analysis systems.

In addition, Microsoft VS Code AI Toolkit, CrewAI and Langchain now support NIM and provide advanced capabilities for integrating the microservices into application code, helping ensure seamless integration and optimization.

Visit the NVIDIA technical blog and build.nvidia.com to get started.

NVIDIA AI Blueprints Will Offer Pre-Built Workflows NVIDIA AI Blueprints, coming in April, give AI developers a head start in building generative AI workflows with NVIDIA NIM microservices.

Blueprints are ready-to-use, extensible reference samples that bundle everything needed - source code, sample data, documentation and a demo app - to create and customize advanced AI workflows that run locally. Developers can modify and extend AI Blueprints to tweak their behavior, use different models or implement completely new functionality.

PDF to podcast AI Blueprint coming soon. The PDF to podcast AI Blueprint will transform documents into audio content so users can learn on the go. By extracting text, images and tables from a PDF, the workflow uses AI to generate an informative podcast. For deeper dives into topics, users can then have an interactive discussion with the AI-powered podcast hosts.

The AI Blueprint for 3D-guided generative AI will give artists finer control over image generation. While AI can generate amazing images from simple text prompts, controlling image composition using only words can be challenging. With this blueprint, creators can use simple 3D objects laid out in a 3D renderer like Blender to guide AI image generation. The artist can create 3D assets by hand or generate them using AI, place them in the scene and set the 3D viewport camera. Then, a prepackaged workflow powered by the FLUX NIM microservice will use the current composition to generate high-quality images that match the 3D scene.

NVIDIA NIM on RTX With Windows Subsystem for Linux One of the key tech
LINK: https://blogs.nvidia.com/blog/rtx-ai-garage-nim-blueprints-g-assist/...
See more stories from nvidia

North America Stories

05/06/2026

Berklee Study Reveals Video Has Become Essential to Music Careers

Berklee Study Reveals Video Has Become Essential to Music Careers Survey findings show social platforms have become the primary source of music for video cont...

04/06/2026

Sony's New PTZ Cameras Deliver 4K 60p; New STARVIS Sensor Meets Low-Light Demands

Sony Electronics is introducing the SRG-AS10, a 4K 60p-compatible PTZ auto-frami...

04/06/2026

SVG Students To Watch: Alex Albert, Texas A&M University

This recent grad from Spring, TX, led creative-video output for the Aggies' men's basketball team last season and has been producing video and creating ...

04/06/2026

USGA Brings AI Recaps, 3D Range Tracking, and Predictive Shot Tracing to U.S. Womens Open

For the first time at a women's golf major, every player in the field will r...

04/06/2026

Panasonic PT-RQ45 Projectors Power Lille Video Mapping Festival Opera House Installation

Three Panasonic PT-RQ45 40,000-lumen 3-Chip DLP projectors made their first live...

04/06/2026

Bitmovin and Akamai Support NRJ Groups Deployment of Akamai Adaptive Media Player 2

Bitmovin and Akamai have announced a collaboration with NRJ Group, a French mult...

04/06/2026

Telestream to Exhibit at InfoComm 2026 with Live Production and Media Workflow Demonstrations

Telestream will exhibit at InfoComm 2026 (Booth N7952), demonstrating media work...

04/06/2026

Sony Announces RIALTO 65 Image Sensor Block for VENICE 2, Targeting 2027 Release

Sony has announced the development of RIALTO 65, a 65mm format image sensor block for the VENICE 2 digital cinema camera, targeting release in the first half of...

04/06/2026

KOKUSAI DENKI Electric America to Exhibit 4K and Remote Production Solutions at InfoComm 2026

KOKUSAI DENKI Electric America will exhibit at InfoComm 2026 (Booth N8025, June ...

04/06/2026

Bell Media to Carry All 104 FIFA World Cup 2026 Matches Across TSN, RDS, and Streaming Platforms

Bell Media's TSN and RDS are the exclusive Canadian broadcasters of FIFA Wor...

04/06/2026

MASV Case Study: How MASV Reduced Miami HEAT's Road Game Video Transfer Times by 85%

The Challenge: Receiving Heavy Media Files From Road Games Quickly and ReliablyT...

04/06/2026

MASV Outlines Seven-Step Sports Analytics Workflow, Highlights File Transfer as Key Bottleneck

MASV, a managed file transfer platform used in broadcast and live sports product...

04/06/2026

NESN Appoints Fahad Haider as Vice President of Operations and Engineering

NESN has announced the appointment of Fahad Haider as Vice President of Operations and Engineering. Haider returns to NESN, where he previously served as Vice P...

04/06/2026

Sports Broadcaster, Executive, and Author David J. Halberstam Dies

David J. Halberstam, who spent almost 50 years in sports as a broadcaster and an executive, died June 2 after a years-long battle with brain cancer. Over his l...

04/06/2026

Grass Valleys Ben Dolinky on Offering Teachable Technology to College Students Across the Country

Although collegiate production programs are tasked with delivering high-quality ...

04/06/2026

Prime Video Caps First NBA Season With Sports Emmy Win, Carries In-House Production Into WNBA Campaign

California studio, two production trucks, global distribution system are combine...

04/06/2026

TikTok and Sundance Collab Launch Micro-Series Storytelling Program

New global program empowers and supports storytellers through scriptwriting course and access to industry experts TikTok and Sundance Institute today announce...

04/06/2026

TiVo: TV Viewing Hits Post-Pandemic Peak

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

Bitmovin and Akamai Support NRJ Group to Deploy Next Gene...

Bitmovin, a leading provider of video streaming infrastructure, and Akamai, the cybersecurity and cloud computing company that powers and protects business onli...

04/06/2026

American Underground Opens at American Tobacco Campus, Completing a 16-Year Full-Circle Story

American Underground (AU), the Startup Hub of the South and a community of mor...

04/06/2026

Nielsen: Thunder Rolls as NBA's Most-Watched Team

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

AI Drives Lenovo's 2026 FIFA World Cup Broadcast Plans

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

ATSC Conference Looks Beyond Traditional TV for 3.0 Success

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

ATSC Awards Highest Technical Honor to Julia Kenyon

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

Lumine Group to Acquire Synamedias Video Network Business

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

BFOA Launches 5th Annual Giving Day

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

Hemisphere Media Group Brings WAPA+ Fast Channel to Prime Video

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

APTS to Hold June 4 'Protect My Public Media Day'

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

NVIDIA and Microsoft Reinvent Windows PCs for the Age of Personal AI

NVIDIA and Microsoft Reinvent Windows PCs for the Age of Personal AI Brie Clayton June 3, 2026 0 Comments RTX Spark - a 1-Petaflop Superchip, the Full...

04/06/2026

Inside the Peaky Blinders: The Immortal Man Grade

Inside the Peaky Blinders: The Immortal Man Grade Brie Clayton June 3, 2026 0 Comments Simone Grattarola discusses shaping the look in DaVinci Resolve...

04/06/2026

Cine Gear Expo Announces 2026 Awards of Excellence Recipients

Cine Gear Expo Announces 2026 Awards of Excellence Recipients Brie Clayton June 3, 2026 0 Comments Ed Lachman ASC, Caleb Deschanel ASC, and M. David M...

04/06/2026

St. Vincents Live with Orchestra Tour to Feature Berklee Alum Ruby Plume

St. Vincents Live with Orchestra Tour to Feature Berklee Alum Ruby Plume Berklee alumni St. Vincent and Ruby Plume will appear on the same bill across seven d...

04/06/2026

'All the Truth in My Lies' Coming to Netflix on August 28

Back to All News All the Truth in My Lies Coming to Netflix on August 28 Entertainment 04 June 2026 GlobalSpain Link copied to clipboard Download the imag...

04/06/2026

Larry Tanz, VP of Content, EMEA, Delivers a Keynote Speech at the Enders TMT Leaders Live 2026 Conference

Back to All News Larry Tanz, VP of Content, EMEA, Delivers a Keynote Speech at ...

04/06/2026

Turn Your Living Room into a Stadium With the New FIFA World Cup: Launch Edition' Game, Exclusively on Netflix Games June 11

Back to All News Turn Your Living Room into a Stadium With the New FIFA World ...

04/06/2026

Keeping conversations real on LinkedIn

Keeping conversations real on LinkedIn Published on Jun 4, 2026 Categories: Product News LinkedIn Corporate Communications Share LinkedIn Facebook ...

04/06/2026

Forecast: Fun Ahead - 18 Games Join in June to Stream on GeForce NOW

June's forecast with GeForce NOW: 100% chance of gaming. GeForce NOW is lining up new adventures for the month, from big-name blockbusters to quirky indies...

03/06/2026

SES Launches Multi-Orbit Satellite Inflight Connectivity on Viva Airlines

SES and Viva, Mexico's ultra low-cost airline, have launched multi-orbit satellite inflight connectivity on Viva's Airbus aircraft. A total of 60 A320s ...

03/06/2026

CFP, ESPN, and TNT Sports Announce 2026-27 College Football Playoff Broadcast Schedule

The College Football Playoff, ESPN, and TNT Sports have announced kick times and...

03/06/2026

RED Digital Cinema to Host Panels and Demos at Cine Gear Expo 2026

RED Digital Cinema will exhibit at Cine Gear Expo 2026 (Booth 33, June 5-6, Universal Studios Lot), hosting three panels and hands-on product demonstrations. P...

03/06/2026

Roku Launches Soccer Zone for FIFA World Cup 2026

Roku has announced the Soccer Zone, a dedicated hub for FIFA World Cup 2026 content available across the United States, Canada, Mexico, Brazil, Colombia, Argent...

03/06/2026

Liverpool FC and Wasabi Technologies Renew Multi-Year Partnership

Liverpool FC and Wasabi Technologies have announced a multi-year extension of their partnership, with Wasabi continuing as the club's official cloud storage...

03/06/2026

Sky News Australia Deploys Grass Valley AMPP for Cloud-Based Newsroom Production

Grass Valley has announced that Australian News Channel (ANC), operator of Sky News Australia, has deployed Grass Valley AMPP as part of the relocation of its n...

03/06/2026

Gudrun Scharler Appointed CEO of Riedel Networks

The Riedel Group has announced the appointment of Gudrun Scharler as CEO of Riedel Networks. She succeeds Michael Martens, who has led Riedel Networks since 201...

03/06/2026

Clear-Com Deploys Arcadia Central Station and FreeSpeak II at Itaka Arena in Poland

Clear-Com has announced the deployment of its intercom solutions at Itaka Arena ...

03/06/2026

Scott Coker Announces Six Executive Hires for New MMA Promotion

Scott Coker has announced six senior executive appointments for his new global MMA promotion, which launched earlier this year with $60 million in financing. Ad...

03/06/2026

Telemundo Announces Digital and Social Media Plans for FIFA World Cup 2026

Telemundo, the exclusive Spanish-language home of the FIFA World Cup 2026, has announced its digital and social media programming for the tournament, running Ju...

03/06/2026

Bundesliga Launches AI Assistant 'Captain' in Official App, Developed With AWS

The Bundesliga has announced the launch of Captain, an AI assistant built into t...

03/06/2026

Anthony James Partners Serving as Technology Consultant for UNC Kenan Stadium Modernization

Anthony James Partners (AJP) is serving as technology consultant for a moderniza...