Sony Pixel Power calrec Sony

NVIDIA NIM Microservices Now Available to Streamline Agentic Workflows on RTX AI PCs and Workstations

25/03/2025

Generative AI is unlocking new capabilities for PCs and workstations, including game assistants, enhanced content-creation and productivity tools and more.

NVIDIA NIM microservices, available now, and AI Blueprints, coming in April, accelerate AI development and improve its accessibility. Announced at the CES trade show in January, NVIDIA NIM provides prepackaged, state-of-the-art AI models optimized for the NVIDIA RTX platform, including the NVIDIA GeForce RTX 50 Series and, now, the new NVIDIA Blackwell RTX PRO GPUs. The microservices are easy to download and run. They span the top modalities for PC development and are compatible with top ecosystem applications and tools.

The experimental System Assistant feature of Project G-Assist was also released today. Project G-Assist showcases how AI assistants can enhance apps and games. The System Assistant allows users to run real-time diagnostics, get recommendations on performance optimizations, or control system software and peripherals - all via simple voice or text commands. Developers and enthusiasts can extend its capabilities with a simple plug-in architecture and new plug-in builder.

Amid a pivotal moment in computing - where groundbreaking AI models and a global developer community are driving an explosion in AI-powered tools and workflows - NIM microservices, AI Blueprints and G-Assist are helping bring key innovations to PCs. This RTX AI Garage blog series will continue to deliver updates, insights and resources to help developers and enthusiasts build the next wave of AI on RTX AI PCs and workstations.

Ready, Set, NIM! Though the pace of innovation with AI is incredible, it can still be difficult for the PC developer community to get started with the technology.

Bringing AI models from research to the PC requires curation of model variants, adaptation to manage all of the input and output data, and quantization to optimize resource usage. In addition, models must be converted to work with optimized inference backend software and connected to new AI application programming interfaces (APIs). This takes substantial effort, which can slow AI adoption.

NVIDIA NIM microservices help solve this issue by providing prepackaged, optimized, easily downloadable AI models that connect to industry-standard APIs. They're optimized for performance on RTX AI PCs and workstations, and include the top AI models from the community, as well as models developed by NVIDIA.

NIM microservices support a range of AI applications, including large language models (LLMs), vision language models, image generation, speech processing, retrieval-augmented generation (RAG)-based search, PDF extraction and computer vision. Ten NIM microservices for RTX are available, supporting a range of applications, including language and image generation, computer vision, speech AI and more. Get started with these NIM microservices today:

Language and Reasoning: Deepseek-R1-distill-llama-8B, Mistral-nemo-12B-instruct, Llama3.1-8B-instruct

Image Generation: Flux.dev

Audio: Riva Parakeet-ctc-0.6B-asr, Maxine Studio Voice

RAG: Llama-3.2-NV-EmbedQA-1B-v2

Computer Vision and Understanding: NV-CLIP, PaddleOCR, Yolo-X-v1

NIM microservices are also available through top AI ecosystem tools and frameworks.

For AI enthusiasts, AnythingLLM and ChatRTX now support NIM, making it easy to chat with LLMs and AI agents through a simple, user-friendly interface. With these tools, users can create personalized AI assistants and integrate their own documents and data, helping automate tasks and enhance productivity.

For developers looking to build, test and integrate AI into their applications, FlowiseAI and Langflow now support NIM and offer low- and no-code solutions with visual interfaces to design AI workflows with minimal coding expertise. Support for ComfyUI is coming soon. With these tools, developers can easily create complex AI applications like chatbots, image generators and data analysis systems.

In addition, Microsoft VS Code AI Toolkit, CrewAI and Langchain now support NIM and provide advanced capabilities for integrating the microservices into application code, helping ensure seamless integration and optimization.

Visit the NVIDIA technical blog and build.nvidia.com to get started.

NVIDIA AI Blueprints Will Offer Pre-Built Workflows NVIDIA AI Blueprints, coming in April, give AI developers a head start in building generative AI workflows with NVIDIA NIM microservices.

Blueprints are ready-to-use, extensible reference samples that bundle everything needed - source code, sample data, documentation and a demo app - to create and customize advanced AI workflows that run locally. Developers can modify and extend AI Blueprints to tweak their behavior, use different models or implement completely new functionality.

PDF to podcast AI Blueprint coming soon. The PDF to podcast AI Blueprint will transform documents into audio content so users can learn on the go. By extracting text, images and tables from a PDF, the workflow uses AI to generate an informative podcast. For deeper dives into topics, users can then have an interactive discussion with the AI-powered podcast hosts.

The AI Blueprint for 3D-guided generative AI will give artists finer control over image generation. While AI can generate amazing images from simple text prompts, controlling image composition using only words can be challenging. With this blueprint, creators can use simple 3D objects laid out in a 3D renderer like Blender to guide AI image generation. The artist can create 3D assets by hand or generate them using AI, place them in the scene and set the 3D viewport camera. Then, a prepackaged workflow powered by the FLUX NIM microservice will use the current composition to generate high-quality images that match the 3D scene.

NVIDIA NIM on RTX With Windows Subsystem for Linux One of the key tech
LINK: https://blogs.nvidia.com/blog/rtx-ai-garage-nim-blueprints-g-assist/...
See more stories from nvidia

More from Nvidia

30/04/2025

From Kitchen to Drive-Thru: How Yum! Brands Is Accelerating Restaurant Innovation With AI

The quick-service restaurant (QSR) industry is being reinvented by AI. For exam...

30/04/2025

Control the Composition of AI-Generated Images With the NVIDIA AI Blueprint for 3D-Guided Generative AI

AI-powered image generation has progressed at a remarkable pace - from early exa...

28/04/2025

NVIDIA Brings Cybersecurity to Every AI Factory

As enterprises increasingly adopt AI, securing AI factories - where complex, agentic workflows are executed - has never been more critical. NVIDIA is bringing ...

28/04/2025

How Agentic AI Enables the Next Leap in Cybersecurity

Agentic AI is redefining the cybersecurity landscape - introducing new opportunities that demand rethinking how to secure AI while offering the keys to addressi...

28/04/2025

Oracle Cloud Infrastructure Deploys Thousands of NVIDIA Blackwell GPUs for Agentic AI and Reasoning Models

Oracle has stood up and optimized its first wave of liquid-cooled NVIDIA GB200 N...

24/04/2025

NVIDIA Research at ICLR - Pioneering the Next Wave of Multimodal Generative AI

Advancing AI requires a full-stack approach, with a powerful foundation of computing infrastructure - including accelerated processors and networking technologi...

24/04/2025

All Roads Lead Back to Oblivion: Bethesda's The Elder Scrolls IV: Oblivion Remastered' Arrives on GeForce NOW

Get the controllers ready and clear the calendar - it's a jam-packed GFN Thu...

23/04/2025

How the Economics of Inference Can Maximize AI Value

As AI models evolve and adoption grows, enterprises must perform a delicate balancing act to achieve maximum value. That's because inference - the process ...

23/04/2025

Capital One Banks on AI for Financial Services

Financial services has long been at the forefront of adopting technological innovations. Today, generative AI and agentic systems are redefining the industry, f...

23/04/2025

Project G-Assist Plug-In Builder Lets Anyone Customize AI on GeForce RTX AI PCs

AI is rapidly reshaping what's possible on a PC - whether for real-time image generation or voice-controlled workflows. As AI capabilities grow, so does the...

23/04/2025

Enterprises Onboard AI Teammates Faster With NVIDIA NeMo Tools to Scale Employee Productivity

An AI agent is only as accurate, relevant and timely as the data that powers it....

22/04/2025

Keeping AI on the Planet: NVIDIA Technologies Make Every Day About Earth Day

Whether at sea, land or in the sky - even outer space - NVIDIA technology is helping research scientists and developers alike explore and understand oceans, wil...

22/04/2025

Chill Factor: NVIDIA Blackwell Platform Boosts Water Efficiency by Over 300x

Traditionally, data centers have relied on air cooling - where mechanical chillers circulate chilled air to absorb heat from servers, helping them maintain opti...

22/04/2025

Making Brain Waves: AI Startup Speeds Disease Research With Lab in the Loop

About 15% of the world's population - over a billion people - are affected by neurological disorders, from commonly known diseases like Alzheimer's and ...

17/04/2025

AI Bites Back: Researchers Develop Model to Detect Malaria Amid Venezuelan Gold Rush

Gold prospecting in Venezuela has led to a malaria resurgence, but researchers h...

17/04/2025

Spring Into Action With 11 New Games on GeForce NOW

As the days grow longer and the flowers bloom, GFN Thursday brings a fresh lineup of games to brighten the week. Dive into thrilling hunts and dark fantasy adv...

16/04/2025

Isomorphic Labs Rethinks Drug Discovery With AI

Isomorphic Labs is reimagining the drug discovery process with an AI-first approach. At the heart of this work is a new way of thinking about biology. Max Jade...

16/04/2025

Into the Omniverse: How Digital Twins Are Scaling Industrial AI

Editor's note: This post is part of Into the Omniverse, a series focused on how developers, 3D practitioners, and enterprises can transform their workflows ...

15/04/2025

Math Test? No Problems: NVIDIA Team Scores Kaggle Win With Reasoning Model

The final days of the AI Mathematical Olympiad's latest competition were a transcontinental relay for team NVIDIA. Every evening, two team members on oppos...

15/04/2025

Everywhere, All at Once: NVIDIA Drives the Next Phase of AI Growth

Every company and country wants to grow and create economic opportunity - but they need virtually limitless intelligence to do so. Working with its ecosystem pa...

15/04/2025

Thousands of NVIDIA Grace Blackwell GPUs Now Live at CoreWeave, Propelling Development for AI Pioneers

CoreWeave today became one of the first cloud providers to bring NVIDIA GB200 NV...

14/04/2025

NVIDIA to Manufacture American-Made AI Supercomputers in US for First Time

NVIDIA is working with its manufacturing partners to design and build factories that, for the first time, will produce NVIDIA AI supercomputers entirely in the ...

11/04/2025

Beyond CAD: How nTop Uses AI and Accelerated Computing to Enhance Product Design

As a teenager, Bradley Rothenberg was obsessed with CAD: computer-aided design software. Before he turned 30, Rothenberg channeled that interest into building ...

10/04/2025

NVIDIA Celebrates Partners of the Year Advancing AI in Europe, Middle East and Africa

NVIDIA this week recognized the contributions of partners in Europe, the Middle ...

10/04/2025

(AI)ways a Cut Above: GeForce RTX 50 Series Accelerates New DaVinci Resolve 20 Studio Video Editing Software

As AI-powered tools continue to evolve, NVIDIA GeForce RTX 50 Series and NVIDIA ...

10/04/2025

Myth and Mystery Await: GeForce NOW Brings South of Midnight' to the Cloud at Launch

Get ready to explore the Deep South. South of Midnight, the action-adventure gam...

09/04/2025

Black Women in Artificial Intelligence' Founder Talks AI Education and Empowerment

Necessity is the mother of invention. And sometimes, what a person really needs ...

09/04/2025

NVIDIA Brings Agentic AI Reasoning to Enterprises With Google Cloud

NVIDIA is collaborating with Google Cloud to bring agentic AI to enterprises seeking to locally harness the Google Gemini family of AI models using the NVIDIA B...

06/04/2025

National Robotics Week - Latest Physical AI Research, Breakthroughs and Resources

This National Robotics Week, NVIDIA highlighted the pioneering technologies that...

03/04/2025

Nintendo Switch 2 Leveled Up With NVIDIA AI-Powered DLSS and 4K Gaming

The Nintendo Switch 2, unveiled April 2, takes performance to the next level, powered by a custom NVIDIA processor featuring an NVIDIA GPU with dedicated RT Cor...

03/04/2025

NVIDIA Showcases Real-Time AI and Intelligent Media Workflows at NAB

Real-time AI is unlocking new possibilities in media and entertainment, improving viewer engagement and advancing intelligent content creation. At NAB Show, a...

03/04/2025

From Browsing to Buying: How AI Agents Enhance Online Shopping

Editor's note: This post is part of the AI On blog series, which explores the latest techniques and real-world applications of agentic AI, chatbots and copi...

03/04/2025

No Foolin': GeForce NOW Gets 21 Games in April

GeForce NOW isn't fooling around. This month, 21 games are joining the cloud gaming library of over 2,000 titles. Whether chasing epic adventures, testing ...

02/04/2025

Speed Demon: NVIDIA Blackwell Takes Pole Position in Latest MLPerf Inference Results

In the latest MLPerf Inference V5.0 benchmarks, which reflect some of the most c...

02/04/2025

NVIDIA's Jacob Liberman on Bringing Agentic AI to Enterprises

AI is rapidly transforming how organizations solve complex challenges. The early stages of enterprise AI adoption focused on using large language models to cre...

02/04/2025

NVIDIA GeForce RTX 50 Series Accelerates Adobe Premiere Pro and Media Encoder's 4:2:2 Color Sampling

Video editing workflows are getting a lot more colorful. Adobe recently announc...

31/03/2025

Industrial Ecosystem Adopts Mega NVIDIA Omniverse Blueprint to Train Physical AI in Digital Twins

Advances in physical AI are enabling organizations to embrace embodied AI across...

27/03/2025

The Dream Life Awaits: Play inZOI' on GeForce NOW Anytime, Anywhere

A new resident is moving into the cloud - KRAFTON's inZOI joins the 2,000+ games in the GeForce NOW cloud gaming library. Plus, members can get ready for a...

26/03/2025

Buzz Solutions Uses Vision AI to Supercharge the Electric Grid

The reliability of the electric grid is critical. From handling demand surges and evolving power needs to preventing infrastructure failures that can cause wil...

25/03/2025

NVIDIA NIM Microservices Now Available to Streamline Agentic Workflows on RTX AI PCs and Workstations

Generative AI is unlocking new capabilities for PCs and workstations, including ...

20/03/2025

EPRI, NVIDIA and Collaborators Launch Open Power AI Consortium to Transform the Future of Energy

The power and utilities sector keeps the lights on for the world's populatio...

20/03/2025

Assassin's Creed Shadows' Emerges From the Mist on GeForce NOW

Time to sharpen the blade. GeForce NOW brings a legendary addition to the cloud: Ubisoft's highly anticipated Assassin's Creed Shadows is now available ...

19/03/2025

Innovation to Impact: How NVIDIA Research Fuels Transformative Work in AI, Graphics and Beyond

The roots of many of NVIDIA's landmark innovations - the foundational techno...

19/03/2025

NVIDIA Blackwell Powers Real-Time AI for Entertainment Workflows

AI has been shaping the media and entertainment industry for decades, from early recommendation engines to AI-driven editing and visual effects automation. Real...

19/03/2025

NVIDIA Honors Americas Partners Advancing Agentic and Physical AI

NVIDIA this week recognized 14 partners leading the way across the Americas for their work advancing agentic and physical AI across industries. The 2025 Americ...

18/03/2025

AI on the Menu: Yum! Brands and NVIDIA Partner to Accelerate Restaurant Industry Innovation

The quick-service restaurant industry is a marvel of modern logistics, where spe...

18/03/2025

Telecom Leaders Call Up Agentic AI to Improve Network Operations

Global telecommunications networks can support millions of user connections per day, generating more than 3,800 terabytes of data per minute on average. That m...

18/03/2025

NVIDIA Aerial Expands With New Tools for Building AI-Native Wireless Networks

The telecom industry is increasingly embracing AI to deliver seamless connections - even in conditions of poor signal strength - while maximizing sustainability...

18/03/2025

From AT&T to the United Nations, AI Agents Redefine Work With NVIDIA AI Enterprise

AI agents are transforming work, delivering time and cost savings by helping peo...

18/03/2025

Full Steam Ahead: NVIDIA-Certified Program Expands to Enterprise Storage for Faster AI Factory Deployment

AI deployments thrive on speed, data and scale. That's why NVIDIA is expandi...