Sony Pixel Power calrec Sony

NVIDIA NIM Microservices Now Available to Streamline Agentic Workflows on RTX AI PCs and Workstations

25/03/2025

Generative AI is unlocking new capabilities for PCs and workstations, including game assistants, enhanced content-creation and productivity tools and more.

NVIDIA NIM microservices, available now, and AI Blueprints, coming in April, accelerate AI development and improve its accessibility. Announced at the CES trade show in January, NVIDIA NIM provides prepackaged, state-of-the-art AI models optimized for the NVIDIA RTX platform, including the NVIDIA GeForce RTX 50 Series and, now, the new NVIDIA Blackwell RTX PRO GPUs. The microservices are easy to download and run. They span the top modalities for PC development and are compatible with top ecosystem applications and tools.

The experimental System Assistant feature of Project G-Assist was also released today. Project G-Assist showcases how AI assistants can enhance apps and games. The System Assistant allows users to run real-time diagnostics, get recommendations on performance optimizations, or control system software and peripherals - all via simple voice or text commands. Developers and enthusiasts can extend its capabilities with a simple plug-in architecture and new plug-in builder.

Amid a pivotal moment in computing - where groundbreaking AI models and a global developer community are driving an explosion in AI-powered tools and workflows - NIM microservices, AI Blueprints and G-Assist are helping bring key innovations to PCs. This RTX AI Garage blog series will continue to deliver updates, insights and resources to help developers and enthusiasts build the next wave of AI on RTX AI PCs and workstations.

Ready, Set, NIM! Though the pace of innovation with AI is incredible, it can still be difficult for the PC developer community to get started with the technology.

Bringing AI models from research to the PC requires curation of model variants, adaptation to manage all of the input and output data, and quantization to optimize resource usage. In addition, models must be converted to work with optimized inference backend software and connected to new AI application programming interfaces (APIs). This takes substantial effort, which can slow AI adoption.

NVIDIA NIM microservices help solve this issue by providing prepackaged, optimized, easily downloadable AI models that connect to industry-standard APIs. They're optimized for performance on RTX AI PCs and workstations, and include the top AI models from the community, as well as models developed by NVIDIA.

NIM microservices support a range of AI applications, including large language models (LLMs), vision language models, image generation, speech processing, retrieval-augmented generation (RAG)-based search, PDF extraction and computer vision. Ten NIM microservices for RTX are available, supporting a range of applications, including language and image generation, computer vision, speech AI and more. Get started with these NIM microservices today:

Language and Reasoning: Deepseek-R1-distill-llama-8B, Mistral-nemo-12B-instruct, Llama3.1-8B-instruct

Image Generation: Flux.dev

Audio: Riva Parakeet-ctc-0.6B-asr, Maxine Studio Voice

RAG: Llama-3.2-NV-EmbedQA-1B-v2

Computer Vision and Understanding: NV-CLIP, PaddleOCR, Yolo-X-v1

NIM microservices are also available through top AI ecosystem tools and frameworks.

For AI enthusiasts, AnythingLLM and ChatRTX now support NIM, making it easy to chat with LLMs and AI agents through a simple, user-friendly interface. With these tools, users can create personalized AI assistants and integrate their own documents and data, helping automate tasks and enhance productivity.

For developers looking to build, test and integrate AI into their applications, FlowiseAI and Langflow now support NIM and offer low- and no-code solutions with visual interfaces to design AI workflows with minimal coding expertise. Support for ComfyUI is coming soon. With these tools, developers can easily create complex AI applications like chatbots, image generators and data analysis systems.

In addition, Microsoft VS Code AI Toolkit, CrewAI and Langchain now support NIM and provide advanced capabilities for integrating the microservices into application code, helping ensure seamless integration and optimization.

Visit the NVIDIA technical blog and build.nvidia.com to get started.

NVIDIA AI Blueprints Will Offer Pre-Built Workflows NVIDIA AI Blueprints, coming in April, give AI developers a head start in building generative AI workflows with NVIDIA NIM microservices.

Blueprints are ready-to-use, extensible reference samples that bundle everything needed - source code, sample data, documentation and a demo app - to create and customize advanced AI workflows that run locally. Developers can modify and extend AI Blueprints to tweak their behavior, use different models or implement completely new functionality.

PDF to podcast AI Blueprint coming soon. The PDF to podcast AI Blueprint will transform documents into audio content so users can learn on the go. By extracting text, images and tables from a PDF, the workflow uses AI to generate an informative podcast. For deeper dives into topics, users can then have an interactive discussion with the AI-powered podcast hosts.

The AI Blueprint for 3D-guided generative AI will give artists finer control over image generation. While AI can generate amazing images from simple text prompts, controlling image composition using only words can be challenging. With this blueprint, creators can use simple 3D objects laid out in a 3D renderer like Blender to guide AI image generation. The artist can create 3D assets by hand or generate them using AI, place them in the scene and set the 3D viewport camera. Then, a prepackaged workflow powered by the FLUX NIM microservice will use the current composition to generate high-quality images that match the 3D scene.

NVIDIA NIM on RTX With Windows Subsystem for Linux One of the key tech
LINK: https://blogs.nvidia.com/blog/rtx-ai-garage-nim-blueprints-g-assist/...
See more stories from nvidia

North America Stories

08/05/2025

What to Watch: 6 Sundance Institute-Supported Films by Filipino Directors

A sinister fairy infiltrates a desperate family in Kenneth Dagatan's In My Mother's Skin, which premiered at the 2023 Sundance Film Festival. Photo co...

08/05/2025

Managing the Mission: Teaching Technique to C3ISR Operators

For skyward-bound operators, training focuses on the unique aspects of flying ISR missions, including the management of onboard surveillance equipment and the e...

08/05/2025

Cable Industry Backs Broadcasters' Move to Software-Based EAS

The cable industry has told the Federal Communications Commission it supports the National Association of Broadcasters' proposal to allow broadcasters to us...

08/05/2025

CTA Tells FCC: Dont Mandate ATSC 3.0 Tuners

WASHINGTON The Consumer Technology Association has continued its opposition to mandates requiring that NextGen TV/ATSC 3.0 tuners be included in new TV sets, sa...

08/05/2025

TAG Video Systems Appoints Paul Maroni as Vice President...

TAG Video Systems, the leader in software-based IP end-to-end workflow monitoring, deep probing, and real time visualization, has named Paul Maroni as Vice Pres...

08/05/2025

BroadcastAsia 2025 Showcases Best of British Innovation

This year's UK Pavilion in hall 5, once again managed by Tradefair, will provide visitors with the unique opportunity to discuss and be involved in cutting ...

08/05/2025

Rohde & Schwarz to highlight innovative broadcast technol...

Rohde & Schwarz will showcase its latest energy-efficient transmitters and 5G Broadcast technologies, designed to support network operators and content provider...

08/05/2025

Nexstar Appoints Bill Nardi VP of Station Operations

IRVING, Texas Nexstar Media Group has tapped Bill Nardi as vice president of station operations, responsible for overseeing the day-to-day broadcast operations ...

08/05/2025

LumaTouch Partners With CNN Academy on Training

SEATTLE LumaTouch is partnering with CNN Academy to improve mobile storytelling techniques and support training across all of CNN Academy's training simulat...

08/05/2025

SBE Backs NAB Proposals to Change EAS Rules

WASHINGTON The Society of Broadcast Engineers has filed comments with the Federal Communications Commission that support a proposal by the National Association ...

08/05/2025

OAN to Provide News to VOA, USAGM Networks

Senior adviser to the United States Agency for Global Media Kari Lake has announced that One America News Network (OAN) will provide newsfeed services for fre...

08/05/2025

EdMon Expands as AI-Driven Post Production Workflows Gains Traction in Sweden and Beyond

EdMon Expands as AI-Driven Post Production Workflows Gains Traction in Sweden an...

08/05/2025

Using Luma Mattes in Adobe Premiere Pro

Using Luma Mattes in Adobe Premiere Pro Graham Quince May 7, 2025 0 Comments This very quick tutorial shows you how to take an RGB clip and apply its ...

08/05/2025

OpenDrives Unveils Free Your Data' Initiative with New Astraeus Cloud-Native Data Services Platform

OpenDrives Unveils Free Your Data' Initiative with New Astraeus Cloud-Nativ...

08/05/2025

Student Spotlight: Grigori Balasanyan

Student Spotlight: Grigori Balasanyan The Armenian composer, who was named Boston Conservatory at Berklees 2025 student commencement speaker, talks about his ...

08/05/2025

Tribeca Festival 2025 Unveils New Premieres Spanning Film and Music

May 8th, 2025 Press Materials Available Here Tribeca Festival 2025 Unveils New Premieres Spanning Film and Music Slick Rick's Victory with Idris Elba a...

08/05/2025

Tribeca Festival 2025 Announces Lineup for Inaugural Storytelling Summit

May 8th, 2025 Press Materials Available Here Tribeca Festival 2025 Announces Lineup for Inaugural Storytelling Summit 11-Day Industry Event Launches with Tal...

08/05/2025

SVG Sit-Down: Vizrt's Nicholas Jameson on AI in Workflows, Pushing Boundaries With XR/AR

SVG Sit-Down: Vizrt's Nicholas Jameson on AI in Workflows, Pushing Boundarie...

08/05/2025

Creating Alternative Brand Experiences: Live Sports in the Age of Fortnite, Meta Horizon, and Beyond

Creating Alternative Brand Experiences: Live Sports in the Age of Fortnite, Meta...

08/05/2025

PGA TOUR's David Piccolo: Advanced Graphics and Virtual Production Tools are Elevating Live Golf Coverage

PGA TOUR's David Piccolo: Advanced Graphics and Virtual Production Tools are...

08/05/2025

Tech Focus: Advancing Immersion in Sports Broadcasting with AR and Virtual Production

Tech Focus: Advancing Immersion in Sports Broadcasting with AR and Virtual Produ...

08/05/2025

Now in Production: Comedy Action Film Husbands in Action' Puts Unlikely Allies on a Rescue Mission

Back to All News Now in Production: Comedy Action Film Husbands in Action'...

08/05/2025

Wildfire Prevention: AI Startups Support Prescribed Burns, Early Alerts

Artificial intelligence is helping identify and treat diseases faster with better results for humankind. Natural disasters like wildfires are next. Fires in th...

08/05/2025

Join the Family: GeForce NOW Welcomes 2K's Acclaimed Mafia' Franchise to the Cloud

Calling all wiseguys - 2K's acclaimed Mafia franchise is available to stream...

08/05/2025

LM Studio Accelerates LLM Performance With NVIDIA GeForce RTX GPUs and CUDA 12.8

As AI use cases continue to expand - from document summarization to custom software agents - developers and enthusiasts are seeking faster, more flexible ways t...

07/05/2025

March 2025 Less Time Spent Watching Video

Warsaw, Poland - April 28, 2025 - Nielsen, a global leader in audience measurement, data and analytics, has released its latest March All Screens Video Landscap...

07/05/2025

Studios Delay Moving Films to Streaming to Protect Box Office

LONDON Movie fans hoping to save money by waiting until their favorite new films appear on streaming services will have to wait a bit longer now, according to a...

07/05/2025

Saudi Broadcasting Authority Turns to Grass Valley for Major Tech Upgrade

MECCA, Saudi Arabia Saudi Broadcasting Authority (SBA) has selected Grass Valley to provide a major technology upgrade of its broadcast facility here....

07/05/2025

Sony and Nevion provide guidance on IP network architecture options for live production in new whitepaper

Sony and Nevion provide guidance on IP network architecture options for live pro...

07/05/2025

Media Pioneer Publishing AG Expands Editorial Capacity

Media Pioneer Publishing AG Expands Editorial Capacity Brie Clayton May 7, 2025 0 Comments Pioneer 2 boat production environment powered by Blackmagic...

07/05/2025

Studios Delaying Moving Films to Streaming to Protect Box Office

LONDON Movie fans hoping to save money by waiting until their favorite new films appear on streaming services will have to wait a bit longer now, according to a...

07/05/2025

FCC Seeks Comments on LPTV Adoption of 5G Broadcasting

WASHINGTON The Federal Communications Commission's Media Bureau is seeking public comment on a Petition for Rulemaking from HC2 Broadcasting Holdings asking...

07/05/2025

U.S. Department of Education Terminates CPB's Ready to Learn Grant

WASHINGTON Following a decision by U.S. Department of Education to terminate its 2020-2025 Ready To Learn to the Corporation for Public Broadcasting, CPB has in...

07/05/2025

Tubi Announces New Interactive Ad Formats

NEW YORK Fox's ad-supported streaming Tubi made a series of product and partnership announcements during IAB NewFronts in New York, including the launch of ...

07/05/2025

The GFiber App Gets an Upgrade

MOUNTAIN VIEW, Calif. Google Fiber (GFiber) has announced a redesigned app that the company said will simplify how customers set up service, manage devices, and...

07/05/2025

NASA+ Launches FAST Channel on Prime Video

WASHINGTON NASAs on-demand streaming service, NASA+, has launched a FAST (Free Ad-Supported Television) channel on Prime Video....

07/05/2025

The WNET Group Names Randall T. Decker Senior Director, Technology

NEW YORK The WNET Group, parent company of the PBS station Thirteen, has announced the appointment of Randall T. Decker to senior director, technology, effectiv...

07/05/2025

Peter Barber appointed new Chief Executive Officer at Ato...

Atomos announced an executive leadership transition as the Company continues to evolve and expand its strategic focus. Peter Barber, currently serving as Chie...

07/05/2025

Steadicam Vol Honored with AMPAS 2025 Scientific and Tech...

Steve Wagner, Jerry Holway and Robert Orf at the 2024 Scientific and Technical Awards at the Academy Museum of Motion Pictures on Tuesday, April 29, 2025. The ...

07/05/2025

nxtedition and TASCAM bring precision audio control to TV...

nxtedition, the Swedish company behind the leading integrated platform for news and program production, and TASCAM, the iconic Japanese manufacturer of professi...

07/05/2025

Signiant Brings Real-Time Camera Raw-to-Cloud Innovation...

Signiant is bringing its Camera-Raw-to-Any-Cloud workflow to the UK for the first time at the Media Production & Technology Show 2025 (Booth# M69) with a live d...

07/05/2025

MNC Software extends its global reach with Gencom Technol...

MNC Software Inc., a global leader in software and network solutions tailored to the broadcast and media industry, has appointed Gencom Technology as an officia...

07/05/2025

Rise AV Announces Inaugural UK Cohort for 2025 Mentoring...

Rise AV, the award-winning advocacy group championing gender diversity and professional development in the AV sector, is proud to announce 31 mentor-mentee pair...

07/05/2025

Leader to show Test and Measurement solutions for workflo...

Test & measurement innovator, Leader Electronics of Europe, is to bring a selection of its leading products for IP, SDI and hybrid workflow requirements to this...

07/05/2025

World Skills Cafe Returns at IBC2025 with Expanded Talent...

The Global Media and Entertainment Talent Manifesto announces that the World Skills Caf will return at IBC2025 with an expanded skills and diversity programme,...

07/05/2025

Moments Lab and LucidLink Expand AI-Powered Workflow Inte...

Moments Lab, a leader in AI video discovery, and LucidLink, the pioneer in real-time cloud collaboration, are proud to announce the integration of Moments Lab&#...

07/05/2025

Obvious C Broadcasts Skiing World Cup with Blackmagic Design

Obvious C Broadcasts Skiing World Cup with Blackmagic Design Brie Clayton May 6, 2025 0 Comments Blackmagic Design cameras capture cinematic sports pr...

07/05/2025

Larry Jordan Interviews Signiant's Jon Finegold at NAB 2025

Larry Jordan Interviews Signiant's Jon Finegold at NAB 2025 Brie Clayton May 6, 2025 0 Comments Jon Finegold, Chief Marketing Officer at Signiant,...

07/05/2025

Cadence Taps NVIDIA Blackwell to Accelerate AI-Driven Engineering Design and Scientific Simulation

A new supercomputer offered by Cadence, a leading provider of technology for ele...