Sony Pixel Power calrec Sony

NVIDIA NIM Microservices Now Available to Streamline Agentic Workflows on RTX AI PCs and Workstations

25/03/2025

Generative AI is unlocking new capabilities for PCs and workstations, including game assistants, enhanced content-creation and productivity tools and more.

NVIDIA NIM microservices, available now, and AI Blueprints, coming in April, accelerate AI development and improve its accessibility. Announced at the CES trade show in January, NVIDIA NIM provides prepackaged, state-of-the-art AI models optimized for the NVIDIA RTX platform, including the NVIDIA GeForce RTX 50 Series and, now, the new NVIDIA Blackwell RTX PRO GPUs. The microservices are easy to download and run. They span the top modalities for PC development and are compatible with top ecosystem applications and tools.

The experimental System Assistant feature of Project G-Assist was also released today. Project G-Assist showcases how AI assistants can enhance apps and games. The System Assistant allows users to run real-time diagnostics, get recommendations on performance optimizations, or control system software and peripherals - all via simple voice or text commands. Developers and enthusiasts can extend its capabilities with a simple plug-in architecture and new plug-in builder.

Amid a pivotal moment in computing - where groundbreaking AI models and a global developer community are driving an explosion in AI-powered tools and workflows - NIM microservices, AI Blueprints and G-Assist are helping bring key innovations to PCs. This RTX AI Garage blog series will continue to deliver updates, insights and resources to help developers and enthusiasts build the next wave of AI on RTX AI PCs and workstations.

Ready, Set, NIM! Though the pace of innovation with AI is incredible, it can still be difficult for the PC developer community to get started with the technology.

Bringing AI models from research to the PC requires curation of model variants, adaptation to manage all of the input and output data, and quantization to optimize resource usage. In addition, models must be converted to work with optimized inference backend software and connected to new AI application programming interfaces (APIs). This takes substantial effort, which can slow AI adoption.

NVIDIA NIM microservices help solve this issue by providing prepackaged, optimized, easily downloadable AI models that connect to industry-standard APIs. They're optimized for performance on RTX AI PCs and workstations, and include the top AI models from the community, as well as models developed by NVIDIA.

NIM microservices support a range of AI applications, including large language models (LLMs), vision language models, image generation, speech processing, retrieval-augmented generation (RAG)-based search, PDF extraction and computer vision. Ten NIM microservices for RTX are available, supporting a range of applications, including language and image generation, computer vision, speech AI and more. Get started with these NIM microservices today:

Language and Reasoning: Deepseek-R1-distill-llama-8B, Mistral-nemo-12B-instruct, Llama3.1-8B-instruct

Image Generation: Flux.dev

Audio: Riva Parakeet-ctc-0.6B-asr, Maxine Studio Voice

RAG: Llama-3.2-NV-EmbedQA-1B-v2

Computer Vision and Understanding: NV-CLIP, PaddleOCR, Yolo-X-v1

NIM microservices are also available through top AI ecosystem tools and frameworks.

For AI enthusiasts, AnythingLLM and ChatRTX now support NIM, making it easy to chat with LLMs and AI agents through a simple, user-friendly interface. With these tools, users can create personalized AI assistants and integrate their own documents and data, helping automate tasks and enhance productivity.

For developers looking to build, test and integrate AI into their applications, FlowiseAI and Langflow now support NIM and offer low- and no-code solutions with visual interfaces to design AI workflows with minimal coding expertise. Support for ComfyUI is coming soon. With these tools, developers can easily create complex AI applications like chatbots, image generators and data analysis systems.

In addition, Microsoft VS Code AI Toolkit, CrewAI and Langchain now support NIM and provide advanced capabilities for integrating the microservices into application code, helping ensure seamless integration and optimization.

Visit the NVIDIA technical blog and build.nvidia.com to get started.

NVIDIA AI Blueprints Will Offer Pre-Built Workflows NVIDIA AI Blueprints, coming in April, give AI developers a head start in building generative AI workflows with NVIDIA NIM microservices.

Blueprints are ready-to-use, extensible reference samples that bundle everything needed - source code, sample data, documentation and a demo app - to create and customize advanced AI workflows that run locally. Developers can modify and extend AI Blueprints to tweak their behavior, use different models or implement completely new functionality.

PDF to podcast AI Blueprint coming soon. The PDF to podcast AI Blueprint will transform documents into audio content so users can learn on the go. By extracting text, images and tables from a PDF, the workflow uses AI to generate an informative podcast. For deeper dives into topics, users can then have an interactive discussion with the AI-powered podcast hosts.

The AI Blueprint for 3D-guided generative AI will give artists finer control over image generation. While AI can generate amazing images from simple text prompts, controlling image composition using only words can be challenging. With this blueprint, creators can use simple 3D objects laid out in a 3D renderer like Blender to guide AI image generation. The artist can create 3D assets by hand or generate them using AI, place them in the scene and set the 3D viewport camera. Then, a prepackaged workflow powered by the FLUX NIM microservice will use the current composition to generate high-quality images that match the 3D scene.

NVIDIA NIM on RTX With Windows Subsystem for Linux One of the key tech
LINK: https://blogs.nvidia.com/blog/rtx-ai-garage-nim-blueprints-g-assist/...
See more stories from nvidia

North America Stories

21/04/2025

Give Me the Backstory: Get to Know Nadia Fall, the Director of Brides

By Lucy Spicer One of the most exciting things about the Sundance Film Festival is having a front-row seat for the bright future of independent filmmaking. Whi...

21/04/2025

Latest Nielsen data shows travel industry ad spend on the rise

Advertising investment up 9% YoY for travel and accommodationSydney - April 16, 2025 - Nielsen Ad Intel data shows that travel and accommodation has grown stron...

21/04/2025

Samsung Ads Launches Optimal Reach for Linear, AVOD

NEW YORK Samsung Ads, the advanced advertising division of Samsung Electronics, has announced the availability of its Optimal Reach solution for advertisers acr...

21/04/2025

Study: Vast Majority of U.S. TV Viewers Choose Streaming As Default Viewing Option

DENVER, Colo. A new survey highlights just how important streaming has become in...

21/04/2025

The Strength of Kindness: Collaborative Effort Helps Special Olympics World Winter Games Reach a Wider Audience

The strength of kindness: Collaborative effort helps Special Olympics World Wint...

21/04/2025

Nashville Juggles A Cornucopia Of Sports With Its Star on the Rise

Nashville Juggles A Cornucopia Of Sports With Its Star on the Rise NFL, NHL, MLS, MLB AAA, NASCAR want a place in Music City By Dan Daley, Audio Editor Monda...

21/04/2025

SVG Sit-Down: Telstra Broadcast Services CEO Karen Clark on the Challenge of Live Global Distribution

SVG Sit-Down: Telstra Broadcast Services CEO Karen Clark on the Challenge of Liv...

21/04/2025

Award Winning Producer/Director Don Mischer Dead at 85

Award Winning Producer/Director Don Mischer Dead at 85 By Ken Kerschbaumer, Editorial Director Monday, April 21, 2025 - 12:30 pm Print This Story | Subscr...

21/04/2025

The Fox Sports Way: How AR Graphics, XR Tech, and LED Displays Have Become Centerpieces of FOX Sports' Biggest Events

The Fox Sports Way: How AR Graphics, XR Tech, and LED Displays Have Become Cente...

19/04/2025

SDVI Earns Both Product and Project of the Year Awards at...

SDVI, the leading platform provider for cloud-native media supply chains, today announced that the company earned multiple awards at the 2025 NAB Show, with two...

19/04/2025

Ateliere Announces CEO Transition

Ateliere Creative Technologies, a leading GenAI media software solutions company, today announced that Dan Goman has stepped down as CEO and David Bortis, Ateli...

19/04/2025

Marshall CV574 Miniature 4K UHD Camera Revolutionizes Off...

As Director of Media and Aerial Production at Terrible Herbst Motorsports, Bryan Moore is setting new standards in off-road racing media coverage thanks to his ...

19/04/2025

Lightware Launches Dual Screen Extended Desktop Taurus

A next-generation collaboration device that redefines connectivity for meeting environments Lightware, an industry-leading manufacturer of signal management so...

19/04/2025

Calrec Wins 2025 NAB Show Product of the Year Award for N...

Calrec is today announcing that its True Control 2.0 is a Remote Production winner in the 2025 NAB Show Product of the Year Awards. This official awards program...

19/04/2025

Appear and NBCUniversal Win Project of the Year at NAB Sh...

Appear, a global leader in live production technology, proudly announces it has been recognised alongside NBCUniversal with the prestigious NAB Show Delivery Pr...

19/04/2025

Deity Microphones Announces The Deity THEOS DIFB at NAB 2...

Deity Microphones, a leader in innovative audio equipment, is proud to announce the expected release of our Ultra-Wide Band IFB to the market. The THEOS DIFB wi...

19/04/2025

LiveU IQ Technology Delivers Breakthrough Network Perform...

A world renowned broadcaster and long-standing LiveU customer has successfully completed a series of live connectivity tests using LiveU's revolutionary, aw...

19/04/2025

BitFire Wins 2025 NAB Show Project of the Year and Produc...

BitFire (bitfire.tv), a longtime leader in live video transport, today announced dual NAB Show award wins at the 2025 NAB Show in Las Vegas. The company's M...

19/04/2025

BitFire Wins Three Top Awards at 2025 NAB Show

BitFire (bitfire.tv), a longtime leader in live video transport, today announced three major award wins at the 2025 NAB Show, April 5-9, in Las Vegas. The compa...

19/04/2025

Moments Lab and Satisfaction Group Form Unique Strategic...

AI video discovery company Moments Lab and Satisfaction Group, a leading independent unscripted television production company, are proud to announce a unique st...

19/04/2025

The Infrastructure of Creative Flow DigitalGlues creative...

As the media industry navigates the triple challenge of AI-driven production, distributed teams, and skyrocketing content demand, DigitalGlue s creative.space h...

19/04/2025

Miri Technologies Wins Two Prestigious Awards for X510 Bo...

Network technology startup Miri Technologies Inc. capped off its tremendously successful NAB Show debut by winning two prestigious industry awards for its cutti...

19/04/2025

Tablo Adds 45 New FAST Channels From Warner Bros. Discovery

CINCINNATI Scripp's Nuvyyo USA has concluded a deal with Warner Bros. Discovery to bring 45 FAST channels to Nuvyyo's Tablo TV device....

19/04/2025

Court Overrules FCC's $57 Million Fine Against AT&T

In a ruling that could have broader implications on the legality of regulatory agencies levying fines through administrative proceedings, the 5th U.S. Circuit C...

19/04/2025

FCC Chair Carr Blasts Comcast Over MSNBC Coverage

WASHINGTON Federal Communications Commission chair Brendan Carr has blasted Comcast over MSNBC's coverage of the deportation of Kilmar Abrego Garcia in a so...

19/04/2025

Berklee NYC and NYC Media Launch Season 3 of Inside Power Station @BerkleeNYC

Berklee NYC and NYC Media Launch Season 3 of Inside Power Station @BerkleeNYC This season features faculty member Arun Pandian as the new host and interviews ...

18/04/2025

Everyone Is Cordially Invited to Celebrate Queer Joy in The Wedding Banquet

Director Andrew Ahn, alongside actors Youn Yuh-jung and Joan Chen, takes a photo of the audience after the premiere of his film The Wedding Banquet at Eccles ...

18/04/2025

U.S. Judge Rules Google Illegally Monopolized Ad Technologies

In a ruling that could have a major impact on the digital advertising market, a federal judge has ruled that Google has monopolized some types of advertising te...

18/04/2025

TV News Outlets See March Spike in Social Media Usage

Broadcast and cable TV news outlets saw strong social media growth in March, according to new data from the social video analytics company Tubular Labs ....

18/04/2025

Berklee Student Yukai Yang Named 2025 Yamaha Young Performing Artist

Berklee Student Yukai Yang Named 2025 Yamaha Young Performing Artist The drummer secured a spot among the elite winners in this years competition. By Maddie...

18/04/2025

Boston Conservatory Alums Bring Real Women Have Curves to Broadway

Boston Conservatory Alums Bring Real Women Have Curves to Broadway The Latin American immigrant community takes center stage in a new musical featuring Tatian...

18/04/2025

UPDATED: Broadcasters Urge FCC to Hit the Delete Button on Antiquated Regs

WASHINGTON The FCC's call for public comments and suggestions on outdated regulations that it should be eliminated, has prompted a slew of fillings from bro...

18/04/2025

Federal Judge Rules Google Illegally Monopolized Ad Technologies

In a ruling that could have a major impact on the digital advertising market, a federal judge has ruled that Google has monopolized some types of advertising te...

18/04/2025

AMS, VideoAmp Collaborate on Cross-Channel Targeting and Measurement

PEARL RIVER, N.Y. Global media solutions company Active Media Services (AMS) has formed a new relationship with VideoAmp, a measurement company for linear TV, c...

18/04/2025

Netflix Reports Strong Q1 Revenue, Operating Income

Netflix reported generally positive results for first-quarter 2025, with revenue up 13% year-over-year to $10.543 billion and operating income growing by 27% to...

18/04/2025

NHL Playoffs 2025: TNT Sports Hits the Road for Onsite Productions With Mobile Units from NEP Group, Game Creek Video

NHL Playoffs 2025: TNT Sports Hits the Road for Onsite Productions With Mobile U...

18/04/2025

EVS's Sbastien Verlaine on U.S. Expansion, Next-Generation Products

EVSs S bastien Verlaine on U.S. Expansion, Next-Generation Products Beyond replay, offerings also target asset management and media infrastructure By Ken Kersc...

18/04/2025

ESPN Unleashes 4DREPLAY as NCAA Women's Gymnastics Championships Hit ABC

ESPN Unleashes 4DREPLAY as NCAA Women's Gymnastics Championships Hit ABC Men's championships to follow Saturday night on ESPN2 By Brandon Costa, Direct...

18/04/2025

Visualizing Victory: The Latest in AR, XR, and Virtual Production in Live Sports

Visualizing Victory: The Latest in AR, XR, and Virtual Production in Live Sports This panel discussion featured leaders from ESPN, CBS Sports, Warner Bros. Disc...

18/04/2025

NHL Playoffs 2025: With 16 Games in First Six Days, ESPN Deploys Variety of Remote-Production Models in U.S., Canada

NHL Playoffs 2025: With 16 Games in First Six Days, ESPN Deploys Variety of Remo...

17/04/2025

The Ugly Stepsister: A Cinderella Body Horror Story That Will Leave a Crowd in Shambles

Emilie Blichfeldt attends the 2025 Sundance Film Festival premiere of The Ugly ...

17/04/2025

Why Resilient GPS (R-GPS) Matters for US Military Superiority: We Must Address GPS Vulnerabilities

R-GPS gives warfighters a decisive battlefield advantage by punching through adv...

17/04/2025

Roku to Collaborate with Adobe on Real-Time Customer Data

SAN JOSE, Calif. Roku and Adobe have announced that they are collaborating on a real time data platform made possible by a a new integration of the Roku Data C...

17/04/2025

IAB: Digital Ad Revenue Surges 14.9% YoY to $259 Billion in 2024

NEW YORK Internet advertising revenues demonstrated strong growth in 2024, increasing 14.9% year-over-year to $258.6 billion, according to the IAB Internet Adv...

17/04/2025

SDVI Earns Both Product and Project of the Year Awards at 2025 NAB Show

SDVI Earns Both Product and Project of the Year Awards at 2025 NAB Show Brie Clayton April 17, 2025 0 Comments Left to right, Geoff Stedman, CMO, SDVI...

17/04/2025

Singapore Polytechnic Readies Aspiring AV Professionals for Live IP Productions with AJA

Singapore Polytechnic Readies Aspiring AV Professionals for Live IP Productions ...

17/04/2025

Calrec Wins 2025 NAB Show Product of the Year Award for True Control 2.0

Calrec Wins 2025 NAB Show Product of the Year Award for True Control 2.0 Brie Clayton April 17, 2025 0 Comments Image: The Calrec True Control 2.o on ...

17/04/2025

In Return to Berklee, Lucius Looks Back and Moves Forward

In Return to Berklee, Lucius Looks Back and Moves Forward From mood boards to live demos, the alumni band gave students an exclusive look at the process behin...

17/04/2025

MyFree DirecTV Adds 8 NBCU Channels

DirecTV's free streaming service MyFree DirecTV has just added another eight channels from NBCUniversal....

17/04/2025

GameChanger Launches in the U.S.

LOS ANGELES The virtual production company GameChanger has announced that it is expanding its global footprint by bringing its virtual production technology to ...