
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible and showcases new hardware, software, tools and accelerations for NVIDIA RTX PC and workstation users.
The demand for tools to simplify and optimize generative AI development is skyrocketing. Applications based on retrieval-augmented generation (RAG) - a technique for enhancing the accuracy and reliability of generative AI models with facts fetched from specified external sources - and customized models are enabling developers to tune AI models to their specific needs.
While such work may have required a complex setup in the past, new tools are making it easier than ever.
NVIDIA AI Workbench simplifies AI developer workflows by helping users build their own RAG projects, customize models and more. It's part of the RTX AI Toolkit - a suite of tools and software development kits for customizing, optimizing and deploying AI capabilities - launched at COMPUTEX earlier this month. AI Workbench removes the complexity of technical tasks that can derail experts and halt beginners.
What Is NVIDIA AI Workbench? Available for free, NVIDIA AI Workbench enables users to develop, experiment with, test and prototype AI applications across GPU systems of their choice - from laptops and workstations to data center and cloud. It offers a new approach for creating, using and sharing GPU-enabled development environments across people and systems.
A simple installation gets users up and running with AI Workbench on a local or remote machine in just minutes. Users can then start a new project or replicate one from the examples on GitHub. Everything works through GitHub or GitLab, so users can easily collaborate and distribute work. Learn more about getting started with AI Workbench.
How AI Workbench Helps Address AI Project Challenges Developing AI workloads can require manual, often complex processes, right from the start.
Setting up GPUs, updating drivers and managing versioning incompatibilities can be cumbersome. Reproducing projects across different systems can require replicating manual processes over and over. Inconsistencies when replicating projects, like issues with data fragmentation and version control, can hinder collaboration. Varied setup processes, moving credentials and secrets, and changes in the environment, data, models and file locations can all limit the portability of projects.
AI Workbench makes it easier for data scientists and developers to manage their work and collaborate across heterogeneous platforms. It integrates and automates various aspects of the development process, offering:
Ease of setup: AI Workbench streamlines the process of setting up a developer environment that's GPU-accelerated, even for users with limited technical knowledge.
Seamless collaboration: AI Workbench integrates with version-control and project-management tools like GitHub and GitLab, reducing friction when collaborating.
Consistency when scaling from local to cloud: AI Workbench ensures consistency across multiple environments, supporting scaling up or down from local workstations or PCs to data centers or the cloud.
RAG for Documents, Easier Than Ever NVIDIA offers sample development Workbench Projects to help users get started with AI Workbench. The hybrid RAG Workbench Project is one example: It runs a custom, text-based RAG web application with a user's documents on their local workstation, PC or remote system.
Every Workbench Project runs in a container - software that includes all the necessary components to run the AI application. The hybrid RAG sample pairs a Gradio chat interface frontend on the host machine with a containerized RAG server - the backend that services a user's request and routes queries to and from the vector database and the selected large language model.
This Workbench Project supports a wide variety of LLMs available on NVIDIA's GitHub page. Plus, the hybrid nature of the project lets users select where to run inference.
Workbench Projects let users version the development environment and code. Developers can run the embedding model on the host machine and run inference locally on a Hugging Face Text Generation Inference server, on target cloud resources using NVIDIA inference endpoints like the NVIDIA API catalog, or with self-hosting microservices such as NVIDIA NIM or third-party services.
The hybrid RAG Workbench Project also includes:
Performance metrics: Users can evaluate how RAG- and non-RAG-based user queries perform across each inference mode. Tracked metrics include Retrieval Time, Time to First Token (TTFT) and Token Velocity.
Retrieval transparency: A panel shows the exact snippets of text - retrieved from the most contextually relevant content in the vector database - that are being fed into the LLM and improving the response's relevance to a user's query.
Response customization: Responses can be tweaked with a variety of parameters, such as maximum tokens to generate, temperature and frequency penalty.
To get started with this project, simply install AI Workbench on a local system. The hybrid RAG Workbench Project can be brought from GitHub into the user's account and duplicated to the local system.
More resources are available in the AI Decoded user guide. In addition, community members provide helpful video tutorials, like the one from Joe Freeman below.
Customize, Optimize, Deploy Developers often seek to customize AI models for specific use cases. Fine-tuning, a technique that changes the model by training it with additional data, can be useful for style transfer or changing model behavior. AI Workbench helps with fine-tuning, as well.
The Llama-factory AI Workbench Project enables QLoRa, a fine-tuning method that minimizes memory requirements, for a variety of models, as well as
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
30/07/2026
CP Communications provided RF audio, RF video, communications, RF coordination, ...
30/07/2026
OpenDrives has been included in CRN's 2026 Storage 100 list in the Software-Defined Storage category. The annual list, selected by the CRN editorial team, r...
30/07/2026
LATAM Airlines has selected SES to provide multi-orbit inflight connectivity to its fleet of Airbus and Embraer aircraft. More than 60 aircraft - including Airb...
30/07/2026
Tagboard has launched the Producer API, an open interface that allows key commands in Tagboard's live production environment to be triggered from external d...
30/07/2026
FOX Sports and the New York Racing Association (NYRA) have announced a multi-year agreement with Del Mar Thoroughbred Club that will make FOX Sports the exclusi...
30/07/2026
ABC Commercial has launched four free ad-supported streaming television (FAST) channels on LG Smart TVs across North America, Great Britain, and select countrie...
30/07/2026
The Six Kings Slam exhibition tennis tournament will return to Riyadh on October 21, 22, and 24, streaming live on Netflix at no additional cost to subscribers....
30/07/2026
Central Christian Church in Mt. Vernon, Illinois has deployed Clear-Com's LQ...
30/07/2026
Blackmagic Design has released the UltraStudio Express 3G family, a pair of USB4 capture and playback devices compatible with Mac, Windows, and Linux computers ...
30/07/2026
ESPN has reached a media rights agreement with the Women's Pro Baseball League (WPBL), making ESPN the national streaming home of the league's 2026 seas...
30/07/2026
Most Valuable Promotions (MVP) and the Professional Fighters League (PFL) have announced a merger that will operate under the MVP banner. PFL CEO John Martin wi...
30/07/2026
The Columbus Blue Jackets will simulcast all game broadcasts across television and radio beginning with the 2026-27 NHL season. Under the new format, the televi...
30/07/2026
TMRW Sports has selected Populous as architect for a purpose-built stadium for its professional flag football league, being developed in partnership with the NF...
30/07/2026
SiriusXM has announced SiriusXM Sports Pass, a new subscription plan launching September 1 that bundles the company's sports audio programming into a single...
30/07/2026
Leagues, broadcasters, and technologists gather to tackle cloud economics, distr...
30/07/2026
A major player in the cloud-based solutions, Amazon Web Services (AWS) has conti...
30/07/2026
The NBA will provide production for all local game broadcasts, including pregame and postgame coverage...
30/07/2026
Cosm will open its fourth immersive sports and entertainment venue in downtown Detroit on September 10. Located at 25 Cadillac Square, adjacent to Campus Martiu...
30/07/2026
NFL Network will be available on the ESPN App beginning July 30 for Unlimited plan subscribers. The addition brings NFL Network's live games, studio program...
30/07/2026
NEP Group has added Riedel's SimplyLive Production Suite to NEP Platform, giving customers access to the live production software through NEP's orchestr...
30/07/2026
LOS ANGELES, CA, July 30, 2026 - The nonprofit Sundance Institute today announce...
30/07/2026
A new take on classic algorithmic reverbs
Waves have just introduced a new flagship algorithmic reverb plug-in that offers the company's take on the ico...
30/07/2026
Save up to 30% on virtual instruments & plug-ins
Arturia have recently launched their annual Summer Sale, which sees discounts of up to 30% applied across a...
30/07/2026
ActiveAnalogue technology powers new flagship modular console
A year on from the launch of the Oracle, SSL have revealed a new flagship console which they s...
30/07/2026
Up to 22dBA of passive attenuation
The latest arrival to the beyerdynamic range introduces a new compact monitoring headphone that's been designed to ta...
30/07/2026
As part of its traditional graduation ceremony, SGL Carbon honored the achievements of a total of twelve young professionals who successfully completed their ap...
30/07/2026
Premiere date revealed for SBS Original drama The Airport Chaplain, starring Hug...
30/07/2026
TVNZ and Evergent are celebrating a major TVNZ milestone - the evolution from a free-to-view, ad-supported business into a hybrid model, offering premium sport...
30/07/2026
WebMiere Adds Native VP9/AV1 WebM/MKV Import to Adobe Premiere Pro
Brie Clayton July 29, 2026
0 Comments
Brought to you by KawaiiEngine, WebMiere is a...
30/07/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/07/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/07/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/07/2026
At IBC2026, GlobalM will showcase the latest evolution of its software-defined media platform, enabling broadcasters, telecom operators and media organisations ...
30/07/2026
At the 2026 TAB Show, Digital Alert Systems will highlight and demo the new DAS-Link AIR, an over-the-air common alert protocol (CAP) dissemination system for ...
30/07/2026
OpenDrives Named to the 2026 CRN Storage 100 List
Company Recognized Among the 50 Coolest Software-Defined Storage Vendors for Unlimited Capacity, S3 Hybrid M...
30/07/2026
New Scene Search capability in VIDA Content OS makes video content itself searchable, letting broadcasters and streamers find key moments across millions of ass...
30/07/2026
July 30th, 2026
TRIBECA FILMS ANNOUNCES SUMMER 2026 ACQUISITIONS INCLUDING L...
30/07/2026
Thursday 30 July 2026
Which WSL matches are Sky Sports showing on the 2026/27 opening weekend?
The season will kick off on Friday 4 September with Manchester ...
30/07/2026
Thursday 30 July 2026
Enjoy discounts on the iPhone Air, plus 5Gb speeds with U...
30/07/2026
Broadcaster John Creedon explores Ireland's rich musical heritage Sunday 2 A...
30/07/2026
Back to school means balancing assignments, deadlines and downtime. GeForce NOW makes it easy to have it all.
With cloud gaming, everyday laptops used for clas...
29/07/2026
In this series, Grass Valley explores the seven paradoxes shaping the next era o...
29/07/2026
Thats a wrap on Season 1 of SVG Students to Watch! Across the country, these stu...
29/07/2026
The agreement will move Gotham Sports App subscribers to DAZN during the 2026-27...
29/07/2026
Longtime digital-media leader expands role overseeing conference branding, video...
29/07/2026
By Bailey Pennick
One of the most exciting things about the Sundance Film Festival is having a front-row seat for the bright future of independent filmmaking. ...