Sony Pixel Power calrec Sony

AI Decoded From GTC: The Latest Developer Tools and Apps Accelerating AI on PC and Workstation

20/03/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and which showcases new hardware, software, tools and accelerations for RTX PC users.

NVIDIA's RTX AI platform includes tools and software development kits that help Windows developers create cutting-edge generative AI features to deliver the best performance on AI PCs and workstations.

At GTC - NVIDIA's annual technology conference - a dream team of industry luminaries, developers and researchers have come together to learn from one another, fueling what's next in AI and accelerated computing.

This special edition of AI Decoded from GTC spotlights the best AI tools currently available and looks at what's ahead for the 100 million RTX PC and workstation users and developers.

Chat with RTX, the tech demo and developer reference project that quickly and easily allows users to connect a powerful LLM to their own data, showcased new capabilities and new models in the GTC exhibit hall.

The winners of the Gen AI on RTX PCs contest were announced Monday. OutlookLLM, Rocket League BotChat and CLARA were highlighted in one of the AI Decoded talks in the generative AI theater and each are accelerated by NVIDIA TensorRT-LLM. Two other AI Decoded talks included using generative AI in content creation and a deep dive on Chat with RTX.

Developer frameworks and interfaces with TensorRT-LLM integration continue to grow as Jan.ai, Langchain, LlamaIndex and Oobabooga will all soon be accelerated - helping to grow the already more than 500 AI applications for RTX PCs and workstations.

NVIDIA NIM microservices are coming to RTX PCs and workstations. They provide pre-built containers, with industry standard APIs, enabling developers to accelerate deployment on RTX PCs and workstations. NVIDIA AI Workbench, an easy-to-use developer toolkit to manage AI model customization and optimization workflows, is now generally available for RTX developers.

These ecosystem integrations and tools will accelerate development of new Windows apps and features. And today's contest winners are an inspiring glimpse into what that content will look like.

Hear More, See More, Chat More Chat with RTX, or ChatRTX for short, uses retrieval-augmented generation, NVIDIA TensorRT-LLM software and NVIDIA RTX acceleration to bring local generative AI capabilities to RTX-powered Windows systems. Users can quickly and easily connect local files as a dataset to an open large language model like Mistral or Llama 2, enabling queries for quick, contextually relevant answers.

Moving beyond text, ChatRTX will soon add support for voice, images and new models.

Users will be able to talk to ChatRTX with Whisper - an automatic speech recognition system that uses AI to process spoken language. When the feature becomes available, ChatRTX will be able to understand spoken language, and provide text responses.

A future update will also add support for photos. By integrating OpenAI's CLIP - Contrastive Language-Image Pre-training - users will be able to search by words, terms or phrases to find photos in their private library.

In addition to Google's Gemma, ChatGLM will get support in a future update.

Developers can start with the latest version of the developer reference project on GitHub.

Generative AI for the Win The NVIDIA Generative AI on NVIDIA RTX developer contest prompted developers to build a Windows app or plug-in.

I found that playing against bots that react to game events with in-game messages in near real time adds a new level of entertainment to the game, and I'm excited to share my approach to incorporating AI into gaming as a participant in this developer contest. The target audience for my project is anyone who plays Rocket League with RTX hardware. - Brian Caffey, Rocket League BotChat developer

Submissions were judged on three criteria, including a short demo video posted to social media, relative impact and ease of use of the project, and how effectively NVIDIA's technology stack was used in the project. Each of the three winners received a pass to GTC, including a spot in the NVIDIA Deep Learning Institute GenAI/LLM courses, and a GeForce RTX 4090 GPU to power future development work.

OutlookLLM gives Outlook users generative AI features - such as email composition - securely and privately in their email client on RTX PCs and workstations. It uses a local LLM served via TensorRT-LLM.

Rocket League BotChat, for the popular Rocket League game, is a plug-in that allows bots to send contextual in-game chat messages based on a log of game events, such as scoring a goal or making a save. Designed to be used only in offline games against bot players, the plug-in is configurable in many ways via its settings menu.

CLARA (short for Command Line Assistant with RTX Acceleration) is designed to enhance the command line interface of PowerShell by translating plain English instructions into actionable commands. The extension runs locally, quickly and keeps users in their PowerShell context. Once it's enabled, users type their English instructions and press the tab button to invoke CLARA. Installation is straightforward, and there are options for both script-based and manual setup.

Congratulations to the #GenAIonRTX #DevContest winners:

CLARA Talk with computers in human language Matthew Yaeger

Rocket League BotChat Generate in-game chat messages Brian Caffey

Outlook LLM Compose emails securely with AI Francisco Gonzalez Blanch

pic.twitter.com/i52w5Pn1n9

NVIDIA AI Developer (@NVIDIAAIDev) March 19, 2024

From the Generative AI Theater GTC attendees can attend three AI Decoded talks on Wednesday, March 20 at the generative AI theater. These 15-minute sessions will guide the audience through ChatRTX and how developers can product
LINK: https://blogs.nvidia.com/blog/ai-decoded-gtc-chatrtx-workbench-nim/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

20/05/2026

New Nissan Stadium Is First NFL Venue With Permanent Built-In Music Stage

True to the Music City theme, the Tennessee Titans plan to make live music a prominent fixture on game days at the new venue Reflecting the continuing converge...

20/05/2026

NHL Taps Honeywell To Make Arenas, Facilities More Energy-Efficient

The long-term goal is innovation for the next generation of hockey rinks at both the professional and the community level The National Hockey League (NHL) toda...

20/05/2026

A Look Into the Future: What It Takes To Power the Next Generation of Sports Stadiums

End-users and vendors alike work toward cost-effective yet high-quality solution...

20/05/2026

Nasvhvilles New Nissan Stadium To Host Super Bowl LXIV in 2030

The National Football League has announced that Nashville will host Super Bowl LXIV in 2030 at the new Nissan Stadium. The announcement was made at the NFL Spri...

20/05/2026

NFL Awards Minnesota as Host Site of 2028 NFL Draft

The NFL has announced that the 2028 NFL Draft presented by Bud Light will take place in Minnesota, uniting fans from around the world to celebrate one of the mo...

20/05/2026

Lawo Highlights Edge One at InfoComm 2026

As professional AV workflows continue to evolve, expectations around audio, video, networking, and control are rising rapidly. At InfoComm 2026 in Las Vegas, La...

20/05/2026

Haivision to Showcase Video Wall, IPTV, and Ultra-Low Latency Video Innovations at InfoComm 2026

Haivision will showcase its latest innovations at InfoComm 2026, taking place fr...

20/05/2026

Spotify House Returns to CMA Fest With 3 Days of Nonstop Country Music

For the seventh year, Spotify is returning to CMA Fest with Spotify House, the festival's premiere destination for fans. We're taking over downtown Nash...

20/05/2026

Aero 2 from Acustica Audio

Amp-simulation software expanded Acustica Audio's latest release greatly expands on their amp-simulation platform, turning it into a complete amplifica...

20/05/2026

Arturia update the KeyLab Mk3

MainStage integration, Analog Lab improvements & more Arturia have just announced the release of an update that brings an assortment of new features to thei...

20/05/2026

SGL Carbon holds successful Annual General Meeting with strong approval of proposed resolutions

At the Annual General Meeting held on May 20, 2026, the shareholders of SGL Carb...

20/05/2026

From Gulkula to the nation: Yothu Yindi Foundation and NITV deepen national access to Garma Festival

From Gulkula to the nation: Yothu Yindi Foundation and NITV deepen national acce...

20/05/2026

SBS appoints David Fernandez as National Manager, Digital & TV Sales

SBS appoints David Fernandez as National Manager, Digital & TV Sales 20 May, 2026 Media releases SBS has appointed David Fernandez as National Manager, Dig...

20/05/2026

Rohde & Schwarz and INFOZAHYST: A strategic alliance set to redefine modern defense

Rohde & Schwarz and INFOZAHYST: A strategic alliance set to redefine modern defe...

20/05/2026

L3Harris Achieves Major Milestones With Latest Series of Rotating Detonation Engine Tests

A Rotating Detonation Engine being hot fire tested at Purdue University's Zu...

20/05/2026

VAMPIRE Confirms Integrated Capability During Live Exercises

A U.S. Army VAMPIRE system, assigned to Bravo Battery, 1st Battalion, 51st Air Defense Artillery Regiment, 7th Infantry Division/Multi-Domain Command - Pacific ...

20/05/2026

NCAA Tournaments Spark March Madness for Paramount and Warner Bros. Discovery in Nielsen's The Gauge

Cable Captures Only Monthly Increase Among Viewing Categories in March, Earns it...

20/05/2026

The Gauge: Poland | April 2026

April brought a symbolic decrease in the overall time spent in front of television screens. On average, Poles watched video content for 3 hours and 51 minutes a...

20/05/2026

DirecTV Asks FCC to Block Scripps' INYO Acquisition

Share Copy link Facebook X Linkedin Bluesky Email...

20/05/2026

RTS Technology Centre Launches the RTS Technology Awards...

The Royal Television Society Technology Centre today announces the launch of the RTS Technology Awards 2026, celebrating excellence, innovation and achievement ...

20/05/2026

Lightware powers immersive video spectacle for The Hunger...

In the heart of London's financial district, the new purpose-built Troubadour Canary Wharf Theatre invites audiences to experience Suzanne Collins' inte...

20/05/2026

New LiveU LU900Q Powers Record Breaking Broadcast of the...

LiveU, the leader in live IP-video solutions, today announced that production powerhouse BCC Live successfully deployed the new LU900Q intelligent production un...

20/05/2026

Nella Mente di Narciso Docuseries Uses Blackmagic Design Workflow

Nella Mente di Narciso Docuseries Uses Blackmagic Design Workflow Brie Clayton May 19, 2026 0 Comments PYXIS 6K full frame camera and DaVinci Resolve ...

20/05/2026

Beeble launches Canvas, a node-based AI compositor for VFX and Virtual Production pipelinesx

Beeble launches Canvas, a node-based AI compositor for VFX and Virtual Productio...

20/05/2026

DSPolitical and FreeWheel Partner on Political CTV Ads

Share Copy link Facebook X Linkedin Bluesky Email...

20/05/2026

Amazon, Netflix and Google to Capture Half of CTV Ad Market by 2030

Share Copy link Facebook X Linkedin Bluesky Email...

20/05/2026

Roku Introduces 'Creator Hub

Share Copy link Facebook X Linkedin Bluesky Email...

20/05/2026

First Nations Factual Co-production Development Fund launched to elevate Indigenous storytelling in global markets

First Nations Factual Co-production Development Fund launched to elevate Indigen...

20/05/2026

'One Hundred Years of Solitude' Concludes This August, With Part Two Premiering on the 5th and the Grand Finale on the 26th

Back to All News One Hundred Years of Solitude Concludes This August, With Part...

20/05/2026

Beloved NHK Dramas to Stream on Netflix Worldwide Starting June 22

Back to All News Beloved NHK Dramas to Stream on Netflix Worldwide Starting June 22 Entertainment 20 May 2026 GlobalJapan Link copied to clipboard Netflix...

20/05/2026

Dolby Recognized as 2025 Supplier of the Year and Overdrive Award Winner by General Motors

May 20 2026, 06:00 (PDT) Dolby Recognized as 2025 Supplier of the Year and Over...

20/05/2026

Two cooks shortlisted for the final of RT Today's TV Home Cook Competition

Mayo's Dee Freney and Margaret Leahy from Galway have reached the final of RT Today's TV Home Cook competition. Both contestants will cook again live...

20/05/2026

RT IN FULL BLOOM AT BORD BIA BLOOM 2026 WITH LIVE BROADCASTS, MUSIC, CHAT AND MUCH MORE

RT IN FULL BLOOM AT BORD BIA BLOOM 2026 WITH LIVE BROADCASTS, MUSIC, CHAT AND M...

19/05/2026

Young Journalist' finalists visit London for training and networking

The winner of Thomson Foundation's Young Journalist of the Year 2025, Tracy Bonareri Onchoke, and runner up Wangu Kanuri enjoyed a three-day trip to London ...

19/05/2026

Cisco and USGA Announce Multiyear Partnership Extension

Cisco and the USGA have announced a multiyear extension of their partnership, which began in 2018. Cisco serves as the Official Technology Partner of the USGA, ...

19/05/2026

Urban Edge Network and Spiideo Partner to Enhance NAIA Sports Streaming

Urban Edge Network (UEN), a streaming platform for NAIA sports, has announced a partnership with Spiideo to provide streaming and production tools to UEN's ...

19/05/2026

Warner Bros. Discovery Announces Expanded Roland-Garros 2026 Coverage

Warner Bros. Discovery (WBD) will provide live coverage of all 900 Roland-Garros matches across its platforms beginning with qualifiers on May 18. In Europe, 21...

19/05/2026

Tubi Launches FIFA World Cup 2026 FOX Hub

Tubi, Fox Corporation's free streaming service, has announced the launch of the FIFA World Cup 2026 FOX Hub, a dedicated destination for World Cup programmi...

19/05/2026

Telefnica and Sony Conduct 5G mmWave Broadcast Trial at Movistar Arena

Telef nica, in collaboration with Sony, has conducted a 5G connectivity trial at the Movistar Arena in Spain using the 26 GHz millimetre wave (mmWave) band. The...

19/05/2026

Ross Production Services Integrates Calrec Argo M into New Hypermax-1 Truck

Ross Production Services (RPS) has installed a Calrec Argo M console into its new Hypermax-1 remote production truck, replacing one of three Argo S consoles pre...

19/05/2026

Panasonic Projector and Display Acquires HIVE Media Control

Panasonic Projector and Display Corporation has announced the acquisition of 100% of the shares of UK-based media technology company Hive Media Control Ltd. (HI...

19/05/2026

Globecast Completes Major Renovation of Singapore Facility

Globecast has announced the completion of a nine-month renovation of its Singapore facility, converting it from a traditional linear broadcast operation into a ...

19/05/2026

Grass Valley Signs Three-Year Enterprise Agreement with Phoenix Broadcast Solutions

Grass Valley has announced a three-year enterprise agreement with Phoenix Broadc...

19/05/2026

Watch Brasil Selects Bitmovin for Streaming Player, Encoder, and Observability

Bitmovin has announced that Watch Brasil, a streaming platform operating across Brazil and Europe since 2018, has replaced its legacy systems with Bitmovin'...

19/05/2026

Ateme and Akamai Power Nepal Premier League Live Streaming

Ateme has announced the migration of Dish Home Nepal's Nepal Premier League (NPL) streaming infrastructure to Ateme's TITAN Live solution deployed on Ak...

19/05/2026

CMSI Supports ESPNs NCAA Gymnastics Championships Coverage

CMSI provided workflow, media management, and HDR support for ESPN during coverage of the NCAA Gymnastics Semifinals and Championships. The company supported fi...