AI Decoded From GTC: The Latest Developer Tools and Apps Accelerating AI on PC and Workstation
20/03/2024
NVIDIA's RTX AI platform includes tools and software development kits that help Windows developers create cutting-edge generative AI features to deliver the best performance on AI PCs and workstations.
At GTC - NVIDIA's annual technology conference - a dream team of industry luminaries, developers and researchers have come together to learn from one another, fueling what's next in AI and accelerated computing.
This special edition of AI Decoded from GTC spotlights the best AI tools currently available and looks at what's ahead for the 100 million RTX PC and workstation users and developers.
Chat with RTX, the tech demo and developer reference project that quickly and easily allows users to connect a powerful LLM to their own data, showcased new capabilities and new models in the GTC exhibit hall.
The winners of the Gen AI on RTX PCs contest were announced Monday. OutlookLLM, Rocket League BotChat and CLARA were highlighted in one of the AI Decoded talks in the generative AI theater and each are accelerated by NVIDIA TensorRT-LLM. Two other AI Decoded talks included using generative AI in content creation and a deep dive on Chat with RTX.
Developer frameworks and interfaces with TensorRT-LLM integration continue to grow as Jan.ai, Langchain, LlamaIndex and Oobabooga will all soon be accelerated - helping to grow the already more than 500 AI applications for RTX PCs and workstations.
NVIDIA NIM microservices are coming to RTX PCs and workstations. They provide pre-built containers, with industry standard APIs, enabling developers to accelerate deployment on RTX PCs and workstations. NVIDIA AI Workbench, an easy-to-use developer toolkit to manage AI model customization and optimization workflows, is now generally available for RTX developers.
These ecosystem integrations and tools will accelerate development of new Windows apps and features. And today's contest winners are an inspiring glimpse into what that content will look like.
Hear More, See More, Chat More Chat with RTX, or ChatRTX for short, uses retrieval-augmented generation, NVIDIA TensorRT-LLM software and NVIDIA RTX acceleration to bring local generative AI capabilities to RTX-powered Windows systems. Users can quickly and easily connect local files as a dataset to an open large language model like Mistral or Llama 2, enabling queries for quick, contextually relevant answers.
Moving beyond text, ChatRTX will soon add support for voice, images and new models.
Users will be able to talk to ChatRTX with Whisper - an automatic speech recognition system that uses AI to process spoken language. When the feature becomes available, ChatRTX will be able to understand spoken language, and provide text responses.
A future update will also add support for photos. By integrating OpenAI's CLIP - Contrastive Language-Image Pre-training - users will be able to search by words, terms or phrases to find photos in their private library.
In addition to Google's Gemma, ChatGLM will get support in a future update.
Developers can start with the latest version of the developer reference project on GitHub.
Generative AI for the Win The NVIDIA Generative AI on NVIDIA RTX developer contest prompted developers to build a Windows app or plug-in.
I found that playing against bots that react to game events with in-game messages in near real time adds a new level of entertainment to the game, and I'm excited to share my approach to incorporating AI into gaming as a participant in this developer contest. The target audience for my project is anyone who plays Rocket League with RTX hardware. - Brian Caffey, Rocket League BotChat developer
Submissions were judged on three criteria, including a short demo video posted to social media, relative impact and ease of use of the project, and how effectively NVIDIA's technology stack was used in the project. Each of the three winners received a pass to GTC, including a spot in the NVIDIA Deep Learning Institute GenAI/LLM courses, and a GeForce RTX 4090 GPU to power future development work.
OutlookLLM gives Outlook users generative AI features - such as email composition - securely and privately in their email client on RTX PCs and workstations. It uses a local LLM served via TensorRT-LLM.
Rocket League BotChat, for the popular Rocket League game, is a plug-in that allows bots to send contextual in-game chat messages based on a log of game events, such as scoring a goal or making a save. Designed to be used only in offline games against bot players, the plug-in is configurable in many ways via its settings menu.
CLARA (short for Command Line Assistant with RTX Acceleration) is designed to enhance the command line interface of PowerShell by translating plain English instructions into actionable commands. The extension runs locally, quickly and keeps users in their PowerShell context. Once it's enabled, users type their English instructions and press the tab button to invoke CLARA. Installation is straightforward, and there are options for both script-based and manual setup.
Congratulations to the #GenAIonRTX #DevContest winners:
CLARA Talk with computers in human language Matthew Yaeger
Rocket League BotChat Generate in-game chat messages Brian Caffey
Outlook LLM Compose emails securely with AI Francisco Gonzalez Blanch
pic.twitter.com/i52w5Pn1n9
NVIDIA AI Developer (@NVIDIAAIDev) March 19, 2024
From the Generative AI Theater GTC attendees can attend three AI Decoded talks on Wednesday, March 20 at the generative AI theater. These 15-minute sessions will guide the audience through ChatRTX and how developers can product
LINK: | https://blogs.nvidia.com/blog/ai-decoded-gtc-chatrtx-workbench-nim/... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
09/05/2024
Yale University's Center for Collaborative Arts and Media (CCAM) Cultivates Creativity with Blackmagic Design
Yale University's Center for Collaborative Arts and Media (CCAM) Cultivates ...
09/05/2024
Blender: Awesome Rack Focus Rig
Blender: Awesome Rack Focus Rig Simon Ubsdell May 9, 2024 0 Comments In which we build a focusing rig in the Blender compositor to enable selective fo...
09/05/2024
Peacock Orders The Office' Offshoot
Peacock has picked up a series from Greg Daniels, who developed The Office for NBC, that is set in the same universe, according to the network, as the NBC hit...
09/05/2024
Sinclair Net Income Drops To $23 Million in First Quarter
Sinclair reported lower net income in the first quarter as distribution revenues rose and ad revenue excluding political spending dipped....
09/05/2024
Vizio Reports $12.1 Million Loss for First Quarter
Vizio Holding Corp., which has agreed to be acquired by Walmart, reported a loss in the first quarter despite growth in its advertising and data businesses....
09/05/2024
Kathleen Keefe, Broadcasting Exec, Dies at 68
Kathleen Keefe, who served as VP of sales for both Hearst Television and Post-Newsweek Stations, died peacefully in her sleep at her home in Roxbury, Connecticu...
09/05/2024
Future Today Adds Movies From Warner Bros Discovery to Fawesome
Streaming company Future Today said it made a deal with Warner Bros. Discovery that will bring 46 movies to Future Today's Fawesome channel....
09/05/2024
Warner Bros. Discovery Reports $966 Million First-Quarter Loss
Despite reporting a profit for its direct-to-consumer business, Warner Bros. Discovery reported a big loss as it took huge write-downs in the first quarter....
09/05/2024
Nexstar Reports Higher Net Income in First Quarter
Nexstar Media Group reported higher first-quarter earnings and said that it cut losses at The CW by $50 million year-over-year....
09/05/2024
Fubo Grabs Viewer Attention, According to TVision Study
Fubo, the sports-focused streaming service, scored high in getting its viewers attention, according to a study conducted by measurement and analytics company TV...
09/05/2024
SailGP Expanding LiveLineFX Graphics Platform to Other Sports
LONDON SailGP, which sponsors high-speed boat racing events worldwide says it is developing its LiveLineFX sports graphics platform for use in other sports....
09/05/2024
Disney, WBD to Offer Streaming Bundle Starting this Summer
BURBANK, Calif. Starting this summer, U.S. consumers will be able to purchase a new streaming bundle offered by Disney and Warner Bros. Discovery that includes ...
09/05/2024
Sony and Apollo plan to break up Paramount'
Companies are expected to sell off Paramounts linear channels as well as close Paramount Plus By Jenny Priestley Published: May 9, 2024 Companies are expe...
09/05/2024
Paramount Global Selects Amdocs Vubiquity to Provide Mana...
Amdocs (NASDAQ:DOX), a leading provider of software and services to communications and media companies, today announced that Vubiquity, an Amdocs company, has b...
09/05/2024
CueScript Awarded Best of Show for CueFlip at NAB 2024
CueScript, the leading developer of professional teleprompting solutions, has announced that its CueFlip screen-to-screen folding field prompter has won in this...
09/05/2024
Mother's Day Ideas from CBC
Capitol Broadcasting has a myriad of ways to celebrate Mom! In honor of Mother's Day, here are a few ideas CBC divisions have to help you honor, or remember...
09/05/2024
Scripps Appoints New President and CEO of the Scripps Howard Fund
CINCINNATI Meredith Delaney has been appointed president and CEO of the Scripps Howard Fund, the philanthropic arm of The E.W. Scripps Company....
09/05/2024
Walmart Launches the Onn. 4K Streaming Device
Following leaks earlier this month of Walmart's plans to launch a new 4K streaming box, Walmart has officially unveiled the Onn. 4K Pro, a hybrid streaming ...
09/05/2024
DirecTV Adds More CW Stations
DirecTV continues to add CW affiliates to its streaming line-up, with the addition of four stations owned by Gray Television....
09/05/2024
Takeshi Kitano's film KUBI graded with DaVinci Resolve
Takeshi Kitano's film KUBI graded with DaVinci Resolve Brie Clayton May 8, 2024 0 Comments Blackmagic Design today announced that DaVinci Resolve ...
09/05/2024
zweiB updates to latest version of R&S CLIPSTER
zweiB updates to latest version of R&S CLIPSTER Brie Clayton May 8, 2024 0 Comments Specialist in deliverables for cinema, events and trade shows Ro...
09/05/2024
Simplify Your Filmmaking with Portable Lights
Simplify Your Filmmaking with Portable Lights Sean Alami May 8, 2024 0 Comments Discover the sleek, mobile Zhiyun lights that enhance cinematic scenes...
09/05/2024
The Benefits of using an Audio Interface
The Benefits of using an Audio Interface Colin Smith May 8, 2024 0 Comments This tutorial takes you through the hardware and software benefits of usin...
09/05/2024
Mother's Day Idea from CBC
Capitol Broadcasting has a myriad of ways to celebrate Mom! In honor of Mother's Day, here are a few ideas CBC divisions have to help you honor, or remember...
09/05/2024
Lachlan Murdoch Sees Progress Toward Sports Streaming Product
Fox CEO Lachlan Murdoch said his company, The Walt Disney Co. and Warner Bros. Discovery are in a two-minute drill to get their streaming sports joint venture t...
09/05/2024
Dale Earnhardt Jr. Joins Prime Video's NASCAR Team
NASCAR legend Dale Earnhardt Jr. is joining the Prime Video broadcast booth when the streaming network begins NASCAR Cup Series coverage next year. Earnhardt Jr...
09/05/2024
Nexstar Pitches Sports on The CW, Extra Reach Via Stations (Upfronts)
If upfront advertisers are looking for reach, Nexstar Media Group believes its base of local stations gives it a unique way to achieve that goal....
09/05/2024
Pluto TV Debuts NBCUniversal Local Streaming News Channels
NBCUniversal Local's 15 NBC and Telemundo local and regional streaming news channels begin launching on Pluto TV this month, starting May 8 with five channe...
09/05/2024
Don't Tell Mom the Babysitter's Dead' Debuts on BET Plus May 16
BET Plus said it has set May 16 as the premiere date for its original movie Don't Tell Mom the Babysitter's Dead....
09/05/2024
Disney's Rita Ferro Is Banking on Sports, Streaming, Tech (Upfronts)
Heading into the upfront, the advertising market is noticeably healthier than it was a year ago, Rita Ferro, president of global advertising sales at The Walt D...
09/05/2024
RT Supporting the Arts: What's On this May
RT Supporting the Arts: What's On this May Watch our YouTube promo here This May RT is delighted to support Dublin Dance Festival along with 20 other ar...
09/05/2024
Honkai: Star Rail' Blasts Off on GeForce NOW
Gear up, Trailblazers - Honkai: Star Rail lands on GeForce NOW this week, along with an in-game reward for members to celebrate the title's launch in the cl...
09/05/2024
Rohde & Schwarz showcases operational efficiency at MPTS
Rohde & Schwarz showcases operational efficiency at MPTS Uncompromised quality and reliability coupled with simplicity and efficiency Rohde & Schwarz will ...
08/05/2024
Saved! and Rudo y Cursi Among Films With May Anniversaries
Diego Luna's character Beto aims to play professional soccer in Carlos Cuar n's film Rudo y Cursi....
08/05/2024
SGL Carbon: Focus on global growth trends pays off
SGL Carbon had a solid start to the first quarter of 2024. Despite the slight decline in sales of 3.9% to 272.6 million (Q1 2023: 283.7 million), adjusted EBI...
08/05/2024
The results are in from Malm Arena as Semi Final 1 participants move through to the Grand Final of this year's Eurovision Song Contest
The results are in from Malm Arena as Semi Final 1 participants move through to...
08/05/2024
Powerful NITV documentary Kindred to premiere during Reconciliation Week
Powerful NITV documentary Kindred to premiere during Reconciliation Week Media releases A journey of family, friendship and home *Watch the trailer here* ...
08/05/2024
Aerojet Rocketdyne Selected by DoD to Demonstrate Powder-in, Engine-out Hypersonic Propulsion Manufacturing
Aerojet Rocketdyne delivers a broad range of capabilities to support hypersonic ...
08/05/2024
L3Harris is Advancing the Future Fleet by Delivering Integrated Solutions
Selected by Fincantieri Marinette Marine, L3Harris is the shipboard design integrator and a key partner on the Fincantieri team for delivering critical subsyste...
08/05/2024
EditShare Goes Beyond Storage at MPTS
EditShare Goes Beyond Storage at MPTS Workflow, server and delivery solutions from storyboard to screen Stand D40, London Olympia, May 15-16, 2024 - EditShar...
08/05/2024
Tegna, Indiana Fever Expand Broadcast Distribution to 11 Additional Markets
TYSONS, Va. Tegna Inc. and the Indiana Fever have announced they have expanded the broadcast distribution of 17 Fever WNBA games to 11 additional markets....
08/05/2024
Comcast Business Boosts Internet Speeds
PHILADELPHIA Comcast Business has increased Internet speeds for customers, nationwide, at no additional cost and has introduced its fastest Internet plans yet ...
08/05/2024
Clear-Com to Showcase Cutting-Edge Communication Solution...
Clear-Com , a renowned provider of professional real-time communication solutions, is thrilled to announce its participation at InfoComm 2024, the largest profe...
08/05/2024
MRMC Achieves its Second Kings Award for Enterprise
Mark Roberts Motion Control (MRMC), a Nikon company, is one of the 252 organisations recognised with a prestigious King's Award for Enterprise. Announced to...
08/05/2024
EditShare goes beyond storage at MPTS
EditShare, the technology leader that enables storytellers to create and manage collaborative workflows at every stage from storyboard to screen, is exhibiting ...
08/05/2024
Magnifi and Linius Fuse Live and Archive Content to Redef...
Magnifi by VideoVerse an AI-driven video technology company and powerful video-editing SaaS platform is pleased to announce a strategic partnership with Linius ...
08/05/2024
NVIDIA RTX GPU Connects DaVinci Resolve to Power
NVIDIA RTX GPU Connects DaVinci Resolve to Power Brie Clayton May 8, 2024 0 Comments Two of the most important questions that the Creative COW audienc...
08/05/2024
Q&A with Visiting Artist Lei Liang
Q&A with Visiting Artist Lei Liang The acclaimed composer discusses his collaboration with Boston Conservatory, his work as a research artist, and what it mea...