![](//www.4rfv.com/images/no_image.jpg)
Editor's note: This post is part of our AI Decoded series, which aims to demystify AI by making the technology more accessible, while showcasing new hardware, software, tools and accelerations for RTX PC and workstation users.
If AI is having its iPhone moment, then chatbots are one of its first popular apps.
They're made possible thanks to large language models, deep learning algorithms pretrained on massive datasets - as expansive as the internet itself - that can recognize, summarize, translate, predict and generate text and other forms of content. They can run locally on PCs and workstations powered by NVIDIA GeForce and RTX GPUs.
LLMs excel at summarizing large volumes of text, classifying and mining data for insights, and generating new text in a user-specified style, tone or format. They can facilitate communication in any language, even beyond ones spoken by humans, such as computer code or protein and genetic sequences.
While the first LLMs dealt solely with text, later iterations were trained on other types of data. These multimodal LLMs can recognize and generate images, audio, videos and other content forms.
Chatbots like ChatGPT were among the first to bring LLMs to a consumer audience, with a familiar interface built to converse with and respond to natural-language prompts. LLMs have since been used to help developers write code and scientists to drive drug discovery and vaccine development.
But the AI models that power those functions are computationally intensive. Combining advanced optimization techniques and algorithms like quantization with RTX GPUs, which are purpose-built for AI, helps make LLMs compact enough and PCs powerful enough to run locally - no internet connection required. And a new breed of lightweight LLMs like Mistral - one of the LLMs powering Chat with RTX - sets the stage for state-of-the-art performance with lower power and storage demands.
Why Do LLMs Matter? LLMs can be adapted for a wide range of use cases, industries and workflows. This versatility, combined with their high-speed performance, offers performance and efficiency gains across virtually all language-based tasks.
DeepL, running on NVIDIA GPUs in the cloud, uses advanced AI to provide accurate text translations. LLMs are widely used in language translation apps such as DeepL, which uses AI and machine learning to provide accurate outputs.
Medical researchers are training LLMs on textbooks and other medical data to enhance patient care. Retailers are leveraging LLM-powered chatbots to deliver stellar customer support experiences. Financial analysts are tapping LLMs to transcribe and summarize earning calls and other important meetings. And that's just the tip of the iceberg.
Chatbots - like Chat with RTX - and writing assistants built atop LLMs are making their mark on every facet of knowledge work, from content marketing and copywriting to legal operations. Coding assistants were among the first LLM-powered applications to point toward the AI-assisted future of software development. Now, projects like ChatDev are combining LLMs with AI agents - smart bots that act autonomously to help answer questions or perform digital tasks - to spin up an on-demand, virtual software company. Just tell the system what kind of app is needed and watch it get to work.
Learn more about LLM agents on the NVIDIA developer blog.
Easy as Striking Up a Conversation Many people's first encounter with generative AI came by way of a chatbot such as ChatGPT, which simplifies the use of LLMs through natural language, making user action as simple as telling the model what to do.
LLM-powered chatbots can help generate a draft of marketing copy, offer ideas for a vacation, craft an email to customer service and even spin up original poetry.
Advances in image generation and multimodal LLMs have extended the chatbot's realm to include analyzing and generating imagery - all while maintaining the wonderfully simple user experience. Just describe an image to the bot or upload a photo and ask the system to analyze it. It's chatting, but now with visual aids.
For more on how these bots are designed, check out the on-demand webinar on Building Intelligent AI Chatbots Using RAG.
Future advancements will help LLMs expand their capacity for logic, reasoning, math and more, giving them the ability to break complex requests into smaller subtasks.
Progress is also being made on AI agents, applications capable of taking a complex prompt, breaking it into smaller ones, and engaging autonomously with LLMs and other AI systems to complete them. ChatDev is an example of an AI agent framework, but agents aren't limited to technical tasks.
For example, users could ask a personal AI travel agent to book a family vacation abroad. The agent would break that task into subtasks - itinerary planning, booking travel and lodging, creating packing lists, finding a dog walker - and independently execute them in order.
Unlock Personal Data With RAG As powerful as LLMs and chatbots are for general use, they can become even more helpful when combined with an individual user's data. By doing so, they can help analyze email inboxes to uncover trends, comb through dense user manuals to find the answer to a technical question about some hardware, or summarize years of bank and credit card statements.
Retrieval-augmented generation, or RAG, is one of the easiest and most effective ways to hone LLMs for a particular dataset.
An example of RAG on a PC. RAG enhances the accuracy and reliability of generative AI models with facts fetched from external sources. By connecting an LLM with practically any external resource, RAG lets users chat with data repositories while also giving the LLM the ability to cite its sources. The user experience is as simple as pointing the chatbot toward a file or directory.
For
More from Nvidia
25/07/2024
Hey, you. You're finally awake.
It's the summer of Elder Scrolls - whe...
24/07/2024
AI is set to transform the workforce - and the Georgia Institute of Technology's new AI Makerspace is helping tens of thousands of students get ahead of the...
24/07/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
23/07/2024
Generative AI applications have little, or sometimes negative, value without acc...
23/07/2024
Businesses seeking to harness the power of AI need customized models tailored to their specific industry needs.
NVIDIA AI Foundry is a service that enables ent...
22/07/2024
AI and accelerated computing - twin engines NVIDIA continuously improves - are d...
22/07/2024
Team NVIDIA has triumphed at the Amazon KDD Cup 2024, securing first place Friday across all five competition tracks.
The team - consisting of NVIDIANs Ahmet E...
19/07/2024
Research published earlier this month in the science journal Nature used NVIDIA-powered supercomputers to validate a pathway toward the commercialization of qua...
19/07/2024
Research published earlier this month in the science journal Nature used NVIDIA-powered supercomputers to validate a pathway toward the commercialization of qua...
19/07/2024
AI has seen unprecedented growth - spurring the need for new training and educat...
19/07/2024
Research published earlier this month in the science journal Nature used NVIDIA-powered supercomputers to validate a pathway toward the commercialization of qua...
18/07/2024
Mistral AI and NVIDIA today released a new state-of-the-art language model, Mist...
18/07/2024
It's time for a sweet treat - the GeForce NOW Summer Sale offers high-perfor...
17/07/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
16/07/2024
Editor's note: This post is part of our In the NVIDIA Studio series, which c...
15/07/2024
NVIDIA founder and CEO Jensen Huang and Meta founder and CEO Mark Zuckerberg wil...
12/07/2024
NVIDIA is taking an array of advancements in rendering, simulation and generativ...
11/07/2024
Unlock new experiences every GFN Thursday. Whether post-apocalyptic survival adventures, narrative-driven games or vast, open worlds, GeForce NOW always has som...
11/07/2024
Enhancing Japan's AI sovereignty and strengthening its research and development capabilities, Japan's National Institute of Advanced Industrial Science ...
10/07/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible and showcases new hardware, softwar...
10/07/2024
Improved cancer diagnostics - and improved patient outcomes - could be among the...
09/07/2024
Sphere, a new kind of entertainment medium in Las Vegas, is joining the ranks of legendary circular performance spaces such as the Roman Colosseum and Shakespea...
08/07/2024
Artificial intelligence is transforming the transportation industry, helping dri...
04/07/2024
GeForce NOW is bringing 22 new games to members this month.
Dive into the four titles available to stream on the cloud gaming service this week to stay cool an...
03/07/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
28/06/2024
On a weekday afternoon, Ashwini Ashtankar sat on the bank of the Doodhpathri River, in a valley nestled in the Himalayas. Taking a deep breath, she noticed that...
27/06/2024
Editor's note: This post is part of Into the Omniverse, a series focused on ...
27/06/2024
Get ready to feel some chills, even amid the summer heat. Capcom's award-winning Resident Evil Village brings a touch of horror to the cloud this GFN Thursd...
26/06/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
26/06/2024
Roblox is a colorful online platform that aims to reimagine the way that people ...
25/06/2024
Generative AI has revolutionized software development with prompt-based code generation - protein design is next.
EvolutionaryScale today announced the release...
24/06/2024
Multi-die chips, known as three-dimensional integrated circuits, or 3D-ICs, represent a revolutionary step in semiconductor design. The chips are vertically sta...
20/06/2024
Sit back and settle in for some epic storytelling. Tell Me Why and As Dusk Falls - award-winning, narrative-driven games from Xbox Studios - add to the 1,900+ g...
19/06/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible and showcases new hardware, softwar...
18/06/2024
The electric grid and the utilities managing it have an important role to play in the next industrial revolution that's being driven by AI and accelerated c...
17/06/2024
NVIDIA contributed the largest ever indoor synthetic dataset to the Computer Vision and Pattern Recognition (CVPR) conference's annual AI City Challenge - h...
17/06/2024
Making moves to accelerate self-driving car development, NVIDIA was today named an Autonomous Grand Challenge winner at the Computer Vision and Pattern Recognit...
17/06/2024
NVIDIA researchers are at the forefront of the rapidly advancing field of visual...
15/06/2024
NVIDIA founder and CEO Jensen Huang on Friday encouraged Caltech graduates to pu...
14/06/2024
When she was five years old, Veronica Miller (n e Teklai) and her family left their homeland of Eritrea, in the Horn of Africa, to escape an ongoing war with Et...
14/06/2024
NVIDIA today announced Nemotron-4 340B, a family of open models that developers ...
13/06/2024
Set sail for adventure, pirates. Sea of Thieves makes waves in the cloud this week. It's an adventure-filled GFN Thursday with four new games joining the Ge...
12/06/2024
Accelerated computing is transforming data processing and analytics for enterpri...
12/06/2024
The full-stack NVIDIA accelerated computing platform has once again demonstrated...
12/06/2024
Let's talk about NeRFs - no, not the neon-colored foam dart blasters, but ne...
12/06/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
07/06/2024
Across industries, AI is supercharging innovation with machine-powered computation. In finance, bankers are using AI to detect fraud more quickly and keep accou...
06/06/2024
Capcom's latest entry in the iconic Street Fighter series, Street Fighter 6, punches its way into the cloud this GFN Thursday. The game, along with Ubisoft&...
05/06/2024
India's AI market is expected to be massive. Yotta Data Services is setting its sights on supercharging it. In this episode of NVIDIA's AI Podcast, Suni...
05/06/2024
NVIDIA launched NVIDIA Studio at COMPUTEX in 2019. Five years and more than 500 ...