
Editor's note: This post is part of the AI On blog series, which explores the latest techniques and real-world applications of agentic AI, chatbots and copilots. The series also highlights the NVIDIA software and hardware powering advanced AI agents, which form the foundation of AI query engines that gather insights and perform tasks to transform everyday experiences and reshape industries.
AI agents powered by large language models (LLMs) have grown past their FAQ chatbot beginnings to become true digital teammates capable of planning, reasoning and taking action - and taking in corrective feedback along the way.
Thanks to reasoning AI models, agents can learn how to think critically and tackle complex tasks. This new class of reasoning agents can break down complicated problems, weigh options and make informed decisions - while using only as much compute and as many tokens as needed.
Reasoning agents are making a splash in industries where decisions rely on multiple factors. Such industries range from customer service and healthcare to manufacturing and financial services.
Reasoning On vs. Reasoning Off Modern AI agents can toggle reasoning on and off, allowing them to efficiently use compute and tokens.
A full chain of thought pass performed during reasoning can take up to 100x more compute and tokens than a quick, single shot reply - so it should only be used when needed. Think of it like turning on headlights - switching on high beams only when it's dark and turning them back to low when it's bright enough out.
Single-shot responses are great for simple queries - like checking an order number, resetting a password or answering a quick FAQ. Reasoning might be needed for complex, multistep tasks such as reconciling tax depreciation schedules or orchestrating the seating at a 120 guest wedding.
New NVIDIA Llama Nemotron models, featuring advanced reasoning capabilities, expose a simple system prompt flag to enable or disable reasoning, so developers can programmatically decide per query. This allows agents to perform reasoning only when the stakes demand it - saving users wait times and minimizing costs.
Reasoning AI Agents in Action Reasoning AI agents are already being used for complex problem-solving across industries, including:
Healthcare: Enhancing diagnostics and treatment planning.
Customer Service: Automating and personalizing complex customer interactions, from resolving billing disputes to recommending tailored products.
Finance: Autonomously analyzing market data and providing investment strategies.
Logistics and Supply Chain: Optimizing delivery routes, rerouting shipments in response to disruptions and simulating possible scenarios to anticipate and mitigate risks.
Robotics: Powering warehouse robots and autonomous vehicles, enabling them to plan, adapt and safely navigate dynamic environments.
Many customers are already experiencing enhanced workflows and benefits using reasoning agents.
Amdocs uses reasoning-powered AI agents to transform customer engagement for telecom operators. Its amAIz GenAI platform, enhanced with advanced reasoning models such as NVIDIA Llama Nemotron and amAIz Telco verticalization, enables agents to autonomously handle complex, multistep customer journeys - spanning customer sales, billing and care.
EY is using reasoning agents to significantly improve the quality of responses to tax-related queries. The company compared generic models to tax-specific reasoning models, which revealed up to an 86% improvement in response quality for tax questions when using a reasoning approach.
SAP's Joule agents - which will be equipped with reasoning capabilities from Llama Nemotron -- can interpret complex user requests, surface relevant insights from enterprise data and execute cross-functional business processes autonomously.
Designing an AI Reasoning Agent A few key components are required to build an AI agent, including tools, memory and planning modules. Each of these components augments the agent's ability to interact with the outside world, create and execute detailed plans, and otherwise act semi- or fully autonomously.
Reasoning capabilities can be added to AI agents at various places in the development process. The most natural way to do so is by augmenting planning modules with a large reasoning model, like Llama Nemotron Ultra or DeepSeek-R1. This allows more time and reasoning effort to be used during the initial planning phase of the agentic workflow, which has a direct impact on the overall outcomes of systems.
The AI-Q NVIDIA AI Blueprint and the NVIDIA Agent Intelligence toolkit can help enterprises break down silos, streamline complex workflows and optimize agentic AI performance at scale.
The AI-Q blueprint provides a reference workflow for building advanced agentic AI systems, making it easy to connect to NVIDIA accelerated computing, storage and tools for high-accuracy, high-speed digital workforces. AI-Q integrates fast multimodal data extraction and retrieval using NVIDIA NeMo Retriever, NIM microservices and AI agents.
In addition, the open-source NVIDIA Agent Intelligence toolkit enables seamless connectivity between agents, tools and data. Available on GitHub, this toolkit lets users connect, profile and optimize teams of AI agents, with full system traceability and performance profiling to identify inefficiencies and improve outcomes. It's framework-agnostic, simple to onboard and can be integrated into existing multi-agent systems as needed.
Build and Test Reasoning Agents With Llama Nemotron Learn more about Llama Nemotron, which recently was at the top of industry benchmark leaderboards for advanced science, coding and math tasks. Join the community shaping the future of agentic, reasoning-powered AI.
Plus, explore and fine-tune using the open Llama Nemotron post-training dataset t
More from Nvidia
24/06/2025
From the heart of Germany's automotive sector to manufacturing hubs across F...
19/06/2025
GeForce NOW is throwing open the vault doors to welcome the legendary Borderland series to the cloud.
Whether a seasoned Vault Hunter or new to the mayhem of P...
18/06/2025
Project G-Assist - available through the NVIDIA App - is an experimental AI assistant that helps tune, control and optimize NVIDIA GeForce RTX systems.
NVIDIA&...
17/06/2025
As a global labor shortage leaves 50 million positions unfilled across industrie...
13/06/2025
Industrial AI isn't slowing down. Germany is ready.
Following London Tech Week and GTC Paris at VivaTech, NVIDIA founder and CEO Jensen Huang's Europea...
12/06/2025
Generative AI has reshaped how people create, imagine and interact with digital ...
12/06/2025
Level up GeForce NOW experiences this summer with 40% off Performance Day Passes. Enjoy 24 hours of premium cloud gaming with RTX ON, delivering low latency and...
11/06/2025
NVIDIA is launching a comprehensive, industry-defining autonomous vehicle (AV) software platform to accelerate large-scale deployment of safe, intelligent trans...
11/06/2025
NVIDIA Research has developed an AI light switch for videos that can turn daytim...
11/06/2025
Using NVIDIA platforms, tools and libraries, European telecommunications institu...
11/06/2025
NVIDIA was today named an Autonomous Grand Challenge winner at the Computer Visi...
11/06/2025
In the face of growing labor shortages and need for sustainability, European man...
11/06/2025
AI is packing and shipping efficiency for the retail and consumer packaged goods (CPG) industries, with a majority of surveyed companies in the space reporting ...
11/06/2025
Urban populations are expected to double by 2050, which means around 2.5 billion...
11/06/2025
Telecom companies last year spent nearly $295 billion in capital expenditures an...
11/06/2025
In a new effort to advance sovereign AI for European public service media, NVIDI...
11/06/2025
At GTC Paris - held alongside VivaTech, Europe's largest tech event - NVIDIA founder and CEO Jensen Huang delivered a clear message: Europe isn't just a...
10/06/2025
Germany's Leibniz Supercomputing Centre, LRZ, is gaining a new supercomputer...
10/06/2025
With a more detailed simulation of the Earth's climate, scientists and resea...
10/06/2025
Cisco and NVIDIA are helping set a new standard for secure, scalable and high-performance enterprise AI.
Announced today at the Cisco Live conference in San Di...
09/06/2025
AI isn't waiting. And this week, neither is Europe.
At London's Olympia, under a ceiling of steel beams and enveloped by the thrum of startup pitches, ...
08/06/2025
U.K. Prime Minister Keir Starmer's ambition for Britain to be an AI maker, not an AI taker, is becoming a reality at London Tech Week.
With NVIDIA's ...
05/06/2025
GeForce NOW is a gamer's ticket to an unforgettable summer of gaming. With 25 titles coming this month and endless ways to play, the summer is going to be e...
04/06/2025
NVIDIA is working with companies worldwide to build out AI factories - speeding ...
04/06/2025
Humans learn the norms, values and behaviors of society from each other - and Bernt B rnich, founder and CEO of 1X Technologies, thinks robots should learn like...
04/06/2025
4:2:2 cameras - capable of capturing double the color information compared with most standard cameras - are becoming widely available for consumers. At the same...
02/06/2025
Editor's note: This blog, originally published on October 28, 2024, has been...
02/06/2025
Since a 7.8-magnitude earthquake hit Syria and T rkiye two years ago - leaving 5...
29/05/2025
Ready for a front-row seat to the next scientific revolution?
That's the idea behind Doudna - a groundbreaking supercomputer announced today at Lawrence Be...
29/05/2025
Large language models (LLMs), trained on datasets with billions of tokens, can generate high-quality content. They're the backbone for many of the most popu...
29/05/2025
GeForce NOW is supercharging Valve's Steam Deck with a new native app - delivering the high-quality GeForce RTX-powered gameplay members are used to on a po...
28/05/2025
Building effective agentic AI systems requires rethinking how technology interac...
27/05/2025
Over a century ago, Henry Ford pioneered the mass production of cars and engines...
27/05/2025
NVIDIA and Google share a long-standing relationship rooted in advancing AI inno...
22/05/2025
GeForce NOW is turning up the heat this summer with a hot new deal. For a limited time, save 40% on six-month Performance memberships and enjoy premium GeForce ...
21/05/2025
As robots increasingly make their way to the largest enterprises' manufacturing plants and warehouses, the need for access to critical business and operatio...
20/05/2025
Industrial AI is transforming how factories operate, innovate and scale.
The convergence of AI, simulation and digital twins is poised to unlock new levels of ...
19/05/2025
Agentic AI is redefining scientific discovery and unlocking research breakthroughs and innovations across industries. Through deepened collaboration, NVIDIA and...
19/05/2025
Across robot training and development, NVIDIA Research is uncovering breakthroughs in areas such as multimodal generative AI and synthetic data generation.
The...
19/05/2025
Generative AI is transforming PC software into breakthrough experiences - from digital humans to writing assistants, intelligent agents and creative tools.
NVI...
18/05/2025
Electricity. The Internet. Now it's time for another major technology, AI, to sweep the globe.
NVIDIA founder and CEO Jensen Huang took the stage at a pack...
18/05/2025
Empowering engineering teams with more tools for building AI factories, NVIDIA t...
18/05/2025
The age of video analytics AI agents is here.
Video is one of the defining feat...
18/05/2025
TSMC, Cadence, KLA, Siemens and Synopsys are advancing semiconductor manufacturi...
18/05/2025
NVIDIA is highlighting significant momentum for its new Grace CPU C1 this week at the COMPUTEX trade show in Taipei, with a strong showing of support from key o...
18/05/2025
Researchers across Taiwan are tackling complex challenges in AI development, climate science and quantum computing. Their work will soon be boosted by a new sup...
18/05/2025
Leading healthcare organizations across the globe are using agentic AI, robotics...
18/05/2025
Quantum computing promises to shorten the path to solving some of the world'...
15/05/2025
Editor's note: This post is part of Into the Omniverse, a series focused on ...
15/05/2025
AI is creating value for everyone - from researchers in drug discovery to quantitative analysts navigating financial market changes.
The faster an AI system ca...