Sony Pixel Power calrec Sony

AI, Go Fetch! New NVIDIA NeMo Retriever Microservices Boost LLM Accuracy and Throughput

23/07/2024

Generative AI applications have little, or sometimes negative, value without accuracy - and accuracy is rooted in data.

To help developers efficiently fetch the best proprietary data to generate knowledgeable responses for their AI applications, NVIDIA today announced four new NVIDIA NeMo Retriever NIM inference microservices.

Combined with NVIDIA NIM inference microservices for the Llama 3.1 model collection, also announced today, NeMo Retriever NIM microservices enable enterprises to scale to agentic AI workflows - where AI applications operate accurately with minimal intervention or supervision - while delivering the highest accuracy retrieval-augmented generation, or RAG.

NeMo Retriever allows organizations to seamlessly connect custom models to diverse business data and deliver highly accurate responses for AI applications using RAG. In essence, the production-ready microservices enable highly accurate information retrieval for building highly accurate AI applications.

For example, NeMo Retriever can boost model accuracy and throughput for developers creating AI agents and customer service chatbots, analyzing security vulnerabilities or extracting insights from complex supply chain information.

NIM inference microservices enable high-performance, easy-to-use, enterprise-grade inferencing. And with NeMo Retriever NIM microservices, developers can benefit from all of this - superpowered by their data.

These new NeMo Retriever embedding and reranking NIM microservices are now generally available:

NV-EmbedQA-E5-v5, a popular community base embedding model optimized for text question-answering retrieval

NV-EmbedQA-Mistral7B-v2, a popular multilingual community base model fine-tuned for text embedding for high-accuracy question answering

Snowflake-Arctic-Embed-L, an optimized community model, and

NV-RerankQA-Mistral4B-v3, a popular community base model fine-tuned for text reranking for high-accuracy question answering.

They join the collection of NIM microservices easily accessible through the NVIDIA API catalog.

Embedding and Reranking Models NeMo Retriever NIM microservices comprise two model types - embedding and reranking - with open and commercial offerings that ensure transparency and reliability.

Example RAG pipeline using NVIDIA NIM microservices for Llama 3.1 and NeMo Retriever embedding and reranking NIM microservices for a customer service AI chatbot application. An embedding model transforms diverse data - such as text, images, charts and video - into numerical vectors, stored in a vector database, while capturing their meaning and nuance. Embedding models are fast and computationally less expensive than traditional large language models, or LLMs.

A reranking model ingests data and a query, then scores the data according to its relevance to the query. Such models offer significant accuracy improvements while being computationally complex and slower than embedding models.

NeMo Retriever provides the best of both worlds. By casting a wide net of data to be retrieved with an embedding NIM, then using a reranking NIM to trim the results for relevancy, developers tapping NeMo Retriever can build a pipeline that ensures the most helpful, accurate results for their enterprise.

With NeMo Retriever, developers get access to state-of-the-art open, commercial models for building text Q&A retrieval pipelines that provide the highest accuracy. When compared with alternate models, NeMo Retriever NIM microservices provided 30% fewer inaccurate answers for enterprise question answering.

Comparison of NeMo Retriever embedding NIM and embedding plus reranking NIM microservices performance versus lexical search and an alternative embedder. Top Use Cases From RAG and AI agent solutions to data-driven analytics and more, NeMo Retriever powers a wide range of AI applications.

The microservices can be used to build intelligent chatbots that provide accurate, context-aware responses. They can help analyze vast amounts of data to identify security vulnerabilities. They can assist in extracting insights from complex supply chain information. And they can boost AI-enabled retail shopping advisors that offer natural, personalized shopping experiences, among other tasks.

NVIDIA AI workflows for these use cases provide an easy, supported starting point for developing generative AI-powered technologies.

Dozens of NVIDIA data platform partners are working with NeMo Retriever NIM microservices to boost their AI models' accuracy and throughput.

DataStax has integrated NeMo Retriever embedding NIM microservices in its Astra DB and Hyper-Converged platforms, enabling the company to bring accurate, generative AI-enhanced RAG capabilities to customers with faster time to market.

Cohesity will integrate NVIDIA NeMo Retriever microservices with its AI product, Cohesity Gaia, to help customers put their data to work to power insightful, transformative generative AI applications through RAG.

Kinetica will use NVIDIA NeMo Retriever to develop LLM agents that can interact with complex networks in natural language to respond more quickly to outages or breaches - turning insights into immediate action.

NetApp is collaborating with NVIDIA to connect NeMo Retriever microservices to exabytes of data on its intelligent data infrastructure. Every NetApp ONTAP customer will be able to seamlessly talk to their data to access proprietary business insights without having to compromise the security or privacy of their data.

NVIDIA global system integrator partners including Accenture, Deloitte, Infosys, LTTS, Tata Consultancy Services, Tech Mahindra and Wipro, as well as service delivery partners Data Monsters, EXLService (Ireland) Limited, Latentview, Quantiphi, Slalom, SoftServe and Tredence, are developing services to help enterprises add NeMo Retriever NIM microservices into their AI pipelines.

Use
LINK: https://blogs.nvidia.com/blog/nemo-retriever-microservices/...
See more stories from nvidia

Most recent headlines

09/11/2025

Dalet Unveils Agentic AI Media Workflows at IBC2025

Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...

15/10/2025

Seeking Astrobiological Potential Millions of Miles from Earth

One of humanity's most profound questions continues: Is there any place in our galaxy suitable for life beyond Earth? NASA intends to find out, with the hel...

15/10/2025

Austin PBS Expands Facility-Wide Production Communications with Clear-Com

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

15/10/2025

Scality debuts industry-first AI certifications with more...

Scality, a global leader in cyber-resilient storage software for the AI era, today announced the advancement of its comprehensive AI ecosystem certification pro...

15/10/2025

2026 HPA Tech Retreat to Deliver Insight Innovation and I...

The Hollywood Professional Association (HPA) today unveiled key highlights of the 2026 HPA Tech Retreat, scheduled for Feb. 15 19 at the Westin Rancho Mirage Go...

15/10/2025

Interra Systems Drives Quality Compliance and Monetizatio...

At NAB Show New York 2025 (Stand 244), Interra Systems will showcase the future of media QC, monitoring, and captioning, highlighting its award-winning, AI- and...

15/10/2025

RMC BFM Group Selects Grass Valley to Power its Transitio...

Grass Valley today announced that RMC BFM, part of the CMA-CGM Group and France's third-largest private media group, has chosen Grass Valley's productio...

15/10/2025

Appear to Showcase Next-Generation Hybrid Live Production...

Appear, the global leader in live production technology, will demonstrate how its powerful hardware and software innovations are shaping the future of hybrid, s...

15/10/2025

Rakim to Join Berklee's Hip-Hop Hall of Fame at Signature Series Concert

Rakim to Join Berklee's Hip-Hop Hall of Fame at Signature Series Concert The rap icon becomes the latest inductee, following luminaries such as Roxanne Sh...

15/10/2025

Berklee Brings Live Music to the Head of the Charles

Berklee Brings Live Music to the Head of the Charles Student artists will perform on multiple riverfront stages during the 60th anniversary of the world's...

15/10/2025

CobbTV Taps Pebble for Playout Automation

CobbTV, the government access television channel for Cobb County, Ga. recently acquired an automated playout system from Pebble, a global provider of automation...

15/10/2025

Appear to Showcase Next-Generation Hybrid Live Production at NAB Show NY

OSLO, Norway Appear, the global leader in live production technology, will demonstrate how its powerful hardware and software innovations are shaping the future...

15/10/2025

NBA Unveils Updated NBA App and Reimagined' NBA TV

NEW YORK The NBA is making major changes to the NBA App and NBA TV as it takes control of them from TNT Sports, which has long managed the league's digital ...

15/10/2025

DirecTV Announces Major Expansion of Interactive AI-Powered Features

SAN MATEO, Calif. In what promises to be a major expansion of interactive features and personalized content on the DirecTV platform, the operator and Glance hav...

15/10/2025

Roku Upgrades User Interface to Showcase Original Content

SAN JOSE, Calif. Roku has launched changes to its user interface (UI) that the streaming platform says will better showcase original programming on the platform...

15/10/2025

OpenDrives Promotes Alex Dunfey to CTO

LOS ANGELES Software-defined data storage and data services provider OpenDrives has elevated Alex Dunfey to chief technology officer, responsible for driving th...

15/10/2025

Revenge Series The Resurrected' Captivates Audiences Across Asia

Back to All News Revenge Series The Resurrected' Captivates Audiences Across Asia Entertainment 15 October 2025 GlobalTaiwan Link copied to clipboard ...

15/10/2025

Bringing the Best in VFX and Virtual Production Together as Eyeline

Back to All News Bringing the Best in VFX and Virtual Production Together as Eyeline Jeffrey Shapiro CEO, Eyeline Business 15 October 2025 GlobalCanadaInd...

15/10/2025

NESN Redefines Regional Sports Video Delivery with Harmonic

Deployed by Astound Business Solutions, Harmonic's Primary Distribution Solution Ensures Outstanding Video Quality and Seamless Ad Insertion at the Edge SA...

15/10/2025

RMC BFM Group Selects Grass Valley to Power its Transition to IP and UHD Production

Collaboration extends a trusted relationship as RMC BFM invests in scalable, fut...

15/10/2025

First look at new RT comedy-drama These Sacred Vows

Series coming in 2026 stars Tom Vaughan-Lawlor, Justine Mitchell and Jason O'Mara released today RT today released first look images of new comedy-drama ...

14/10/2025

SVG Europe Summit 2025: All Sessions Now Available to Watch on SVG PLAY

SVG Europe Summit 2025: All Sessions Now Available to Watch on SVG PLAYNetworking event that preceded IBC2025 shone a light on elite live sports innovation acro...

14/10/2025

SVG Sit-Down: Author Rich Podolsky on Writing Madden & Summerall: How They Revolutionized NFL Broadcasting'

SVG Sit-Down: Author Rich Podolsky on Writing Madden & Summerall: How They Revo...

14/10/2025

SVG All-Stars: Michael Reiners, Coordinating Producer, FloRacing

SVG All-Stars: Michael Reiners, Coordinating Producer, FloRacingThe Illinois State grad steers a vast schedule of motorsports events at tracks across the countr...

14/10/2025

Content Protection: Getting the Right Management for Your DRM

Content protection: Getting the right management for your DRM By Neal Romanek Friday, October 10, 2025 - 10:11 Print This Story Eluvio power the EPCR'...

14/10/2025

As League Takes Over Ops, NBA TV and NBA App Add 60 Games, Weekday Studio Show, Global Matchups, and More

As League Takes Over Ops, NBA TV and NBA App Add 60 Games, Weekday Studio Show, ...

14/10/2025

Time and Effort: World's Largest Student-Led Broadcast Prepares to Go On Air for 24 Hours this Week

Time and effort: World's largest student-led broadcast prepares to go On Air...

14/10/2025

The Perfect Neighbor Takes a Novel Approach to Examining America's Race and Gun Violence

(L-R) Guest, Kimberly Robinson Jones, Geeta Gandbhir, Pamela Dias, and Takema Ro...

14/10/2025

Spotify Premium bietet jetzt verlustfreies Audio fr ein detailreicheres Hrerlebnis

Lossless ist jetzt mit Spotify Premium verf gbar. Verlustfreies Audio war eine...

14/10/2025

La qualit Lossless arrive sur Spotify Premium, pour une exprience d'coute plus riche

La qualit Lossless est disponible sur Spotify Premium. Le format sans perte de...

14/10/2025

Ed Sheeran's Play' Hits the Pitch as Spotify and FC Barcelona Launch Latest El Clsico Jersey Takeover

For the seventh edition of Spotify and FC Barcelona's artist jersey series, ...

14/10/2025

Spotify Expands Managed Accounts for Young Listeners on Premium Family Plans

Spotify is committed to bringing the best listening experience to all our users, and that includes parents and families. That's why we're expanding mana...

14/10/2025

Spotify's Fiction Podcast Caso 63' Reaches an Epic Conclusion

Since its debut, the Spotify Original podcast Caso 63 has been more than just a story; it's been a cultural sensation. The science fiction thriller captivat...

14/10/2025

El podcast de ficcin de Spotify, Caso 63,' llega a un pico final

Desde su debut, el podcast original de Spotify Caso 63 ha sido mucho m s que una historia: se ha convertido en un fen meno cultural. Este thriller de ciencia fi...

14/10/2025

Nu kan du lyssna med lossless-kvalitet p Spotify Premium

Lossless p Spotify Premium r h r. Lossless-ljud har varit en av de mest efterl ngtade funktionerna p Spotify och nu, ntligen, har den b rjat rullas ut til...

14/10/2025

Spotify Studios and The Ringer Video Podcasts Are Coming to Netflix

Early next year, your favorite video podcasts are getting a bigger stage. Spotify and Netflix are teaming up to bring sports, culture, lifestyle, and true crime...

14/10/2025

4th Safety Day at SGL Carbon puts occupational safety in the spotlight

Last week, the 4th global Safety Day took place at all SGL Carbon sites. This years Safety Day focused on hazardous substances. Various information events, wor...

14/10/2025

Latest Nielsen consumer data shows Everything's too expensive

From bowser to basket, 9 in 10 Aussies are feeling the impact of rising prices 26% of households earn over $160k, but are still concerned about rising prices...

14/10/2025

Latest Nielsen data shows Aussies are careful with cash, but careless with loyalty

New players take a bite out of big bank share as consumers increasingly value tr...

14/10/2025

From road trips to recipes, Nielsen data shows Aussies are choosing simple pleasures over big splurges

56% of Aussies are looking for a coastal holiday, while 40% are planning a road ...

14/10/2025

Nielsen data shows Aussies are set to swap utes for EVs in green gold rush

51% of Aussies want a hybrid car and 36% want a full EV Toyota leads the market 75% research online before a new car purchase Sydney - October 14, 2025 - Aus...

14/10/2025

Nielsen reveals Indonesia's biggest advertisers and top spending ad categories

Unilever leads the market Beverages, smartphones, and food dominate category sp...

14/10/2025

Nielsen Ad Intel data shows increasing ad spend by insurance brands as competition increases

Top insurance advertisers Biggest growth categories Sector ad spend up 4.7...

14/10/2025

Saothair Capital Partners Acquires GatesAir

WAYNE, Pa. Private-equity firm Saothair Capital Partners said it has completed the acquisition of GatesAir through a newly-formed affiliate....

14/10/2025

Space Norway chooses Media Excel HERO 6000 to power next-...

Media Excel, a leading provider of encoding and transcoding solutions, today announced that Space Norway, a leading provider of satellite services and operator ...

14/10/2025

ZTransform Welcomes Jason Tyler as Inside Sales and Procu...

Jason Tyler has joined ZTransform, a leader in media environment innovation, as Inside Sales and Procurement Manager bringing commercial and operational focus t...

14/10/2025

Tiny toys, big missions: Knee High Spies launches on ABC this November

14 10 2025 - Media release Tiny toys, big missions: Knee High Spies launches on ABC this November Knee High Spies Kids, assemble! The ABC and Screen Australi...

14/10/2025

University of Arizona Scales Up Broadcast Capabilities With Riedel Communications Intercom Solution

Wuppertal October 14, 2025 University of Arizona Scales Up Broadcast Capabilit...

14/10/2025

Space42 and e& Partner to Accelerate Vehicle-to-Everything Technologies for Autonomous Mobility in the UAE

Abu Dhabi, UAE October 14, 2025: Space42 (ADX: SPACE42), the AI-powered SpaceT...