NVIDIA today announced Nemotron-4 340B, a family of open models that developers can use to generate synthetic data for training large language models (LLMs) for commercial applications across healthcare, finance, manufacturing, retail and every other industry.
High-quality training data plays a critical role in the performance, accuracy and quality of responses from a custom LLM - but robust datasets can be prohibitively expensive and difficult to access.
Through a uniquely permissive open model license, Nemotron-4 340B gives developers a free, scalable way to generate synthetic data that can help build powerful LLMs.
The Nemotron-4 340B family includes base, instruct and reward models that form a pipeline to generate synthetic data used for training and refining LLMs. The models are optimized to work with NVIDIA NeMo, an open-source framework for end-to-end model training, including data curation, customization and evaluation. They're also optimized for inference with the open-source NVIDIA TensorRT-LLM library.
Nemotron-4 340B can be downloaded now from the NVIDIA NGC catalog and from Hugging Face, where developers can also use the Train on DGX Cloud service to easily fine-tune open AI models. Developers will soon be able to access the models at ai.nvidia.com, where they'll be packaged as an NVIDIA NIM microservice with a standard application programming interface that can be deployed anywhere.
Navigating Nemotron to Generate Synthetic Data LLMs can help developers generate synthetic training data in scenarios where access to large, diverse labeled datasets is limited.
The Nemotron-4 340B Instruct model creates diverse synthetic data that mimics the characteristics of real-world data, helping improve data quality to increase the performance and robustness of custom LLMs across various domains.
Then, to boost the quality of the AI-generated data, developers can use the Nemotron-4 340B Reward model to filter for high-quality responses. Nemotron-4 340B Reward grades responses on five attributes: helpfulness, correctness, coherence, complexity and verbosity. It's currently first place on the Hugging Face RewardBench leaderboard, created by AI2, for evaluating the capabilities, safety and pitfalls of reward models.
In this synthetic data generation pipeline, (1) the Nemotron-4 340B Instruct model is first used to produce synthetic text-based output. An evaluator model, (2) Nemotron-4 340B Reward, then assesses this generated text - providing feedback that guides iterative improvements and ensures the synthetic data is accurate, relevant and aligned with specific requirements. Researchers can also create their own instruct or reward models by customizing the Nemotron-4 340B Base model using their proprietary data, combined with the included HelpSteer2 dataset.
Fine-Tuning With NeMo, Optimizing for Inference With TensorRT-LLM Using open-source NVIDIA NeMo and NVIDIA TensorRT-LLM, developers can optimize the efficiency of their instruct and reward models to generate synthetic data and to score responses.
All Nemotron-4 340B models are optimized with TensorRT-LLM to take advantage of tensor parallelism, a type of model parallelism in which individual weight matrices are split across multiple GPUs and servers, enabling efficient inference at scale.
Nemotron-4 340B Base, trained on 9 trillion tokens, can be customized using the NeMo framework to adapt to specific use cases or domains. This fine-tuning process benefits from extensive pretraining data and yields more accurate outputs for specific downstream tasks.
A variety of customization methods are available through the NeMo framework, including supervised fine-tuning and parameter-efficient fine-tuning methods such as low-rank adaptation, or LoRA.
To boost model quality, developers can align their models with NeMo Aligner and datasets annotated by Nemotron-4 340B Reward. Alignment is a key step in training LLMs, where a model's behavior is fine-tuned using algorithms like reinforcement learning from human feedback (RLHF) to ensure its outputs are safe, accurate, contextually appropriate and consistent with its intended goals.
Businesses seeking enterprise-grade support and security for production environments can also access NeMo and TensorRT-LLM through the cloud-native NVIDIA AI Enterprise software platform, which provides accelerated and efficient runtimes for generative AI foundation models.
Evaluating Model Security and Getting Started The Nemotron-4 340B Instruct model underwent extensive safety evaluation, including adversarial tests, and performed well across a wide range of risk indicators. Users should still perform careful evaluation of the model's outputs to ensure the synthetically generated data is suitable, safe and accurate for their use case.
For more information on model security and safety evaluation, read the model card.
Download Nemotron-4 340B models via NVIDIA NGC and Hugging Face. For more details, read the research papers on the model and dataset.
See notice regarding software product information.
North America Stories
14/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
14/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
14/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
13/01/2026
NHL Situation Room 2.0: How Sony Hawk-Eye Powers Centralized Officiating, Player...
13/01/2026
NBC Sports Ices the Audio for the 2026 Prevagen U.S. Figure Skating Championship...
13/01/2026
DMF and MXL in practice: Which vendors are adopting it, and how fast is the ecos...
13/01/2026
CES 2026: Five Important Sports-Tech BuzzwordsThe terms highlight innovations for sports production at the showBy Daniel Frankel, SVG Contributor
Tuesday, Jan...
13/01/2026
For TGL Season 2, Unity 6 Boosts Virtual-Graphic Quality; COSM 360 Cameras Impro...
13/01/2026
Resetting Expectations? The State of the Sports Industry with Devoncroft's J...
13/01/2026
Top Row L-R: Ana Katz, Natalia Almada, Bao Nguyen, Tatiana Maslany, A.V. Rockwell, Dr. Heather Berlin
Second Row L-R: Sophie Barthes, Azazel Jacobs, Janicza Br...
13/01/2026
DoW to invest $1B in planned independently traded Missile Solutions business...
13/01/2026
L3Harris Chairman and CEO Christopher Kubasik and Under Secretary of War for Acq...
13/01/2026
Singapore - January 13, 2026 - Nielsen today announced the appointment of Matty Lin to its Commercial Organization as APAC regional sales leader.
Based in Sing...
13/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
13/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
13/01/2026
Nine-week performance series brings music, dance, theatre, and storytelling to downtown Durham, January - March 2026 (Durham, NC) The Chamber Orchestra of the T...
13/01/2026
Berklee Launches AIMS, an Artist-Centered Summit on Music and AI Hosted by the Berklee Emerging Artistic Technology Lab (BEATL), the event will focus on the i...
13/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
13/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
13/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
13/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
13/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
13/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
13/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
13/01/2026
NVIDIA and Lilly are putting together a blueprint for what is possible in the f...
13/01/2026
viztrick AiDi, Provided by Nippon TV and FOR-A, Powers Automatic 9:16 Cropping with Auto-Tracking and Intuitive Operation for Dynamic Streaming Content
Targ...
12/01/2026
Sports and Music Unite: A Look Back at the Operationally Ambitious FIFA Club Wor...
12/01/2026
Nielsen Panel Discussion Highlights World Cup Impact for FOX, Telemundo, MetLife...
12/01/2026
FIFA President Infantino Highlights How AI Will Impact 2026 FIFA World Cup and B...
12/01/2026
Baltimore Ravens' Jack Dana on Telling a Better Story With Media Management ...
12/01/2026
FOX Sports' Brad Cheney on Spectrum Debate's Impact on the Sports-Produc...
12/01/2026
Australia and New Zealand VP Alan Clements shares L3Harris' leadership insig...
12/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
12/01/2026
Berklee International Folk Festival Celebrates 40 Years Featuring Grammy-winning alumna Arooj Aftab, the milestone concert and weeklong festival marks four de...
12/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
12/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
12/01/2026
Back to All News
Kento Nakajima To Star in Netflix Manga Adaptation S&X', ...
12/01/2026
Back to All News
Netflix Celebrates Partnership and Progress at Fort Monmouth Closing Ceremony
Governor Phil Murphy, Netflix co-CEO, and Governor-elect Mikie ...
12/01/2026
Back to All News
WWE By the Numbers: Celebrating One Year on Netflix
From left to right: Rey Mysterio, Intercontinental Champion John Cena and Sheamus celebr...
10/01/2026
By Bailey Pennick
One of the most exciting things about the Sundance Film Festi...
10/01/2026
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
10/01/2026
Back to All News
Connection and Youth Defined: The Ramparts of Ice Brings a Hea...
09/01/2026
Rock-It Sports' Deron Brown & Laura Rowlands on Launching a New Brand, Suppl...
09/01/2026
Warner Bros. Discovery's Chris Brown on the Broadcaster's First French O...
09/01/2026
NFL Playoffs 2026: CBS Sports Travels to Jacksonville With Packed Arsenal of Pro...
09/01/2026
NFL Playoffs 2026: NBC Sports Is Set To Roll Out New Scorebar, Insert Graphics T...
09/01/2026
NFL Playoffs 2026: Prime Video Production Team Caps Historic Season With Iconic ...
09/01/2026
NFL Playoffs 2026: FOX Sports Kicks Off Postseason Slate With Two-Game Wild Card...
09/01/2026
NFL Playoffs 2026: ESPN's Run Brings Monday Night Football' Flagship Op...
NVIDIA today announced Nemotron-4 340B, a family of open models that developers can use to generate synthetic data for training large language models (LLMs) for commercial applications across healthcare, finance, manufacturing, retail and every other industry.
