
NVIDIA today announced Nemotron-4 340B, a family of open models that developers can use to generate synthetic data for training large language models (LLMs) for commercial applications across healthcare, finance, manufacturing, retail and every other industry.
High-quality training data plays a critical role in the performance, accuracy and quality of responses from a custom LLM - but robust datasets can be prohibitively expensive and difficult to access.
Through a uniquely permissive open model license, Nemotron-4 340B gives developers a free, scalable way to generate synthetic data that can help build powerful LLMs.
The Nemotron-4 340B family includes base, instruct and reward models that form a pipeline to generate synthetic data used for training and refining LLMs. The models are optimized to work with NVIDIA NeMo, an open-source framework for end-to-end model training, including data curation, customization and evaluation. They're also optimized for inference with the open-source NVIDIA TensorRT-LLM library.
Nemotron-4 340B can be downloaded now from the NVIDIA NGC catalog and from Hugging Face, where developers can also use the Train on DGX Cloud service to easily fine-tune open AI models. Developers will soon be able to access the models at ai.nvidia.com, where they'll be packaged as an NVIDIA NIM microservice with a standard application programming interface that can be deployed anywhere.
Navigating Nemotron to Generate Synthetic Data LLMs can help developers generate synthetic training data in scenarios where access to large, diverse labeled datasets is limited.
The Nemotron-4 340B Instruct model creates diverse synthetic data that mimics the characteristics of real-world data, helping improve data quality to increase the performance and robustness of custom LLMs across various domains.
Then, to boost the quality of the AI-generated data, developers can use the Nemotron-4 340B Reward model to filter for high-quality responses. Nemotron-4 340B Reward grades responses on five attributes: helpfulness, correctness, coherence, complexity and verbosity. It's currently first place on the Hugging Face RewardBench leaderboard, created by AI2, for evaluating the capabilities, safety and pitfalls of reward models.
In this synthetic data generation pipeline, (1) the Nemotron-4 340B Instruct model is first used to produce synthetic text-based output. An evaluator model, (2) Nemotron-4 340B Reward, then assesses this generated text - providing feedback that guides iterative improvements and ensures the synthetic data is accurate, relevant and aligned with specific requirements. Researchers can also create their own instruct or reward models by customizing the Nemotron-4 340B Base model using their proprietary data, combined with the included HelpSteer2 dataset.
Fine-Tuning With NeMo, Optimizing for Inference With TensorRT-LLM Using open-source NVIDIA NeMo and NVIDIA TensorRT-LLM, developers can optimize the efficiency of their instruct and reward models to generate synthetic data and to score responses.
All Nemotron-4 340B models are optimized with TensorRT-LLM to take advantage of tensor parallelism, a type of model parallelism in which individual weight matrices are split across multiple GPUs and servers, enabling efficient inference at scale.
Nemotron-4 340B Base, trained on 9 trillion tokens, can be customized using the NeMo framework to adapt to specific use cases or domains. This fine-tuning process benefits from extensive pretraining data and yields more accurate outputs for specific downstream tasks.
A variety of customization methods are available through the NeMo framework, including supervised fine-tuning and parameter-efficient fine-tuning methods such as low-rank adaptation, or LoRA.
To boost model quality, developers can align their models with NeMo Aligner and datasets annotated by Nemotron-4 340B Reward. Alignment is a key step in training LLMs, where a model's behavior is fine-tuned using algorithms like reinforcement learning from human feedback (RLHF) to ensure its outputs are safe, accurate, contextually appropriate and consistent with its intended goals.
Businesses seeking enterprise-grade support and security for production environments can also access NeMo and TensorRT-LLM through the cloud-native NVIDIA AI Enterprise software platform, which provides accelerated and efficient runtimes for generative AI foundation models.
Evaluating Model Security and Getting Started The Nemotron-4 340B Instruct model underwent extensive safety evaluation, including adversarial tests, and performed well across a wide range of risk indicators. Users should still perform careful evaluation of the model's outputs to ensure the synthetically generated data is suitable, safe and accurate for their use case.
For more information on model security and safety evaluation, read the model card.
Download Nemotron-4 340B models via NVIDIA NGC and Hugging Face. For more details, read the research papers on the model and dataset.
See notice regarding software product information.
North America Stories
19/05/2026
Cisco and the USGA have announced a multiyear extension of their partnership, which began in 2018. Cisco serves as the Official Technology Partner of the USGA, ...
19/05/2026
Urban Edge Network (UEN), a streaming platform for NAIA sports, has announced a partnership with Spiideo to provide streaming and production tools to UEN's ...
19/05/2026
Warner Bros. Discovery (WBD) will provide live coverage of all 900 Roland-Garros matches across its platforms beginning with qualifiers on May 18. In Europe, 21...
19/05/2026
Tubi, Fox Corporation's free streaming service, has announced the launch of the FIFA World Cup 2026 FOX Hub, a dedicated destination for World Cup programmi...
19/05/2026
Telef nica, in collaboration with Sony, has conducted a 5G connectivity trial at the Movistar Arena in Spain using the 26 GHz millimetre wave (mmWave) band. The...
19/05/2026
Ross Production Services (RPS) has installed a Calrec Argo M console into its new Hypermax-1 remote production truck, replacing one of three Argo S consoles pre...
19/05/2026
Panasonic Projector and Display Corporation has announced the acquisition of 100% of the shares of UK-based media technology company Hive Media Control Ltd. (HI...
19/05/2026
Globecast has announced the completion of a nine-month renovation of its Singapore facility, converting it from a traditional linear broadcast operation into a ...
19/05/2026
Grass Valley has announced a three-year enterprise agreement with Phoenix Broadc...
19/05/2026
Bitmovin has announced that Watch Brasil, a streaming platform operating across Brazil and Europe since 2018, has replaced its legacy systems with Bitmovin'...
19/05/2026
Ateme has announced the migration of Dish Home Nepal's Nepal Premier League (NPL) streaming infrastructure to Ateme's TITAN Live solution deployed on Ak...
19/05/2026
CMSI provided workflow, media management, and HDR support for ESPN during coverage of the NCAA Gymnastics Semifinals and Championships. The company supported fi...
19/05/2026
In advance of this year's Sports Emmy Awards, SVG is taking a deep dive into the six production-technologies nominated for this year's George Wensel Tec...
19/05/2026
In advance of this year's Sports Emmy Awards, SVG is taking a deep dive into the six production-technologies nominated for this year's George Wensel Tec...
19/05/2026
Featuring a fully IP infrastructure, Supershooter 11 is intended for large-scale events. Enabling remote and distributed workflows, Supershooter 65 joins the RE...
19/05/2026
By Jessica Herndon
The line wrapped around the building outside Denver's La...
19/05/2026
When all companies in the market are allowed to compete under the same set of ru...
19/05/2026
Battle-proven technology withstands electronic warfare threats across air, maritime surface and subsea domains....
19/05/2026
WESCAM MX-Series EO/IR systems provide high-precision targeting across domains, including counter-UAS applications...
19/05/2026
Champaign, IL - March 16, 2026 Cobalt Digital, the leading designer and manufa...
19/05/2026
CHAMPAIGN, Ill. April 16, 2026 - Cobalt Digital today announced a partnership ...
19/05/2026
Las Vegas - April 18, 2026 Cobalt Digital, the leading designer and manufactur...
19/05/2026
LAS VEGAS April 18, 2026 - Advanced HDR by Technicolor and Cobalt Digital are ...
19/05/2026
LAS VEGAS - May 4, 2026 - Cobalt Digital, the leading designer and manufacturer of signal processing products, and a founding partner in the openGear initiativ...
19/05/2026
London - 11 May 2026 Cobalt Digital, the leading designer and manufacturer of award-winning signal processing products, and a founding partner in the openGear...
19/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
19/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
19/05/2026
Grass Valley has entered into a three-year enterprise agreement with Phoenix Broadcast Solutions as the Singapore-based company expands its live production oper...
19/05/2026
Clear-Com supported Musikal Perahu Kertas, a large-scale musical theater production in Indonesia adapted from the acclaimed novel by Dee Lestari, through the d...
19/05/2026
Actus Digital, a LiveU company, and a leading provider of intelligent media monitoring and broadcast compliance platforms, announced today that METEO CONSULT ha...
19/05/2026
Globecast, a leading provider of managed services for the broadcast and media industry, today announced the completion of a major renovation of its Singapore fa...
19/05/2026
Following a major upgrade to its Connecticut remote production centre with the installation of three 60-fader Argo S consoles in 2023, RPS has switched one of t...
19/05/2026
PlayBox Technology today announced the launch of Celebro Play, a browser-based media orchestration platform designed specifically for broadcast facilities and p...
19/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
19/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
19/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
19/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
19/05/2026
LYNX Technik, provider of modular signal processing solutions for broadcast, post, and professional AV will showcase its latest signal processing solutions at B...
19/05/2026
Media Links, a leading developer and manufacturer of IP media transport solutions, has announced the integration of its Xscend platform with Skyline Communicat...
19/05/2026
Collaboration expands regional partner ecosystem as Media Links showcases IP media transport solutions on stand 4M4-4 and alongside Clearcast Asia on stand
Me...
19/05/2026
Company Highlights Labor-Saving Control and Custom Branding Opportunities Designed to Increase Integrator Profitability
LynTec, a leading manufacturer of ele...
19/05/2026
Mago Studio Moves AI Video Beyond Prompts with New Production-Focused Tools
Brie Clayton May 18, 2026
0 Comments
New Capabilities Bring Controllable, ...
19/05/2026
It May be Time to Stop and Take an AI Breather
Brie Clayton May 19, 2026
0 Comments
If the rock you stay on starts to roll, jump clean. Or you'll...
19/05/2026
Back to All News
Netflix Unveils the Trailer for RAFA, the Documentary Series A...
19/05/2026
Back to All News
Netflix Expands Consumer Products Footprint with Strategic Con...
19/05/2026
Matt Derella Expands Leadership Across LinkedIn Ads and Microsoft Advertising Published on May 19, 2026 Categories: Company News
LinkedIn Corporate Commun...
18/05/2026
Despite a bumpy start to the year, the provider of event-production support and ...
18/05/2026
Daktronics has partnered with the University of North Carolina to manufacture and install 11 LED displays totaling more than 10,000 square feet and more than 14...
18/05/2026
CBS LA has announced a multi-year partnership with the Los Angeles Rams, covering exclusive local broadcasts of Rams preseason games, weekly year-round programm...