Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

29/09/2026

Netflix Deploys Advanced Sony PTZ Cameras For Wonka's The Golden Ticket' Production

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Massachusetts Broadcasters Association Names Gene Lavanchy 2026 Broadcaster of the Year

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

ESPN Reports Its Most-Watched WNBA Regular Season

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Scripps Taps Digital News Veteran Sean McGarvy to Lead News Strategy

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Gray Raises Political Ad Revenue Estimates

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Edward Czarnecki Uses Game Theory to Assess ATSC 3.0 Transition Policies

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

First Baptist Nashville Drastically Upgrades Production C...

Clear-Com announced that First Baptist Nashville has upgraded its production communications with a Clear-Com intercom solution as part of a comprehensive sanct...

29/09/2026

Blackmagic Cinema Camera 6K Captured Action Shots for Sketch

Blackmagic Cinema Camera 6K Captured Action Shots for Sketch Brie Clayton September 28, 2026 0 Comments Camera's portable design and dynamic range...

29/09/2026

Kean Production Services Deploys AJA ColorBox to Deliver Consistent, Accurate Color Across In-venue Displays at Live Events

Kean Production Services Deploys AJA ColorBox to Deliver Consistent, Accurate Co...

29/09/2026

Berklee Alumni and Faculty Nominated for the 2026 Latin Grammy Awards

Berklee Alumni and Faculty Nominated for the 2026 Latin Grammy Awards A total of 28 Berklee alumni and faculty earned nominations across 20 categories this ye...

29/09/2026

Berklee's K-Pop & Beyond Explores Connections Between K-Pop and Hip-Hop

Berklee's K-Pop & Beyond Explores Connections Between K-Pop and Hip-Hop Now in its fifth year, the series brings together artists, industry leaders, and s...

28/09/2026

NHL Names Adobe as an Official Creative, Marketing and AI Partner

The NHL has announced Adobe as an Official Creative, Marketing and AI Partner beginning with the 2026-27 season. The partnership will provide the league and its...

28/09/2026

MultiDyne to Showcase Expanded Portfolio Including MRMC Robotics at CABSAT 2026

MultiDyne will exhibit at CABSAT 2026 (October 5-7, Dubai Exhibition Centre), showcasing an expanded technology portfolio following its June 2026 acquisition of...

28/09/2026

ARRI and HONOR Launch Co-Branded HONOR Magic9 Pro Max

ARRI and HONOR have announced the HONOR Magic9 Pro Max, a flagship smartphone carrying ARRI branding on the device and packaging as the first product-level expr...

28/09/2026

Net Insight Adds Nimbra 1020G to Pan-Asian Live Media Trial Network

Net Insight has added the Nimbra 1020G to its pan-Asian live media trial network, giving customers and partners in the region a way to evaluate ST 2110 and JPEG...

28/09/2026

Vindral Named Recipient of 2026 Technology and Engineering Emmy Award

Vindral has been named a recipient of a 2026 Technology and Engineering Emmy Award by the National Academy of Television Arts and Sciences in the category of We...

28/09/2026

Interra Systems to Demonstrate QC and Monitoring Portfolio at CABSAT 2026

Interra Systems will exhibit at CABSAT 2026 (Stand B2-37, Dubai Exhibition Centre, October 5-7), demonstrating its BATON QC platform, ORION monitoring solutions...

28/09/2026

PGA TOUR's Michael Raimondo on Agentic Production, ShotLink Automation, and the Evolution of PGA TOUR Studios

Two years into its new production facility, the TOUR is expanding centralized wo...

28/09/2026

Game Creek Videos Epic Building Run Continues With ESPNs Countdown Unit, Upgrades to Four Others

In addition to rolling out a new mobile unit for ESPN's Monday Night Countd...

28/09/2026

Bleacher Report and WWE Reach Multi-Year Global Content Partnership

Bleacher Report and WWE have announced a multi-year content partnership giving Bleacher Report global highlight rights across WWE's programming slate, inclu...

28/09/2026

Behind The Mic: NBC Sports Shares MLB Wild Card Series Announcing Booth; ESPN Reveals NHL 26-27 Season Talent

Behind The Mic provides a roundup of recent news regarding on-air talent, includ...

28/09/2026

Fubo Adds Four NHL Regional Sports Networks for 2026-27 Season

FuboTV has announced a multi-year distribution agreement with the NHL to carry four regional sports networks covering the Carolina Hurricanes, Columbus Blue Jac...

28/09/2026

Program Productions Names Alan Ostfield President and CEO

Program Productions (PPI) has announced the appointment of Alan Ostfield as President and Chief Executive Officer, effective September 28, 2026. Ostfield succee...

28/09/2026

Ha-chan, Shake Your Booty! Encourages Us to Keep Dancing

Director Josef Kubota Wladyka attends the premiere of Ha-Chan, Shake Your Booty! with the film's cast and crew at Eccles Theatre on January 22, 2026, in P...

28/09/2026

Scaler Music introduce Scaler EQ Pro

EQ plug-in can now be played via MIDI Scaler Music have recently released a new and improved version of their patented musical EQ plug-in, kitting it out wi...

28/09/2026

The Asura from Animal Factory Amps

New synth developed in collaboration with philterSoup Boutique effects pedal and Eurorack manufacturer Animal Factory Amps have announced that the new compa...

28/09/2026

Rohde & Schwarz adds an integrated multi-channel pulse analysis option to its FSWX signal and spectrum analyzer

Rohde & Schwarz adds an integrated multi-channel pulse analysis option to its FS...

28/09/2026

SBE Announces 2026 Ennes Scholarship Recipients

Share Copy link Facebook X Linkedin Bluesky Email...

28/09/2026

Spectrum to Demo AI Computing at the Network's Edge at SCTE TechExpo 26

Share Copy link Facebook X Linkedin Bluesky Email...

28/09/2026

Autoscript launches new Voice Controller prompting soluti...

Autoscript, the leading global provider of professional teleprompting solutions, today announced Voice Controller for WinPlus-IP, a new voice-controlled prompti...

28/09/2026

IBC 2026 Technical Conference Highlights

IBC 2026 Technical Conference Highlights David Kirk September 28, 2026 0 Comments Hero image courtesy Deposit Photos David Kirk reports from the 11-1...

28/09/2026

First Baptist Nashville Taps Clear-Com for Production Coms

Share Copy link Facebook X Linkedin Bluesky Email...

28/09/2026

IEEE Announces Award for Leadership in Developing HEVC/H.265

Share Copy link Facebook X Linkedin Bluesky Email...

28/09/2026

Nakadi Introduces Live to Theater Service Powered by Pate...

Nakadi, a global streaming technology innovator dedicated to engineering a new era of digital media delivery, today announced its Live to Theater service based ...

28/09/2026

Sky launches Full Fibre 1.6 Gbps for millions of homes

Monday 28 September 2026 Sky launches Full Fibre 1.6 Gbps for millions of homes Sky has launched a new Full Fibre 1.6 Gbps product, rolling out from today, gi...

28/09/2026

Arvato Systems Highlights Its Role for Automakers and Suppliers

Arvato Systems Highlights It's Role for Automotive Manufacturers and Suppliers TISAX Arvato Systems has successfully completed the TISAX Level 3 assess...

28/09/2026

Crimecall returns for a brand-new series

Crimecall, presented by Carla O'Brien, returns tonight for a brand new series at 9.35pm on RT One and RT Player. In tonight's episode, alongside appe...

28/09/2026

RT SHORT STORY COMPETITION 2026 - SHORTLISTED STORIES ANNOUNCED

CELEBRATING 40 YEARS AT THE HEART OF NEW IRISH WRITING LIVE FROM POETRY IRELAND, DUBLIN AND ON RT RADIO 1 FROM 7PM DETAILS: www.rte.ie/writing | FOLLOW: #r...

27/09/2026

Boss launch the EX-4 Effects Expander

New compact pedal packs in 120 effects The latest multi-effects pedal from Boss is a compact unit that promises to give any pedalboard a massive boost in s...

26/09/2026

ESPN Operations, Production Teams Plan for Every Scenario as WNBA Playoffs Tip Off

With short turnaround between game selections, ESPN's operations team is pla...

26/09/2026

Prime Video Scales Up for First WNBA Postseason, Adding Cameras, Analysts, Coach Mics, and NBA Mobile Units

Prime Video will use GCV's Bird and Magic mobile units for its inaugural WNB...

26/09/2026

NBC Sports Tips Off First WNBA Postseason in 20+ Years Using Sunday Night Basketball as a Production Baseline

Studio show moves on-site as network models playoff coverage on its NBA flagship...

26/09/2026

Ratings Roundup: Cowboys-Commanders Leads NFL Week 2 With 27.2 Million, College GameDay Posts Best Week 3 Ever

Ratings Roundup is a rundown of recent ratings news and is derived from press re...

26/09/2026

From Sketch to Strut, Unzipped Returns to the Sundance Film Festival at 30

Douglas Keeve attends the 2025 Sundance Film Festival screening of Unzipped at the Egyptian Theatre. (Photo by Andrew H. Walker/Shutterstock for Sundance Film...

26/09/2026

Native Instruments update Maschine

Launched alongside three new expansion packs In celebration of their 30th anniversary, Native Instruments have released a major update for their Maschine 3 ...

26/09/2026

YouTube Embraces Microdramas with Features for Episodic Shorts

Share Copy link Facebook X Linkedin Bluesky Email...

26/09/2026

Civil Rights Groups Urge Sen. Cruz to Delay Thumann Severs FCC Confirmation

Share Copy link Facebook X Linkedin Bluesky Email...