Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

21/07/2026

Savannah Bananas Tap Calrec to Expand Banana Ball TV Coverage

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

Where Growth Takes Root Viaccess-Orca Showcases the Found...

Across the TV and streaming ecosystem, industry players face mounting pressure to do more with less. They must simplify operations, protect premium content and ...

21/07/2026

Tuxera breaks performance ceilings and brings SMB/NFS mul...

Tuxera, a leading prover of quality-assured file systems and networking technologies, is bringing its latest advances in connectivity performance to the media w...

21/07/2026

COW Jobs: Apple Motion Expert for Custom FCP Rigged Graphics Package

COW Jobs: Apple Motion Expert for Custom FCP Rigged Graphics Package Brie Clayton July 21, 2026 0 Comments HIRING: Apple Motion Expert for Custom FCP ...

21/07/2026

Cinegy directly addresses the real issues of software-def...

Cinegy GmbH, the premier provider of software-defined television technology, will use its presence at IBC2026 (stand 7.A01, Amsterdam RAI, 11 14 September) to...

21/07/2026

Calrec brings leading audio solutions and long term busin...

Calrec will be located in Hall 8, on Stand C47 Beyond bigger For years, broadcast facilities were built around one assumption: provision for the biggest pro...

21/07/2026

Pebble takes the next step towards the future of media de...

Pebble, the leading automation, content management and integrated channel specialist, will discuss its future-facing developments for the new generation of medi...

21/07/2026

nxtedition Brings Production, AI and Automation Together...

nxtedition returns to IBC2026 with its consolidated production platform, showing how scripting, editing, graphics, AI-assisted tools and automation can work wit...

21/07/2026

Big Blue Marble brings C2PA Content Credentials to Cloud...

C2PA content signing helps broadcasters, public institutions, and publishers give audiences a verifiable record of where their video content came from and how i...

21/07/2026

HDHomeRun Enables Operation During Internet Outages

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

Calif. Federal Judge Pauses Paramount-WBD Merger

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

AWARN Rebuts Weigel Claims of 3.0 EAS Problems

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

FCC Announces Tentative Agenda for August Open Meeting

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

VIDA Introduces QC Manager for Collaborative Quality Cont...

New capability centralizes collaboration, feedback, security and status tracking within VIDA, providing a structured, auditable approach to master quality contr...

21/07/2026

Lightcraft Launches Exclusive Spark Story Beta for Filmmakers and Creators at SIGGRAPH 2026

Lightcraft Launches Exclusive Spark Story Beta for Filmmakers and Creators at SI...

21/07/2026

Indie Road Movie Where in the Hell Shot with Pocket Cinema Camera 4K

Indie Road Movie Where in the Hell Shot with Pocket Cinema Camera 4K Brie Clayton July 20, 2026 0 Comments Colorist blends vintage film looks to shape...

21/07/2026

Which USS Defiant Pulse Phaser effect is better?

Which USS Defiant Pulse Phaser effect is better? Graham Quince July 20, 2026 0 Comments Aargh, ever since @DarkRavenProductions posted a comment ask...

21/07/2026

Built for Vera Rubin, NVIDIA Spectrum-6 Arrives in Gigascale AI Factories

AI has entered the gigascale era. The world's most advanced AI factories are bringing together hundreds of thousands of GPUs and CPUs to train frontier mod...

21/07/2026

NVIDIA Vera Rubin Driving Performance Per Watt, Lowest Token Cost for Partners Worldwide

NVIDIA Vera Rubin is here, and it's going gigascale. Vera Rubin NVL72 produ...

21/07/2026

RT announces biggest ever year for new drama

160 hours of Irish storytelling for 2026 KIN and The Walsh Sisters return RT has today unveiled its most ambitious drama slate ever, with a record-breakin...

20/07/2026

SVG All-Stars: Rob Coons, Senior Director, StudentU, Big Ten Network

The former Northwestern broadcast-operations leader is helping train the next generation of live-sports-production talent across the Big Ten The sports-product...

20/07/2026

Give Me the Backstory: Get to Know Stacey Lee, the Filmmaker Behind Murder 101

By Lucy Spicer One of the most exciting things about the Sundance Film Festival is having a front-row seat for the bright future of independent filmmaking. Whi...

20/07/2026

Graph Tech Guitar Labs open UK Online Store

Product range now readily available in the UK Graph Tech Guitar Labs have just announced the launch of a new UK Online Store that makes it quicker and easie...

20/07/2026

Audeze launch the Maxwell 2 ANC

Popular headset gains active noise cancellation The Maxwell headet was Audeze's first foray into the gaming world, and thanks to its Dolby Atmos compati...

20/07/2026

The National Film and Video Foundation (NFVF) Call for Public Screening funding applications for Cycle 1, 2026/27 financial year is Open

The NFVF, an agency of the Department of Sport, Arts and Culture, has released t...

20/07/2026

Telemundo Inks Another Major U.S. Spanish-Language Soccer Deal

Share Copy link Facebook X Linkedin Bluesky Email...

20/07/2026

HDHomeRun Enables Operation During An Internet Outage

Share Copy link Facebook X Linkedin Bluesky Email...

20/07/2026

Starfish highlights flexible, scalable transport stream p...

Starfish Technologies will use IBC2026 to showcase the flexibility of its transport stream processing software, including the latest versions of TS Splicer (Win...

20/07/2026

Bitfocus makes the connections at IBC2026

Bitfocus, the specialist in media control and monitoring, will show at IBC2026 (Elgato stand 8.D31, Amsterdam RAI, 11 14 September) how its Buttons control la...

20/07/2026

Mediagenix Introduces Trusted Agentic AI Operating Model...

Mediagenix, a global leader in smart content solutions to profitably connect the right content to the right audience, today announced new AI capabilities that e...

20/07/2026

Big Blue Marble Cloud DRM nominated for Streaming Media R...

Big Blue Marble's Cloud DRM has been nominated in the DRM/Content Protection category of the 2026 Streaming Media Readers' Choice Awards. Only four pro...

20/07/2026

Sky brings free global roaming to millions of loyal customers when they choose Sky Mobile

Monday 20 July 2026 Sky brings free global roaming to millions of loyal custome...

20/07/2026

Red Seat Ventures Announces Introduction of Premium Creator and Podcast Communities to Amazon DSP

Red Seat Ventures Announces Introduction of Premium Creator and Podcast Communit...

20/07/2026

RT secures exclusive free-to-air Irish rights to the 2030 FIFA World Cup

FIFA World Cup Final sets new RT Player record as the most-streamed single event in the platform's history Over 1 million viewers watched live on RT 2 as ...

20/07/2026

At SIGGRAPH, NVIDIA Advances Graphics and Simulation With Agentic and Physical AI

At this year's SIGGRAPH conference, running through Thursday, July 23, in Lo...

20/07/2026

Bristol Myers Squibb Building Life Science Industry's Most Advanced AI Factory on NVIDIA Vera Rubin

Erin Davis calls it the SuperDuperPOD. That's two things in one name: phar...

19/07/2026

Halftime Show at FIFA World Cup Final Joins a Litany of Firsts for the Quadrennial Event

Justin Bieber, Madonna, Shakira, BTS make for a diverse lineup, and the venue ad...

19/07/2026

More Than Just a Game: FIFA World Cup's Lance Brass Breaks Down Stadium Production and Entertainment

The stage is set: three-time champion Argentina will defend its World Cup title ...

19/07/2026

Acustica reveal Mystic 2

Channel strip plug-in gets upgraded Acustica Audio's vintage-inspired channel strip plug-in has just been treated to an update that expands its tonal ra...

18/07/2026

More Than Just a Game: FIFA World Cups Lance Brass Breaks Down Stadium Production & Entertainment

Topics include pre-match ceremonies, live performances, the tournament's fir...

18/07/2026

As the Final Approaches, FIFA and HBS Take Stock of a World Cup That Rewrote the Production Playbook

When FIFA and HBS set out to produce the 2026 FIFA World Cup, the numbers alone ...

18/07/2026

IK Multimedia add Brown Panel Signature Collection to TONEX

Captures nine sought-after Fender amps IK Multimedia's latest TONEX expansion captures a selection of nine rare Brown Panel' Fender amps that were ...

18/07/2026

Frap Tools update the Magnolia

Latest batch ships alongside firmware update Since being unveiled at Superbooth 2025, Frap Tools' debut polysynth has been met with widespread praise, a...

18/07/2026

Netflix Viewing Hit Record 97 Billion Hours in First Half of 2026

Share Copy link Facebook X Linkedin Bluesky Email...

18/07/2026

YouTube's Creative Ecosystem Contributed $60 Billion to U.S. GDP

Share Copy link Facebook X Linkedin Bluesky Email...

17/07/2026

SVG GameDay, Ep. 24: Mercedes-Benz Stadiums Cole Gallagher - Supporting Shows in the ATL

In-venue and creative video staffers at the professional and collegiate level ha...