Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

10/08/2026

Apple to Bring Friday Night Baseball' Live to Apple Immersive on Vision Pro Beginning Aug. 28

Weekly immersive broadcasts will feature 8K 3D video, a 180-degree field of view...

10/08/2026

Raiju from fedDSP

Saturation plug-in free until 20 August 2026 fedDSP have announced the launch of Raiju, a new guitar pedal-style saturation plug-in that's capable of de...

10/08/2026

I/O Music release Talkback

New mix-comparison & feedback tool Independent Swedish record label I/O Music have recently released a handy new tool that provides artists, engineers, prod...

10/08/2026

Sound Radix launch Radical1 Solo

Additive soft synth gains free counterpart Sound Radix have just released a free monophonic additive software synth that's based on the same engine as t...

10/08/2026

Chroma integrates MXO oscilloscopes into ATS 8000 platform, rounding out its high-end power testing ecosystem

Chroma integrates MXO oscilloscopes into ATS 8000 platform, rounding out its hig...

10/08/2026

Former NAB Tech Exec Tom Keller Has Died

Share Copy link Facebook X Linkedin Bluesky Email...

10/08/2026

Matthews Bows Monitor Stand III

Share Copy link Facebook X Linkedin Bluesky Email...

10/08/2026

AES Elects David v.R. Bowles as President-Elect for 2027

Share Copy link Facebook X Linkedin Bluesky Email...

10/08/2026

NUGEN Audio Helps SFCM Students Achieve Professional Mixe...

Students in the Technology and Applied Composition (TAC) program at the San Francisco Conservatory of Music (SFCM) gain rare, real world experience in professio...

10/08/2026

FOR-A demonstrates new and practical solutions to real ch...

FOR-A is using its presence at IBC2026 (stand 2.B53, Amsterdam RAI, 11 14 September) to show how its products deliver the answers to the real challenges faced...

10/08/2026

Frontier EU brings broadcast-grade network resilience to...

Frontier EU, official Peplink distributor for Europe, will exhibit at IBC 2026 in Amsterdam from 11 to 14 September, presenting live demonstrations of how Pepli...

10/08/2026

Remote Editing Without Cloud Storage Premiere Pro

Remote Editing Without Cloud Storage Premiere Pro Michael Cioni August 10, 2026 0 Comments This is a step-by-step guide that demonstrates how to setup...

10/08/2026

Stunning Pixelated ASCII Effect for Apple Motion

Stunning Pixelated ASCII Effect for Apple Motion Simon Ubsdell August 10, 2026 0 Comments Apple Motion is perfect for building this popular ASCII unic...

10/08/2026

New York Jets, CBS New York Extend Deal

Share Copy link Facebook X Linkedin Bluesky Email...

10/08/2026

Welcome to the Show: Sky Creative unites football fans with start of season campaign

Monday 10 August 2026 Welcome to the Show : Sky Creative unites football fans w...

10/08/2026

Red Seat Ventures' Speakeasy Brings Video to Apple Podcasts, Beginning with Surrounded

Red Seat Ventures' Speakeasy Brings Video to Apple Podcasts, Beginning with ...

10/08/2026

30% More Pumping Hours With Autonomous Frac Operations

A major unconventional operator increased monthly pumping hours by more than 30% by automating critical frac completion processes and eliminating common sources...

10/08/2026

Apple, MLB announce September \u201CFriday Night Baseball\u201D schedule - UPDATE - Posted on 10 August 2026

Today, Apple and Major League Baseball (MLB) unveiled the September schedule for...

09/08/2026

reFX introduce Rippler

Combines physical modelling with subtractive synthesis reFX, the company behind the popular Nexus and Vanguard2 soft synths have announced the launch of the...

09/08/2026

Dreamtonics tease upcoming release

Human nuance is not a switch Dreamtonics have built up a solid reputation off the back of their Synthesizer V Studio software, a powerful vocal-synthesis t...

09/08/2026

COW Jobs: Documentary Editor - Remote

COW Jobs: Documentary Editor - Remote Brie Clayton August 9, 2026 0 Comments Documentary Editor July 31, 2026COW Jobs: Lead Generation Representativ...

08/08/2026

IK Multimedia launch Tonex 2.0 beta

Enhanced ToneNET integration & 220 new Premium V2 Tone Models IK Multimedia have just launched a public beta of Tonex 2.0, a release which is said to repres...

08/08/2026

Roland celebrate 808 Day

Honouring the drum machine that redefined modern music Roland have announced their plans for this year's 808 Day, a day that was founded to celebrate th...

08/08/2026

Call for Entries Now Open for the 20th Annual South African Film & Television Awards (SAFTAs20)

The National Film and Video Foundation (NFVF), an agency of the Department of Sp...

08/08/2026

Star Wars Hyperspeed Tutorial: The No-Echo Method in After Effects

Star Wars Hyperspeed Tutorial: The No-Echo Method in After Effects Graham Quince August 8, 2026 0 Comments The Echo Effect to create long streaks is n...

08/08/2026

Chyron Releases AXIS 4.0 With Expanded News Workflows and Richer Map Storytelling

Chyron Releases AXIS 4.0 With Expanded News Workflows and Richer Map Storytellin...

08/08/2026

Nielsen to Acquire DoubleVerify for $2.15 Billion

Share Copy link Facebook X Linkedin Bluesky Email...

08/08/2026

FCC Chair Carr Announces New Legal Advisor

Share Copy link Facebook X Linkedin Bluesky Email...

08/08/2026

Trump Nominates Danielle Thumann Severs to FCC Commission Seat

Share Copy link Facebook X Linkedin Bluesky Email...

08/08/2026

New York Jets, CBS New York Extends Deal with New York Jets

Share Copy link Facebook X Linkedin Bluesky Email...

08/08/2026

Foundry Unlocks Professional-Grade AI for VFX with Griptape Enterprise; Appoints Kyle Roche as Chief AI Officer

Foundry Unlocks Professional-Grade AI for VFX with Griptape Enterprise; Appoints...

08/08/2026

Award Winning New Horror Film Shot Using Blackmagic Camera App

Award Winning New Horror Film Shot Using Blackmagic Camera App Brie Clayton August 7, 2026 0 Comments Fire Alive, shot using the Blackmagic Camera i...

08/08/2026

Firebird Launches CIS Region's Largest AI Factory in Armenia

The global buildout of AI infrastructure reached a new milestone today - Firebird, an emerging AI cloud, launched the CIS region's largest AI factory in Arm...

07/08/2026

Diversified Appoints Pete Emminger as Global Chief Technology Officer

Diversified has appointed industry veteran Pete Emminger as global chief technology officer. Emminger will lead the company's global go-to-market technology...

07/08/2026

Release Rundown: What to Watch in August, From American Doctor to Idiots

O'Shea Jackson Jr., Dave Franco, and Mason Thames appear in Idiots by Macon Blair, an official selection of the 2026 Sundance Film Festival. (Courtesy of ...

07/08/2026

Sonuscore release The Sculpture

An instrument made for the adventurous composer Described as an instrument made for the adventurous composer , Sonuscore's latest sample library has b...

07/08/2026

Synchron Solo Violin 2 & Viola (sordino) join VSL line-up

Latest solo Synchron libraries arrive VSL have just released the final two instalments in their range of muted solo string libraries. Recorded in the large ...

07/08/2026

GC Audio's new Producer Channel

Channel strip offers plug-in control & recall Along with some new additions to their Inherit modular preamp system, GC Audio's announcements for NAMM 20...

07/08/2026

Opening Statement: Public hearing of the Inquiry into Racism, Hate and Violence Directed at Aboriginal and Torres Strait Islander People

Opening Statement: Public hearing of the Inquiry into Racism, Hate and Violence ...

07/08/2026

Nielsen to Acquire DoubleVerify, Creating a Leading, Independent Media Intelligence Platform

DoubleVerify Shareholders to Receive $13.60 Per Share in Cash, Representing a 30...

07/08/2026

Lawo To Highlight Dynamic Media Facility Support At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

07/08/2026

MediaKind To Feature Unified Product Portfolio At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

07/08/2026

ACT Entertainment Honored with Neutrik Group Americas Par...

The Award Recognizes ACT's Outstanding Sales Performance, Marketing Collaboration and Long-standing Commitment to the NEUTRIK Brand ACT Entertainment, one ...

07/08/2026

Beamr Brings NVIDIA Video Super Resolution to Live Sports...

Beamr Imaging Ltd. (Nasdaq: BMR), a leader in video optimization technology and solutions, today announced it is bringing AI upscaling to live sports, broadcast...

07/08/2026

Berklee City Music Presents Nine Scholarships and Awards at Annual Concert

Berklee City Music Presents Nine Scholarships and Awards at Annual Concert Student recipients from seven states and Canada received scholarships, housing awar...

07/08/2026

Lawo To Highlights Dynamic Media Facility Support At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

07/08/2026

Kevin Trueblood to Return as SBE President

Share Copy link Facebook X Linkedin Bluesky Email...