Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

11/08/2026

Dolby Acquires VVC Patents From Florida Atlantic University

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

Alyson Stewart Joins Zixi as Senior Director, Sales

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

FCC Issues Alert Over Scammers Impersonating Its Commissioners

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

Comcast, Disney Ink Deal to End NFL Network Blackout

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

farmerswife and Cirkus are Exhibiting at IBC 2026

farmerswife and Cirkus will return to IBC 2026 to showcase new tools designed to help broadcast, media and post-production teams manage workflows with greater s...

11/08/2026

LiveU Powers Cross-Venue Coverage of Glasgow Commonwealth...

LiveUs LU900Q intelligent production unit played a central role in the host broadcast operation for the Games in Glasgow (July 23 to August 2, 2026). The host b...

11/08/2026

Jigsaw24 Appoints James Morse as Client Director to Drive...

Jigsaw24 has appointed James Morse as Client Director, Media Sales, as it deepens its focus on sports, live events and integrated production. His appointment co...

11/08/2026

Net Insight enables one of Europes largest broadcast grad...

Net Insight today announced that DMC Production Norway has selected its Open Live Media solution to centralize the production of Blinkfestivalen 2026. Combining...

11/08/2026

Vivaro Supports Record World Cup Audiences with the Appea...

Modular HEVC and JPEG XS workflows enabled resilient, ultra-low-latency delivery for leading linear and digital media platforms across all 104 matches Appear A...

11/08/2026

Homecoming Artist Spotlight: Fabiola Mndez

Homecoming Artist Spotlight: Fabiola M ndez The first cuatrista to graduate from Berklee talks about the community that shaped her career ahead of her Homecom...

11/08/2026

FOR-A To Highlight MixBoard, Viztrik AiDi Enhancement At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

AMWA and EBU to Host Demos at IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

Dalet Solution Suites Enable Media Teams to Move Like a S...

Dalet, a leading technology and service provider for media-rich organizations, today announced Dalet Solution Suites, a new portfolio of cloud-native solutions ...

11/08/2026

Mediagenix Helps Broadcasters Prepare for Brazil DTV Futu...

Mediagenix, a global leader in smart content solutions to profitably connect the right content to the right audience, will showcase how media companies can prep...

11/08/2026

Transforming your audience into advocates with Kelsey Gamble

Transforming your audience into advocates with Kelsey Gamble 10 August 2026 Building community, harnessing fandom for marketing and activating the four stages ...

11/08/2026

Why Scaling AI Compute Performance Requires a New Power Architecture

Every new generation of accelerated computing demands more from the infrastructure underneath it - more compute performance, higher rack density and more effici...

11/08/2026

Documentary reflecting on the 2015 Marriage Equality Referendum to air on RT

A Day in May airs Wednesday 12 August at 9.35pm RT One and RT Player A Day in May revisits the people and stories behind Ireland's historic marriage equa...

11/08/2026

NVIDIA Nemotron 3.5 Lightning and NeMo Switchyard Deliver Faster, Smarter, More Efficient Agentic AI

As AI shifts from chatbots to autonomous agents, open models are serving market ...

11/08/2026

NVIDIA and Local AI Community Fuel Open Source Models and Intelligent Agents

The open source ecosystem is making it easier for AI enthusiasts and developers to build, customize and run increasingly capable agents locally. Throughout Au...

10/08/2026

Apple to Bring Friday Night Baseball' Live to Apple Immersive on Vision Pro Beginning Aug. 28

Weekly immersive broadcasts will feature 8K 3D video, a 180-degree field of view...

10/08/2026

Raiju from fedDSP

Saturation plug-in free until 20 August 2026 fedDSP have announced the launch of Raiju, a new guitar pedal-style saturation plug-in that's capable of de...

10/08/2026

I/O Music release Talkback

New mix-comparison & feedback tool Independent Swedish record label I/O Music have recently released a handy new tool that provides artists, engineers, prod...

10/08/2026

Sound Radix launch Radical1 Solo

Additive soft synth gains free counterpart Sound Radix have just released a free monophonic additive software synth that's based on the same engine as t...

10/08/2026

Chroma integrates MXO oscilloscopes into ATS 8000 platform, rounding out its high-end power testing ecosystem

Chroma integrates MXO oscilloscopes into ATS 8000 platform, rounding out its hig...

10/08/2026

Former NAB Tech Exec Tom Keller Has Died

Share Copy link Facebook X Linkedin Bluesky Email...

10/08/2026

Matthews Bows Monitor Stand III

Share Copy link Facebook X Linkedin Bluesky Email...

10/08/2026

AES Elects David v.R. Bowles as President-Elect for 2027

Share Copy link Facebook X Linkedin Bluesky Email...

10/08/2026

NUGEN Audio Helps SFCM Students Achieve Professional Mixe...

Students in the Technology and Applied Composition (TAC) program at the San Francisco Conservatory of Music (SFCM) gain rare, real world experience in professio...

10/08/2026

FOR-A demonstrates new and practical solutions to real ch...

FOR-A is using its presence at IBC2026 (stand 2.B53, Amsterdam RAI, 11 14 September) to show how its products deliver the answers to the real challenges faced...

10/08/2026

Frontier EU brings broadcast-grade network resilience to...

Frontier EU, official Peplink distributor for Europe, will exhibit at IBC 2026 in Amsterdam from 11 to 14 September, presenting live demonstrations of how Pepli...

10/08/2026

Remote Editing Without Cloud Storage Premiere Pro

Remote Editing Without Cloud Storage Premiere Pro Michael Cioni August 10, 2026 0 Comments This is a step-by-step guide that demonstrates how to setup...

10/08/2026

Stunning Pixelated ASCII Effect for Apple Motion

Stunning Pixelated ASCII Effect for Apple Motion Simon Ubsdell August 10, 2026 0 Comments Apple Motion is perfect for building this popular ASCII unic...

10/08/2026

New York Jets, CBS New York Extend Deal

Share Copy link Facebook X Linkedin Bluesky Email...

10/08/2026

Welcome to the Show: Sky Creative unites football fans with start of season campaign

Monday 10 August 2026 Welcome to the Show : Sky Creative unites football fans w...

10/08/2026

Red Seat Ventures' Speakeasy Brings Video to Apple Podcasts, Beginning with Surrounded

Red Seat Ventures' Speakeasy Brings Video to Apple Podcasts, Beginning with ...

10/08/2026

30% More Pumping Hours With Autonomous Frac Operations

A major unconventional operator increased monthly pumping hours by more than 30% by automating critical frac completion processes and eliminating common sources...

10/08/2026

Apple, MLB announce September \u201CFriday Night Baseball\u201D schedule - UPDATE - Posted on 10 August 2026

Today, Apple and Major League Baseball (MLB) unveiled the September schedule for...

09/08/2026

reFX introduce Rippler

Combines physical modelling with subtractive synthesis reFX, the company behind the popular Nexus and Vanguard2 soft synths have announced the launch of the...

09/08/2026

Dreamtonics tease upcoming release

Human nuance is not a switch Dreamtonics have built up a solid reputation off the back of their Synthesizer V Studio software, a powerful vocal-synthesis t...

09/08/2026

COW Jobs: Documentary Editor - Remote

COW Jobs: Documentary Editor - Remote Brie Clayton August 9, 2026 0 Comments Documentary Editor July 31, 2026COW Jobs: Lead Generation Representativ...

08/08/2026

IK Multimedia launch Tonex 2.0 beta

Enhanced ToneNET integration & 220 new Premium V2 Tone Models IK Multimedia have just launched a public beta of Tonex 2.0, a release which is said to repres...

08/08/2026

Roland celebrate 808 Day

Honouring the drum machine that redefined modern music Roland have announced their plans for this year's 808 Day, a day that was founded to celebrate th...

08/08/2026

Call for Entries Now Open for the 20th Annual South African Film & Television Awards (SAFTAs20)

The National Film and Video Foundation (NFVF), an agency of the Department of Sp...

08/08/2026

Star Wars Hyperspeed Tutorial: The No-Echo Method in After Effects

Star Wars Hyperspeed Tutorial: The No-Echo Method in After Effects Graham Quince August 8, 2026 0 Comments The Echo Effect to create long streaks is n...

08/08/2026

Chyron Releases AXIS 4.0 With Expanded News Workflows and Richer Map Storytelling

Chyron Releases AXIS 4.0 With Expanded News Workflows and Richer Map Storytellin...

08/08/2026

Nielsen to Acquire DoubleVerify for $2.15 Billion

Share Copy link Facebook X Linkedin Bluesky Email...