Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

06/08/2026

USA Sports Rolls Into 2026 NASCAR Season With First Pace-Car Analyst on Selected Races

The broadcaster's 14-race schedule begins in Iowa and ends in November with ...

06/08/2026

SVG GameDay, Ep. 25: Chicago Bears Katlin Strange - Serving the Masses in the Windy City

In-venue and creative video staffers at the professional and collegiate level ha...

06/08/2026

Warner Bros Discovery's Anne Graham Details the Organization's Media-Ops and Metadata Consolidation Across Sports and Entertainment

As media organizations consolidate teams, technology platforms, and content libr...

06/08/2026

Dolby Vision 2 Begins Rollout on Selected 2026 Hisense TVs

Firmware updates introduce Dolby's next-generation picture engine, content-aware optimization, and new motion and ambient-light tools...

06/08/2026

TNT Sports Preps Wall-to-Wall Coverage of FIBA Women's Basketball World Cup 2026 from Sept. 4-13

TNT Sports will have wall-to-wall coverage of the upcoming FIBA Women's Bask...

06/08/2026

IBC 2026: swXtch.io Introduces groundSwXtch Software-Defined Multicast Overlay

swXtch.io (Stand 5.MR13) has unveiled groundSwXtch for Audio over IP (AoIP), a software application that lets broadcasters and media organizations move audio in...

06/08/2026

IBC 2026: Riedel Communications Showcases Integrated IP Production Workflows

At IBC2026, Riedel Communications (Stands: 10.A24, 10.A31, 10.A38) will bring modern media production to life with the Live Production Experience - a connected ...

06/08/2026

Sandy Grossman's Legacy as a Pioneering Director Earns Pro Football Hall of Fame's Pete Rozelle Award

The first live-sports director to receive the prestigious honor, eight-time Emmy...

06/08/2026

NBC Sports, Maryland Jockey Club Continue Partnership To Present Preakness Stakes Through 2032

NBC Sports will continue to present the Preakness Stakes on NBC and Peacock thro...

06/08/2026

IBC 2026: Cobalt Digital Brings New Practical Solutions to Evolving Broadcast Workflows

Cobalt Digital (Stand 8.F90) continues to reinforce its commitment to delivering...

06/08/2026

Wave Central Elevates Jeff Daubert to Director of Sales, Americas

Wave Central has promoted promotion Jeff Daubert to Director of Sales, Americas. In his expanded role, Daubert will lead Wave Central's sales strategy and ...

06/08/2026

KMH Integration Adds Architect Keith Hanadel to Expanding Full-Services Team

KMH Integration is expanding its ability to serve media, broadcast, and IT organizations by adding Keith Hanadel, an accomplished architect with decades of indu...

06/08/2026

Advanced Systems Group Promotes Michele Ferreira to Chief Business Officer

Advanced Systems Group (ASG) has promoted Michele Ferreira from Vice President of its Systems Integration team to the newly created position of Chief Business O...

06/08/2026

IBC2026: Appear Expands X, VX Platforms for Hybrid Live-Production Workflows

Demonstrations will include new JPEG XS, Dolby audio, cloud-gateway, stream-processing, and distribution capabilities...

06/08/2026

Live Media Group Acquires Gravity Media's U.S. Mobile-Production Assets, Adds Eight Units to Fleet

The deal includes three premium mobile units, engineering personnel, existing br...

06/08/2026

Broadcast Management Group, LiveU Power Vertical REMI Production for Amazon Prime's Obsessed Fest on TikTok

Broadcast Management Group produced Amazon Prime's inaugural Obsessed Fest a...

06/08/2026

IBC2026: Ikegami to Showcase Expanded UNICAM Camera and Monitoring Lineup

Exhibit will feature new variable-ND functionality, OLED viewfinders, remote-camera tools, and UHD production monitors...

06/08/2026

Sony Introduces FE 100-400mm Super-Telephoto Zoom Lens

Compact full-frame E-mount lens targets sports, wildlife, and other long-range shooting applications...

06/08/2026

Tennis Channel Lands Exclusive U.S. Coverage of 2026 International Tennis Hall of Fame Induction Ceremony

Live broadcast will honor Roger Federer and Mary Carillo on Aug. 29, with onsite...

06/08/2026

UTEP Upgrades Sun Bowl Stadium Video Display With Daktronics

End-zone board receives higher-resolution LED technology and an updated Show Control system ahead of the 2026 football season...

06/08/2026

Fender launch Fender Motion controllers

New 16- and 32-pad MIDI controllers now available Fender have just announced that the two new performance-focused controllers that were unveiled at NAMM 202...

06/08/2026

Lewitt update Space Replicator plug-in

Standalone version, performance improvements & more Lewitt have just released a significant update for their speaker and room virtualisation software, intro...

06/08/2026

Hallowed Bells from ebbandflow

Combines celeste samples with synth engine After launching earlier in 2026 with deFORM, ebbandflow have returned with their first sampled acoustic instrumen...

06/08/2026

SGL Carbon: Still on track to meet its 2026 annual targets

SGL Carbon's consolidated sales in the first half of 2026 totaled 394.2 million, down 13.0% from the prior year (H1 2025: 453.2 million). On the one hand,...

06/08/2026

BritBox & BBC's Poirot Origin Series Hercule' Reveals Cast

The BBC has announced casting for the forthcoming six-part series Hercule from Mammoth Screen and Agatha Christie Limited. Joining Bluemel are Henry Ashton (A ...

06/08/2026

FCC Votes to Modify TV Station Ownership Caps

Share Copy link Facebook X Linkedin Bluesky Email...

06/08/2026

LTN Showcases Live Event Master Control Capabilities for...

Proven offering builds on more than 20,000 live sporting events with greater automation, flexibility, and operational control LTN , the industry leader in tran...

06/08/2026

Hornets Tech brings new encoder and decoder range to IBC2...

Hornets Tech, a specialist in broadcast connectivity and IP video, is bringing a new range of encoders, decoders and an IPTV platform to IBC2026. Broadcast in...

06/08/2026

Introducing Adobe for ChatGPT: Create, edit and get work done - all in ChatGPT

Introducing Adobe for ChatGPT: Create, edit and get work done - all in ChatGPT Deepti Pradeep August 6, 2026 0 Comments The Adobe plugin in ChatGPT br...

06/08/2026

Hisense Adds Dolby Vision 2 to Select Models

Share Copy link Facebook X Linkedin Bluesky Email...

06/08/2026

MediaKind to showcase one unified portfolio at IBC2026

At IBC2026, MediaKind will make its first major appearance as a unified global powerhouse in video, showcasing one of the world's most comprehensive video i...

06/08/2026

Big Blue Marble to unveil AI-assisted piracy detection an...

Big Blue Marble (#5.A63) will demonstrate how its integrated technology and operational expertise help media companies scale premium services with less complexi...

06/08/2026

NIH expected to award Scripps Research nearly $4.2 million over 5 years to advance tools for vaccine design

LA JOLLA, CA-Scripps Research has received more than $500,000 in first-year fund...

06/08/2026

Improving vaccine design for Ebola, HIV and more

LA JOLLA, CA-Viruses are masters at invading our cells thanks to specialized proteins that coat their surfaces. When scientists design vaccines, they often crea...

06/08/2026

How a chemical reaction triggers brain inflammation in Alzheimer's disease

LA JOLLA, CA-The brain has its own immune system, which detects threats and mounts a defense. A growing body of evidence has shown that in Alzheimer's disea...

06/08/2026

Jin-Quan Yu elected to the National Academy of Sciences

LA JOLLA, CA-Scripps Research chemist Jin-Quan Yu has been elected to the National Academy of Sciences (NAS), one of the highest honors a scientist can achieve....

06/08/2026

Scripps Research ranks third in 2026 Cure Innovation Index

LA JOLLA, CA-Scripps Research ranked third in the inaugural 2026 Cure Innovation Index recognizing the top-performing institutes and centers across the United S...

06/08/2026

Scripps Research chemist Benjamin Cravatt elected to American Philosophical Society

Benjamin Cravatt, the Gilula Chair of Chemical Biology and a professor of chemis...

06/08/2026

Scripps Research immunologist Dennis Burton elected to American Academy of Arts and Sciences

LA JOLLA, CA-Dennis Burton, professor and the James & Jessie Minor Chair in Immu...

06/08/2026

How changes to proteins can alter drug interactions for new precision therapies

LA JOLLA, CA-Inside every human cell, proteins are constantly being tagged with small chemical modifications after they're produced. Known as post-translati...

06/08/2026

Scripps Research establishes endowed chair honoring renowned structural biologist Ian Wilson

LA JOLLA-Scripps Research has established the Ian Wilson Endowed Chair, a new fa...

06/08/2026

Scripps Research's Skaggs Graduate School awards doctoral degrees to 34th graduating class

Scripps Research's Skaggs Graduate School of Chemical and Biological Science...

06/08/2026

Scripps Research chemist Jin-Quan Yu is named a Fellow of the Royal Society

LA JOLLA, CA-Professor Jin-Quan Yu of Scripps Research has been elected to the Fellowship of the Royal Society, the U.K.'s national academy of sciences and ...

06/08/2026

Experimental HIV vaccine achieves a long-sought goal

LA JOLLA, CA-For years, researchers have been hoping for vaccines that protect people against not just one strain of HIV, but every strain of the quickly mutati...

06/08/2026

Calibr-Skaggs advances CLF065, a regenerative GLP-2 therapy, into two Phase 2 IBD studies

LA JOLLA, CA-The Calibr-Skaggs Institute for Innovative Medicines, the nonprofit...

06/08/2026

Chemists snap together complex 3D molecules from highly reactive radicals'-without losing their shape

LA JOLLA, CA-Building the complex 3D molecules needed for new medicines has alwa...

06/08/2026

A fentanyl countermeasure that adapts to combat future black-market drugs

LA JOLLA, CA-Fentanyl and related variants of the synthetic opioid kill more Americans each year than car accidents and gun violence combined. In too-high doses...