Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

22/09/2026

Young Journalist Award 2026: Meet the Final 12

From Malaysia to Mexico and from DR Congo to Ukraine, this year's 12 finalists for the 2026 Thomson Foundation Young Journalist of the Year award tell extra...

22/09/2026

ESPN, Precision Lasers Light Up NHL Player Media Tour in Las Vegas

The annual preseason content-gathering event brought 36 NHL players to Las Vegas, where ESPN used 2.5 kilowatts of laser power and a motion-control camera syste...

22/09/2026

Neumann Introduces KK 104 A and KK 105 A Wireless Capsule Heads

Neumann has introduced the KK 104 A (cardioid) and KK 105 A (supercardioid) wireless capsule heads, succeeding the KK 204 and KK 205. The new capsules are compa...

22/09/2026

NFL and TMRW Sports Announce Pro Flag Showcase During Super Bowl LXI Week

The NFL and TMRW Sports have announced a new annual Pro Flag Showcase to be held during Super Bowl LXI week in Los Angeles. The event will feature top flag foot...

22/09/2026

Washington State University Unveils New Daktronics Video Board and Audio System at Gesa Field

Washington State University has unveiled a new end zone video display and audio ...

22/09/2026

SVG Sit-Down: Disney's Dave Johnson on ESPN's New 4K HDR Distribution Pipeline and What It Means for Super Bowl LXI and Beyond

Disney's SVP of Live Operations and Engineering details the technology behin...

22/09/2026

Cosm Promotes Mazen Alawar to SVP of Marketing, Alexis Scalice to VP of Cosm Studios

Cosm has announced two senior promotions. Mazen Alawar has been promoted to SVP,...

22/09/2026

Mississippi State University Extends Camera Relationship with KOKUSAI DENKI

Mississippi State University's University Television Center has purchased four KOKUSAI DENKI SK-UHD7000-S2 cameras since 2024, with plans to add two more, a...

22/09/2026

Net Insight Appoints Christine Kjellvard as Interim CFO

Net Insight has announced that Christine Kjellvard will assume the role of interim Chief Financial Officer on November 1, 2026. Kjellvard has previously held in...

22/09/2026

Net Insight Launches Zyntai TimeNode Access PTP Grandmaster for Edge Sites

Net Insight has announced Zyntai TimeNode Access, a compact PTP Grandmaster designed for distributed edge sites. The product carries secure, precise time across...

22/09/2026

The Weight Explores the High Cost of Freedom in the Depression Era

Sam Hazeldine, Austin Amelio, Padraic McKinley, Julia Jones, and Ethan Hawke attend the premiere of The Weight at The Ray Theatre on January 26, 2026, in Park...

22/09/2026

Avalanche Tones introduce Noise Suite

Second high-gain tone plug-in released Following on from their debut release, Chainsaw Suite, Avalanche Tones have announced the launch of their second plug...

22/09/2026

LW6 wireless headphones from Lewitt Audio

Uncompressed audio with below 6ms of latency Lewitt's have just introduced their first pair of headphones which, despite being aimed primarily at studio...

22/09/2026

Neumann launch the KK 104 A & KK 105 A

Two new capsule heads for Sennheiser wireless systems Neumann have announced the upcoming launch of the KK 104 A and KK 105 A, a pair of new premium condens...

22/09/2026

Apogee Plugins Are Moving to Plugin Alliance

Apogee Plugins Are Moving to Plugin Alliance We're excited to share an important update about the future of Apogee plugins. Apogee plugins are moving to Pl...

22/09/2026

SipRadius honored with a Technology And Engineering Emmy...

Parkland, Florida, US, September 22, 2026: SipRadius, widely recognized for making content processing and connectivity secure and seamless, has been honored wit...

22/09/2026

VanityFilter 3.1.5 adds project files and adjustable protection around lips, brows and ears

VanityFilter 3.1.5 adds project files and adjustable protection around lips, bro...

22/09/2026

Chile's TV+ Modernizes Broadcast Operations with Blackmagic Design

Chile's TV Modernizes Broadcast Operations with Blackmagic Design Brie Clayton September 22, 2026 0 Comments URSA Broadcast G2 brings versatility...

22/09/2026

OWC Shares Sneak Peek at Amazon Prime Big Deal Days Pricing

OWC Shares Sneak Peek at Amazon Prime Big Deal Days Pricing Brie Clayton September 22, 2026 0 Comments Image courtesy of Deposit Photos Business and ...

22/09/2026

Berklee's First Homecoming Block Party Brings Alumni Home for Global Music Festival

Berklee's First Homecoming Block Party Brings Alumni Home for Global Music F...

22/09/2026

New TVU Pocket Offers Broadcast Features In Phone-Sized Unit

Share Copy link Facebook X Linkedin Bluesky Email...

22/09/2026

Operative Launches Unified Platform for Advertising and Broadcast Management

Share Copy link Facebook X Linkedin Bluesky Email...

22/09/2026

Element Launches New TiVo-Powered Smart TVs in the U.S.

Share Copy link Facebook X Linkedin Bluesky Email...

22/09/2026

NOAA Taps Tomorrow.io for Improved U.S. Weather Forecasts

Share Copy link Facebook X Linkedin Bluesky Email...

22/09/2026

Gray Media Promotes Tim Maloney to GM and Director of Sales at WBKO

Share Copy link Facebook X Linkedin Bluesky Email...

22/09/2026

Reports: Paramount Reaches Settlement with State AGs in Antitrust Suit

Share Copy link Facebook X Linkedin Bluesky Email...

22/09/2026

New Research Lays Out Streaming Services Best Defense Against Churn

Share Copy link Facebook X Linkedin Bluesky Email...

22/09/2026

Sinclair Expands The National News Desk

Share Copy link Facebook X Linkedin Bluesky Email...

22/09/2026

Paramount Settles Antitrust Lawsuit over WBD Merger

Share Copy link Facebook X Linkedin Bluesky Email...

22/09/2026

U.S. Broadband Industry Investment Hits $92.6 Billion

Share Copy link Facebook X Linkedin Bluesky Email...

22/09/2026

Sky commissions Tupac murder trial documentary from Passion Pictures & Propagate Content

From Academy Award-winning Passion Pictures and BAFTA-winning director Marian Mo...

22/09/2026

Wi-Fi, phones and power lines: understanding EMF exposure

Whether it be from the sun or from our phones and other devices, we are all exposed to electromagnetic radiation in some shape or form. With the dramatic growth...

22/09/2026

Comscore's latest AI Intelligence Report Shows Competition Intensifying as Claude and Gemini Gain Ground on ChatGPT

Comscore's latest AI Intelligence Report Shows Competition Intensifying as C...

22/09/2026

The Factory-X Project Sets Standards for Data Sovereignty in Industry

The Factory-X Project Sets Standards for Data Sovereignty in Industry Arvato Systems Brings Digital Sovereignty to Industrial Practice Factory-X Successfully...

22/09/2026

Apple opens Apple Music Hall, a\u00A0state-of-the-art live music venue in London - PRESS RELEASE - Posted on 21 September 2026

LONDON Apple today announced the opening of Apple Music Hall, a brand-new state-...

22/09/2026

Young creativity across the island of Ireland takes centre stage as sixth RT This is Art! competition launches

RT , Creative Ireland and Shared Island Initiative ask young artists to respon...

22/09/2026

NVIDIA Isaac ROS 5.0 Advances Agentic, Open Source Robotics Development

To build and deploy sophisticated robotics applications that can perceive, reason and act in dynamic environments, developers need new physical AI models and to...

21/09/2026

Manifold Taps Ryhaan Williams for North America COO Post

Manifold Technologies, developer of software-defined, FPGA-accelerated infrastructure for live production, has named Ryhaan Williams as Chief Commercial Officer...

21/09/2026

SNS Wins IAMT Best Journal Article Award

Studio Network Solutions (SNS) has won Best Journal Article at the 2026 IAMT Impact Awards for What Video Editors Need When Everything Is Changing Around Them,...

21/09/2026

MLW Announces Streaming Deal with Tubi for Weekly FUSION Series

Major League Wrestling (MLW) has announced a streaming distribution agreement with Tubi for its weekly series MLW FUSION. Beginning September 17, new episodes w...

21/09/2026

Adam Smith Named Chairman of Direct-to-Consumer at Disney Entertainment

Disney Entertainment has announced that Adam Smith has been named Chairman, Direct-to-Consumer, with responsibility for Disney and Hulu including product, engi...

21/09/2026

United Airlines and DISH to Offer Live Football on Starlink-Enabled Seatback Screens

United Airlines and DISH have announced an agreement to bring live professional ...

21/09/2026

SES to Provide Satellite Distribution for JioStar Channels Across India

SES and JioStar have announced a multi-year agreement under which SES will provide satellite distribution services for JioStar's television channel portfoli...

21/09/2026

Detroit Red Wings Announce Detroit SportsNet Broadcast Details for 2026-27 Season

The Detroit Red Wings have announced details for their inaugural season on Detro...

21/09/2026

Manifold Technologies Appoints Ryhaan Williams as CCO for North America

Manifold Technologies has appointed Ryhaan Williams as Chief Commercial Officer for North America, effective October 1, 2026. Based in Jacksonville, Florida, Wi...

21/09/2026

DAZN Pick Up L.A. Kings DTC Streaming Rights; ABTV Will Continue as Local TV Home

Angels Broadcast Television (ABTV), the local television home of the Los Angeles...