Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

29/07/2026

SBS Appoints Chief Commercial Officer and Director of Marketing and Audiences

SBS Appoints Chief Commercial Officer and Director of Marketing and Audiences 29 July, 2026 Media releases SBS is pleased to announce the appointment of Ni...

29/07/2026

Rohde & Schwarz showcases unified next-generation broadcasting ecosystem at SET Expo 2026 in Brazil

Rohde & Schwarz showcases unified next-generation broadcasting ecosystem at SET ...

29/07/2026

Central Christian Church Connects Remote Production Teams with Clear-Com's Gen-IC...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

29/07/2026

Streaming Embarks on Annual Summer Ascent in Nielsen's May 2026 Gauge Reports

Streaming Hits 48.6% of Total TV Usage in May YouTube Leads in Media Distributo...

29/07/2026

WVIT's Joseph DiMaggio Named SBE Flanders Engineer of the Year

Share Copy link Facebook X Linkedin Bluesky Email...

29/07/2026

Amagi Appoints Martin Wacker to Lead Sales for DACH -- St...

Industry veteran joins Amagi to drive growth in Europe's leading broadcast market and advance cloud-native broadcast, FAST, and AI-driven operations. LONDO...

29/07/2026

WebTransport opens new route for broadcast-quality media...

Work is ongoing to specify how to run RIST over WebTransport. This will deliver secure, stable, broadcast quality video playback and origination to any platform...

29/07/2026

Offline Files Makes the Drive Shelf Searchable on Mac

Offline Files Makes the Drive Shelf Searchable on Mac Brie Clayton July 29, 2026 0 Comments A local Mac app for finding files, photos, and footage acr...

29/07/2026

Blackmagic Design Announces New UltraStudio Mini 12G

Blackmagic Design Announces New UltraStudio Mini 12G Brie Clayton July 29, 2026 0 Comments New extremely portable Thunderbolt 4 capture and playback ...

29/07/2026

Brightline Lighting Introduces the MOD1

Brightline Lighting, a premier manufacturer of energy-efficient lighting systems for broadcast, videoconferencing, government, education and corporate applicati...

29/07/2026

Applications open for IFFI/WAVES Film Bazaar in Goa - Producer Delegation

Applications open for IFFI/WAVES Film Bazaar in Goa - Producer Delegation 28 July 2026 Image credit: Four Years Later Screen Australia has opened applications...

29/07/2026

Brightline Unveils Compact, Suspended MOD1 LED Light

Share Copy link Facebook X Linkedin Bluesky Email...

29/07/2026

NAB Meets With Trusty on Ownership Caps

Share Copy link Facebook X Linkedin Bluesky Email...

29/07/2026

QuickLink To Feature New StudioPro AnywhereTally At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

29/07/2026

HBO Max Launches Vertical Shorts to Improve Content Discovery

Share Copy link Facebook X Linkedin Bluesky Email...

29/07/2026

New Tool Identifies Sources Of Fake Videos

Share Copy link Facebook X Linkedin Bluesky Email...

29/07/2026

DNEG Migrates Editorial Workflows to Foundrys Hiero

Foundry today announced that Academy Award-winning creative studio DNEG has implemented Hiero to support its editorial workflows. Part of the Nuke product famil...

29/07/2026

QuickLink Unveils New StudioPro AnywhereTally Remote Tall...

The Latest Addition to the Brand's StudioPro Ecosystem Combines Simple Deployment, Cloud Control and Professional Grade Wireless Reliability QuickLink, a l...

29/07/2026

The Secret Master Adjustment Layer Hack in After Effects

The Secret Master Adjustment Layer Hack in After Effects Graham Quince July 28, 2026 0 Comments Trish Meyer (who literally beta-tested the original Af...

29/07/2026

Post Completed with Blackmagic Cloud for Shane Kosugi's Feature Film SEEK

Post Completed with Blackmagic Cloud for Shane Kosugi's Feature Film SEEK Brie Clayton July 28, 2026 0 Comments Cannes Indie International Film Fe...

29/07/2026

Isabeau Miller Named Chair of Berklee Songwriting Department

Isabeau Miller Named Chair of Berklee Songwriting Department The Berklee alumna, who previously served on the Songwriting faculty, will begin her new role on ...

29/07/2026

New RT true crime podcast launches today

RT launches Unsolved, a true crime podcast, presented by crime journalist Barry Cummins and presenter Katja Mia. Unsolved is a weekly podcast exploring unsol...

28/07/2026

LiveUs World Cup Record: 1,700 Units Support Wide Range of Transmission Needs

LiveU, the pioneer in IP-video transmission and cloud-based remote production, today detailed its historic performance records set during the 2026 FIFA World Cu...

28/07/2026

Case Study: How the Dallas Cowboys Removed Bottlenecks in Off-site Content Production

The NFL franchise rebuilt their off-site content operation for an era when teams...

28/07/2026

A New Way To Watch': How Formula 1 and Sky Sports Are Pushing Race Coverage Into a New Era

Longtime partners expand viewer choice, data-driven analysis, access, immersive ...

28/07/2026

Grass Valley Op Ed: Seven Paradoxes Shaping the Next Era of Media Production

There is a unique moment before every major production. The audience never sees it. The cameras are ready. The talent is preparing. Directors review the final...

28/07/2026

The CW Network, ESPN Ink Streaming Agreement With Launch on Aug. 4

The CW Network and ESPN have announced their highly anticipated streaming agreement to bring CW Sports' live events to the ESPN App will officially launch o...

28/07/2026

Lawo Delivers Audio Excellence for Europes Largest Classical Open-Air Concert on Bastille Day

As more than tens of thousands of spectators filled Paris' Champ de Mars and...

28/07/2026

Appear Assists Chile's First Large-Scale 4K FIFA World Cup Viewing Experience

Appear's X Platform played a central role in Chile's first large-scale c...

28/07/2026

IBC 2026: Solid State Logic Highlights Transition to Software-Defined Production

Responding to the broadcast industry's shift to embrace more flexible production platforms, Solid State Logic (SSL) is evolving its comprehensive System T p...

28/07/2026

TNT Sports Goes to Greater Heights With New DUNKMAN League

Production leverages innovative camera technologies, AI, and data to capture the action in four-week inaugural competition The first-ever professional dunking ...

28/07/2026

Rogers, Prime Video Ink 12-Year Sublicensing Deal for NHL Rights in Canada

Prime Video to exclusively broadcast Wednesday night national NHL regular-season games in Canada...

28/07/2026

CBS Sports Snags U.S. English-Language Rights for CONCACAF Champions Cup

Every match will stream live on Paramount+ beginning in February,...

28/07/2026

TK Audio unveil the TK-Lizer 3

Baxandall-inspired hardware EQ overhauled TK Audio's Baxandall-inspired hardware EQ unit has just made a return, bringing the popular unit back into the...

28/07/2026

Asparion reveal the D700 Rack

D700 system gains new live-focused rackmount surface Asparion have just announced an expansion of their D700 control surface range, introducing a new model ...

28/07/2026

Six NFVF Presidential Employment Stimulus Programme (PESP)-Funded Films Selected for the 47th Durban International Film Festival (DIFF)

27 July 2026, Johannesburg - The National Film and Video Foundation (NFVF), an a...

28/07/2026

Nielsen Launches Ad Intel AI: the Only Product of its Kind that Transforms Fragmented Ad Data into Actionable Intelligence

Ad Intel AI is Nielsen's first in a new generation of AI products built to t...

28/07/2026

aconnic is ramping up supply for the new ACCEED 1444 fiber migration

Contribution to Europe's technological autonomy in the key industry telecommunications aconnic AG (ISIN: DE000A0LBKW6), Munich, starts commercial shipments...

28/07/2026

The Tow Foundation Awards PMVP $400,000 Grant

Share Copy link Facebook X Linkedin Bluesky Email...

28/07/2026

LiveU's World Cup Support Breaks Company Records

Share Copy link Facebook X Linkedin Bluesky Email...

28/07/2026

Encompass Selected by Channel 4 to Deliver Managed Linear...

Encompass Digital Media has been selected by Channel 4, one of the UK's public service broadcasters, to deliver managed linear playout services as part of a...

28/07/2026

Cinegy partners with SAMA Digital Media Solutions to sati...

Cinegy GmbH, the premier provider of software-defined television technology, has confirmed a new partnership with leading Korean systems integrator and distribu...

28/07/2026

Limecraft Adds Multicam Player and Audio Fingerprint-Base...

Limecraft today announces version 2026.5 of its AI-powered production platform. Limecraft 2026.5 https://(www.limecraft.com/limecraft-2026-5-multicam-quad-view-...

28/07/2026

Appear powers first large-scale 4k FIFA World Cup viewing...

X Platform technology enabled a premium UHD viewing experience through a hybrid ground-to-cloud architecture developed with Chilevisi n, ClaroVTR and Pixop App...

28/07/2026

LiveU Delivers Record-Breaking LIQ and Cloud Service Depl...

LiveU, the pioneer in IP-video transmission and cloud-based remote production, today announced it has set historic performance records during the 2026 World Foo...

28/07/2026

DHD Releases New Firmware and Options for its Audio Produ...

dhd.audio announces that its latest generation firmware, Version 10.4, is now available to DHD customers. Version 10.4 introduces expanded configuration capabil...