Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

27/04/2026

CES Power Acquires Three Ireland-Based Businesses

CES Power, a provider of infrastructure for live events, has announced the acquisition of three Ireland-based businesses: GH Energy Rental Ltd, Event Power, and...

27/04/2026

Fubo to Launch Multiview on Select LG TVs Ahead of 2026 Football Season

FuboTV Inc. has announced it is developing its Multiview feature for the Fubo streaming service on select LG TVs, including 2024, 2025, and newer 4K and 8K mode...

27/04/2026

Shade Raises $14 Million in Funding Round Led by Khosla Ventures

Shade, a file management platform for creative teams, has announced a $14 million funding round led by Khosla Ventures, Construct Capital, and Bling Capital, br...

27/04/2026

AES to Present Immersive Audio Academy 12th Edition on April 30

The Audio Engineering Society (AES) will present the Immersive Audio Academy 12th Edition - Immersive Audio in All Flavors - on April 30, 2026, at 12:00 p.m. ...

27/04/2026

DAZN Launches DAZN48 Creator Program for FIFA World Cup 2026

DAZN has announced DAZN48, a creator program for the FIFA World Cup 2026 that will recruit 48 creators - one representing each of the 48 qualified nations - to ...

27/04/2026

FloSports Acquires Streaming Rights to Four CrossFit Events

FloSports has announced exclusive streaming rights to four CrossFit competitions: Legends Del Mar: CrossFit Semi-Finals, Magic City Games, NorCal Classic, and t...

27/04/2026

NAB 2026: Telestream Pulse Named NAB Show 2026 Product of the Year for Monitoring and Measuring

Telestream has announced that Pulse, its software-defined test and measurement p...

27/04/2026

NAB 2026: Shade Wins 2026 NAB Show Product of the Year Award

Shade has announced it is a Cloud Computing and Storage winner in the 2026 NAB Show Product of the Year Awards. Winners were selected by a panel of industry exp...

27/04/2026

SVG All-Stars: Kelsey Kjeldsen, Senior Director and Video Ads Platform Lead, DTC Products, Tech, and Operations, NBA

Leading the NBA's video-ads platform, this Penn State grad is at the forefro...

27/04/2026

DAZN Extends T100 Triathlon World Tour Rights to Africa

DAZN has expanded its international broadcast rights for the T100 Triathlon World Tour to include Africa. All races from the T100 calendar will be available for...

27/04/2026

NAB 2026: NAB Show Announces 2026 Project and Product of the Year Award Winners

NAB Show has announced the recipients of its 2026 Project of the Year and Product of the Year Awards at a ceremony at the Las Vegas Convention Center. Each wi...

27/04/2026

DIRECTV Launches on Meta Quest Headsets as Sports Season Heats Up

DIRECTV has launched on Meta Quest headsets, becoming the first MVPD to offer live TV through the platform. The timing coincides with the stretch run of the MLB...

27/04/2026

TBL Team Boxing League and MSG Networks Announce Broadcast Partnership

TBL Team Boxing League has announced a broadcast agreement with MSG Networks to air all remaining Season 4 fights live across MSG's television and digital p...

27/04/2026

Audio Exhibitors Showcase New Platforms, Innovative Solutions for Complex Issues

IP integration, interoperability, growth of intercommunications were key concerns for vendors and visitors alike Attendees at the recently concluded 2026 NAB S...

27/04/2026

Behind The Mic: Kenny Beecham to Launch NBA Radio Show on SiriusXM; Mike Tomlin to Join NBC Pregame Show

Behind The Mic provides a roundup of recent news regarding on-air talent, includ...

27/04/2026

On the Show Floor, the Microphone Is Still the Place Where Audio Begins

A pro-audio emphasis, spectrum changes, and on-field audio mark the new products and enhancements to existing offerings Microphones remain the primary point of...

27/04/2026

NAB Show 2026 In Review: Our Complete Collection of Video Interviews with Industry Thought Leaders

The Sports Video Group team was all over the NAB Show floor out in Las Vegas las...

27/04/2026

Svenska artister genererade nra 2 miljarder kronor frn Spotify under 2025

N r Spotify grundades f r 20 r sedan dominerades musikmarknaden av illegal nedladdning. Sedan dess har streaming bidragit till att teruppr tta betalningsvilja...

27/04/2026

Introducing Fitness With Spotify: A New Way to Bring Movement Into Your Daily Routine

Time on Spotify should feel meaningful and intentional, not something that slips...

27/04/2026

Brainworx release bx_tonebox

New modular multi-effects plug-in revealed The latest plug-in from Brainworx delivers a modular set of effects designed to offer a convenient alternative to...

27/04/2026

Desert Island Boom Set from Schoeps

Kit includes supercardioid & shotgun capsules High-end mic manufacturer Schoeps have recently introduced another member of their Desert Island Set family. O...

27/04/2026

Sound Skulptor introduce the LA502T

LA2A-inspired 500-series module arrives Sound Skulptor have announced the upcoming launch of a new 500-series module that aims to recreate one of the most p...

27/04/2026

Stam Audio announce the SA-4000+

SSL-inspired compressor unit upgraded Stam Audio are well known for their painstaking recreations of vintage audio gear, with their extensive product range ...

27/04/2026

Study: Local TV Political Ad Spend to Top $4 billion in 2026

Share Copy link Facebook X Linkedin Bluesky Email...

27/04/2026

Nippon TV's In-House Proprietary AI Solution AiDi Wins Product of the Year Award at NAB 2026

Nippon TV's In-House Proprietary AI Solution AiDi Wins Product of the Year A...

27/04/2026

Outpost Introduces Unlimited Collaboration Model for Review and Approval Workflows

Outpost Introduces Unlimited Collaboration Model for Review and Approval Workflo...

27/04/2026

Ikegami Announces VFE-P07D Monocular OLED Viewfinder with Tiltable 3.5-inch LCD Monitor

Ikegami Announces VFE-P07D Monocular OLED Viewfinder with Tiltable 3.5-inch LCD ...

27/04/2026

Custom Consoles Completes Large Module-R MCR Desk and Med...

Custom Consoles announces the completion of a large Module-R desk and MediaWall monitor display mount for an expanded master control room at Gravity Medias West...

27/04/2026

Other World Computing Launches OWC Express 4M2 Ultra - Thunderbolt 5 Four-Slot NVMe M.2 SSD Enclosure

Other World Computing Launches OWC Express 4M2 Ultra - Thunderbolt 5 Four-Slot N...

27/04/2026

Netflix announces El sobrino, the new film by Damin Szifron starring Leonardo Sbaraglia

Back to All News Netflix announces El sobrino, the new film by Dami n Szifron s...

27/04/2026

Red Seat Ventures Announces Exclusive Multiyear Partnership with Kill Tony

Red Seat Ventures Announces Exclusive Multiyear Partnership with Kill Tony The Company is the New Monetization and Distribution Home for the Globally Popula...

27/04/2026

RT 2FM launches nationwide quest for next superstar DJ to play Forbidden Fruit Festival

RT 2FM is calling on aspiring DJs across Ireland to take their shot at the spot...

27/04/2026

RT is Supporting 32 Arts and Cultural Events all over Ireland this May

RT continues to champion Ireland's creative life this May, supporting a broad range of festivals, exhibitions and performances across music, theatre, liter...

26/04/2026

Director Yoon Jong-bin Returns with The Generals' (WT), An Incisive Chronicle of a Second-in-Command

Back to All News Director Yoon Jong-bin Returns with The Generals' (WT), A...

26/04/2026

'Nine Queens,' Starring Alvaro Morte and Patrick Criado, Starts Production

Back to All News Nine Queens, Starring Alvaro Morte and Patrick Criado, Starts ...

25/04/2026

Spotify and Vogue Celebrate Music and Culture in Mexico City

In the heart of Mexico City, music, culture, and fashion converged last night as Spotify and Vogue Latin America welcomed guests to an intimate gathering at Soh...

25/04/2026

Brainworx introduce bx_tonebox

New modular multi-effects plug-in revealed The latest plug-in from Brainworx delivers a modular set of effects designed to offer a convenient alternative to...

25/04/2026

Mediagenix Sweeps 2026 NAB Awards With Wins for Product of the Year and Best of Show for Scheduling Optimization

Mediagenix Sweeps 2026 NAB Awards With Wins for Product of the Year and Best of ...

25/04/2026

SCHOEPS Microphones Announces Desert Island Boom Set for NAB 2026

SCHOEPS Microphones Announces Desert Island Boom Set for NAB 2026 Brie Clayton April 24, 2026 0 Comments Compact modular set ideal for location sound ...

25/04/2026

Berklee Africana Studies Hosts Gospel Extravaganza 2026

Berklee Africana Studies Hosts Gospel Extravaganza 2026 The Signature Series event will honor three new inductees to the Berklee Gospel Hall of Fame and celeb...

25/04/2026

Student Spotlight: Siva

Student Spotlight: Siva Maja Gierszewska, who performs under the artist name Siva, shares how she found her songwriting confidence at Berklee. April 24, 2026...

25/04/2026

WNBA Offers Free Streaming of all Preseason Games

Share Copy link Facebook X Linkedin Bluesky Email...

24/04/2026

Churchill Downs Inc. Acquires Preakness Stakes for $85 Million

Churchill Downs Inc. (CDI) has announced a definitive agreement to acquire the intellectual property of the Preakness Stakes and Black-Eyed Susan Stakes from 1/...