Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

17/12/2025

The EU Investigative Journalism Award 2025: bold reporting, regional impact, and rise in public-interest journalism

Investigative journalists across the Western Balkans and T rkiye continue to con...

17/12/2025

Sports Broadcasting Hall of Fame Inducts 10 Industry Icons During Unforgettable Night

Sports Broadcasting Hall of Fame Inducts 10 Industry Icons During Unforgettable ...

17/12/2025

ESPN to Debut MNF Playbook with Next Gen Stats, a New AI-Driven NFL Data-AltCast

ESPN to Debut MNF Playbook with Next Gen Stats, a New AI-Driven NFL Data-AltCastThe series, powered by Adrenaline TruPlay AI, launches Dec. 22 and runs through ...

17/12/2025

Inaugural Optum Golf Channel Games Debut Under the Lights' in Primetime on Golf Channel and USA Network

Inaugural Optum Golf Channel Games Debut Under the Lights' in Primetime on ...

17/12/2025

Ring In the New Year With New Playlists Mixed by Artists, and More Spotify Hacks

The right playlist is essential on New Year's Eve, building the energy as you get ready and keeping it high as you count down to midnight. This year, Spotif...

17/12/2025

Clear-Com's Arcadia Central Station Links Toledo Walleye and Mud Hens Venues with...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

17/12/2025

Broadcast and Streaming Serve Up a Historic Month of TV in Nielsen's The Gauge

Audiences Watched Over 103 Billion Minutes of TV on Thanksgiving Day NFL Games ...

17/12/2025

EdgeBeam Wireless Makes Initial Sale, Expands Executive Team

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Warner Bros. Discovery Tells Shareholders to Reject Paramount Bid

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

NDI, Zoom Collaborate on Seamless Connectivity

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Broadcasters Mark Momentous Year of Challenges Amid Viewing Fragmentation

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Tennessee Public Broadcaster to Trial AI Metadata

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Chyron Unveils New AXIS Maps

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Broadcast Solutions Group Acquires PMT Professional Motion Technology

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Study: U.S. Pay TV, Video Revenue to Total $190.7B in 2030

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Texas Attorney General Takes Aim at 5 TV Manufacturers

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

DirecTV Wins Appeal in Retransmission Price-Fixing Suit

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

E.W. Scripps Rejects Sinclair Takeover Bid

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

KPop Demon Hunters Stars Visit Berklee for Weeklong Celebration

KPop Demon Hunters Stars Visit Berklee for Weeklong Celebration Andrew Choi and EJAE, who voiced the film's main characters and contributed to its soundtr...

17/12/2025

Heated Rivalry will be coming to Sky and streaming service NOW on 10 January

Wednesday 17 December 2025 Heated Rivalry will be coming to Sky and streaming service NOW on 10 JanuaryTurn on cookies to view this content. Go to Privacy opti...

17/12/2025

Inside The Unseen World Of Indian Customs: Netflix Reveals The Brave Heroics Of The Customs Officers In Taskaree

Back to All News Inside The Unseen World Of Indian Customs: Netflix Reveals The...

17/12/2025

Netflix announces PAPARAZZI KING: the docu series coming to Netflix on January 9th

Back to All News Netflix announces PAPARAZZI KING: the docu series coming to Ne...

17/12/2025

Netflix Unveils First Look at 'Jo Nesbo's Detective Hole' Premiering on March 26, 2026

Back to All News Netflix Unveils First Look at Jo Nesbo's Detective Hole Pr...

17/12/2025

Netflix Welcomes Warner Bros. Discovery Board Recommendation

Back to All News Netflix Welcomes Warner Bros. Discovery Board Recommendation Business 17 December 2025 Global Link copied to clipboard After Careful Revi...

17/12/2025

RT announces appointment of Kathy Fox to role of Commissioning Editor, Documentaries and Features

RT has announced that Kathy Fox has been appointed Commissioning Editor with re...

17/12/2025

UC San Diego Lab Advances Generative AI Research With NVIDIA DGX B200 System

The Hao AI Lab research team at the University of California San Diego - at the forefront of pioneering AI model innovation - recently received an NVIDIA DGX B...

17/12/2025

Into the Omniverse: OpenUSD and NVIDIA Halos Accelerate Safety for Robotaxis, Physical AI Systems

Editor's note: This post is part of Into the Omniverse, a series focused on ...

17/12/2025

The Glitterball awaits: Dancing with the Stars unveils dance pairings for 2026

With the new season of Dancing with the Stars shimmering in the not-too-distant future this New Year, the celebrity and dancer pairings of the twelve couples ha...

16/12/2025

Stranger Things' Playlist Takeover Challenges Fans to Decode Clues and Unlock Exclusive Volume 2' Content

Hawkins has landed on Spotify, just in time for Stranger Things Season 5, Volume...

16/12/2025

Spotify and NAVER Bring Music Integrations and Premium Benefits to Korea

Wherever you are, your favorite music and audio content should go seamlessly with you. That's why Spotify has partnered with NAVER Corp, Korea's leading...

16/12/2025

Around the World With Spotify Wrapped: 2025 Fan Destinations You Had to See

2025 Wrapped arrived bigger and bolder than ever. This year's experience is designed to be ultra personal and shareable, with new features like Wrapped Part...

16/12/2025

L3Harris Delivers Most Powerful Thrusters for NASA's Lunar Gateway

Three 12-kilowatt Advanced Electric Propulsion System thrusters, supplied by L3Harris Technologies, form the core of Gateway's propulsion system. Pictured i...

16/12/2025

Palantir and L3Harris: Reindustrializing Defense Through AI-Powered Production

The challenge facing America's defense industrial base is not just about speed - its about rebuilding the foundation that makes speed possible. Our nations ...

16/12/2025

NFL Boosts Broadcast, Streaming Viewing Share in November

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

16/12/2025

Spanish Broadcaster Updates Playout With Pebble Solutions

SEVILLE, Spain Canal Sur, the public broadcasting service for Andalusia, Spain, has completed a total technology refresh based on Pebble's resilient, softwa...

16/12/2025

Telescript International Buys Prompter Software Company

NEW YORK Teleprompting hardware provider Telescript International has acquired all software code and intellectual property previously owned by Telescript West. ...

16/12/2025

Ookla: T-Mobile Is Fastest Fixed Wireless Access Provider

As cable operators face increased competition from 5G fixed wireless access providers, a new report from Ookla Research finds that T-Mobile is the FWA speed lea...

16/12/2025

Apple TV App for Android Now Supports Google Cast

Apple has announced a major upgrade to the Apple TV app for device owners outside the Apple ecosystem with news that the Apple TV app for Android now supports G...

16/12/2025

PT Telkom Satelit Indonesia and Space42 Explore Partnership to Extend 5G Direct-to-Device Services

Space42 grows Direct-to-Device partner ecosystem through a Memorandum of Underst...

16/12/2025

VEON Announces Release Date for Full Year and Fourth Quarter 2025 Results of Both VEON and Kyivstar

16 Dec 2025 VEON Announces Release Date for Full Year and Fourth Quarter 2025 R...

16/12/2025

VEON's Kyivstar Invests in Renewable Energy in Ukraine with Acquisition of Solar Power Company

16 Dec 2025 VEON's Kyivstar Invests in Renewable Energy in Ukraine with Acq...

16/12/2025

Emma Appleton, Fares Fares, Frida Gustavsson and Jakob Oftebro Star in Swedish Thriller Series Bytet'

Back to All News Emma Appleton, Fares Fares, Frida Gustavsson and Jakob Oftebro...

16/12/2025

Docu-reality 'My Korean Boyfriend' Gets a Trailer and Premiere Date: January 1st. Is Real Life Really like a K-drama?

Back to All News Docu-reality My Korean Boyfriend Gets a Trailer and Premiere D...

16/12/2025

Czech TV Elevates Video Streaming with Harmonic

Harmonic's XOS Advanced Media Processor Improves Streaming Video Quality and Boosts Viewer Engagement SAN JOSE, Calif. - Dec. 16, 2025 - Harmonic (NASDAQ: ...

16/12/2025

RT Sport Manager of the Year Nominees 2025 Revealed

RT Sport Awards 2025 live on RT One and RT Player at 8:05pm on Saturday 20 December. On Saturday 20 December live on RT One and RT Player at the earlier t...

16/12/2025

Music legend Brian Kennedy revealed as the twelfth and final contestant for Dancing with the Stars 2026

Singer -songwriter Brian Kennedy has been announced as the final celebrity dance...

15/12/2025

Harlem Globetrotters Celebrate 100th Anniversary With New Brand Campaign From The Famous Group

Harlem Globetrotters Celebrate 100th Anniversary With New Brand Campaign From Th...

15/12/2025

2026 Sundance Film Festival Reveals 54 Titles Selected for Short Film Program Presented by Ketel One Vodka

Top L-R: La Tierra Del Valor (The Home of the Brave), Mangittatuarjuk (The Gnawe...

15/12/2025

L3Harris to Provide Assured Communications for US Air Force's Survivable Airborne Operations Center Program

L3Harris will leverage 15 years of experience supporting the E-4B Nightwatch and...