Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

09/11/2025

Dalet Unveils Agentic AI Media Workflows at IBC2025

Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...

16/10/2025

SVG Sit-Down: FUJIFILM Execs on GFX ETERNA 55 Camera, Importance of Shallow-Depth-of-Field Production

SVG Sit-Down: FUJIFILM Execs on GFX ETERNA 55 Camera, Importance of Shallow-Dept...

16/10/2025

Squash's Most Ambitious Broadcast Production To Be Deployed at Comcast Business U.S. Open

Squash's Most Ambitious Broadcast Production To Be Deployed at Comcast Busin...

16/10/2025

Main Street Sports Group Inks Deal With Omaha Productions, Launches Original-Content Division

Main Street Sports Group Inks Deal With Omaha Productions, Launches Original-Con...

16/10/2025

A Historic Precursor? FIFA, HBS, DAZN Offer an Inside Look at Production of FIFA Club World Cup 2025

A Historic Precursor? FIFA, HBS, DAZN Offer an Inside Look at Production of FIFA...

16/10/2025

Prime Video Offers Sneak Peak at New NBA on Prime Studio

Prime Video Offers Sneak Peak at New NBA on Prime StudioThe massive 13,000-sq-ft, two-story studio features a LED regulation half court and hoopBy Jason Dachman...

16/10/2025

SVG Remote Production Forum Draws Record Crowd for Visit to PGA TOUR Studios, Deep Dive Into REMI Workflows

SVG Remote Production Forum Draws Record Crowd for Visit to PGA TOUR Studios, De...

16/10/2025

BitFire's Ben Grafchik on How Growing Cloud Workflows Are Impacting the Live-Sports World

BitFire's Ben Grafchik on How Growing Cloud Workflows Are Impacting the Live...

16/10/2025

CultureCon Uncut' Video Podcast Returns for Season 2 With Host Imani Ellis

In 2017, Imani Ellis launched CultureCon, a conference that's become a must-attend event for more than 10,000 diverse creatives and Black professionals to c...

16/10/2025

Fresh Spins on Holiday Standards: The 2025 Spotify Singles Have Arrived

It might still be a little early to break out the tinsel and mistletoe, but Spotify's already queuing up some holiday magic. This year's Spotify Singles...

16/10/2025

Spotify to Publish First Independent Author Releases Through Audiobook Selects, With More Planned Ahead

Earlier this year, our in-house publishing imprint, Spotify Audiobooks, put out ...

16/10/2025

L3Harris Integrates VAMPIRE Aboard GM Defense's Infantry Squad Vehicle

VAMPIRE has been integrated onto GM Defenses Infantry Squad Vehicle (ISV), providing a mobile solution to effectively and affordably counter small drone threat...

16/10/2025

Unseen and Unmatched: L3Harris Marks a First in Infrared Tracking Technology

The AgilePod mounted on the host aircraft....

16/10/2025

Consumer attitudes toward in-car entertainment and media preferences highlighted in new Gracenote automotive report

60% say infotainment systems are a critical purchasing or leasing consideration,...

16/10/2025

Broadcasters Foundation Launches 2025 Year-End Giving Campaign

NEW YORK The Broadcasters Foundation of America has launched its 2025 Year-End Giving Campaign, which seeks to raise donations from tax-deductible personal and ...

16/10/2025

Roku Adds Live Sports Scores, AI-Powered Voice Discovery, New Hardware

Roku has added several new features to its user interface and operating system meant to make it easier to discover and personalize content, the company said....

16/10/2025

CNN to Launch New All Access Subscription Tier Oct. 28

NEW YORK CNN has announced that its All Access subscription tier will launch in the U.S. on Oct. 28, providing audiences with a centralized destination for CNN&...

16/10/2025

Student Spotlight: Alan Villanueva

Student Spotlight: Alan Villanueva The graduate student and saxophonist, who performed on Natalia Lafourcades Latin Grammy-nominated Live at Carnegie Hall alb...

16/10/2025

XR Sports Alliance Announces New Members

The XR Sports Alliance (XRSA) has announced the third cohort of members. The new members include Maple Leafs Sports & Entertainment (MLSE), the Vegas Golden Kni...

16/10/2025

Broadcasters Foundation of America Launches 2025 Year-End Giving Campaign

NEW YORK The Broadcasters Foundation of America has launched its 2025 Year-End Giving Campaign which seeks to raise donations from tax-deductible personal and c...

16/10/2025

Australia's Nine to Broadcast Live NHL Games

NEW YORK Australia's Nine Network and the NHL today announced a media partnership that will bring the world's premier professional ice hockey league to ...

16/10/2025

Study: 45% of U.S. Internet Households Now Watch FAST Services

Parks Associates has released new data showing that nearly half (45%) of U.S. internet homes watch free ad-supported streaming TV (FAST) services and 89% of U.S...

16/10/2025

J.D. Power: Wireless Internet Signups Soar Over Last 6 Months

TROY, Mich. -New data from J.D. Power's 2025 U.S. Residential Internet Service Provider Study shows that residential wireless internet providers are growing...

16/10/2025

Shakespeare & Hathaway: Private Investigators recommissioned for sixth series, as filming gets underway in Stratford-Upon-Avon

TV's most charming detective drama * Shakespeare & Hathaway: Private Investi...

16/10/2025

Thailand's Legendary Outlaw Returns: Tee Yai: Born to be Bad' Premieres November 13

Back to All News Thailand's Legendary Outlaw Returns: Tee Yai: Born to be ...

16/10/2025

Christmas Is Just Around The Corner: 'Home For Christmas' Season 3 is Coming to Netflix on December 12

Back to All News Christmas Is Just Around The Corner: Home For Christmas Season...

16/10/2025

Tristn Ulloa Stars in 'El crimen de Pazos', the New Netflix Series Inspired by a True Story

Back to All News Trist n Ulloa Stars in El crimen de Pazos, the New Netflix Ser...

16/10/2025

ABS Completes Redomiciliation to Dubai Development Authority as Part of Strategic Transformation

ABS Completes Redomiciliation to Dubai Development Authority as Part of Strategi...

16/10/2025

KATJA MIA ANNOUNCED AS NEW 2FM WEEKEND PRESENTER

This Saturday October 18 Katja Mia will burst onto the radio airwaves for the first time as she joins 2FM. Katja will be standing in for Bl thnaid Treacy on Sat...

16/10/2025

RT is Supporting 39 Arts and Cultural Events across Ireland this October

This October, RT is delighted to support Wexford Festival Opera, Babor International Arts Festival for Children, Open House Dublin and 36 other arts and cultu...

16/10/2025

Ready, Set, Reward - GeForce NOW Membership Rewards Await

GeForce NOW is more than just a platform to stream fresh games every week - it offers celebrations for the gamers who make it epic, with member rewards to sweet...

15/10/2025

Reporting that changes lives: Announcing the Young Journalist finalists 2025

Across the world, early-career reporters are interrogating systems that shape daily life, from mortuaries and classrooms to the corridors of legal education and...

15/10/2025

St. Louis Blues Pay Tribute to Ozzy Osbourne in New Pregame Open Video

St. Louis Blues Pay Tribute to Ozzy Osbourne in New Pregame Open VideoThe NHL franchise worked with production firms 2WEI and 4th Floor CreativeBy Mark J Burns,...

15/10/2025

Cobalt Digital, G3DVu, Proxima Vision, and Telos Alliance Renew Premier Sponsorships

Cobalt Digital, G3DVu, Proxima Vision, and Telos Alliance Renew Premier Sponsors...

15/10/2025

The Remaining Native Team on the Sundance Institute Labs, Community and More

By Paige Bethmann Before my grandmother passed away in 2019, I went to visit her in the hospital where she'd been for a few weeks. When I arrived, the nurs...

15/10/2025

Spotify Celebrates Two Years of Audiobooks in Premium, Fueling Growth and Discovery Across the Publishing World

Two years ago, Spotify set out to grow the entire publishing industry by making ...

15/10/2025

DJ Levels Up With Spanish-Language Requests, Text Requests, and Personalized Prompts

People turn to DJ for a listening experience that feels personal, dynamic, and j...

15/10/2025

DJ evoluciona con solicitudes en espaol, peticiones por texto y recomendaciones personalizadas

Las personas recurren a DJ para vivir una experiencia de escucha personal, din m...

15/10/2025

Bruce Springsteen and Jeremy Allen White Unite in London for an Exclusive Spotify Conversation and Film Preview

Rock legend Bruce Springsteen and luminary actor Jeremy Allen White came togethe...

15/10/2025

Meet Spotify's RADAR Creators Global Class of 2025, the Next Wave of Podcast Talent

At Spotify, we're all about supporting rising talent and helping them connec...

15/10/2025

New SBS Documentary Series THE CANCER KILLERS Premieres 4 November on SBS & SBS On Demand

New SBS Documentary Series THE CANCER KILLERS Premieres 4 November on SBS & SBS ...

15/10/2025

SBS celebrates the Festivals of Lights with bold, illuminating stories across the network

SBS celebrates the Festivals of Lights with bold, illuminating stories across th...

15/10/2025

Seeking Astrobiological Potential Millions of Miles from Earth

One of humanity's most profound questions continues: Is there any place in our galaxy suitable for life beyond Earth? NASA intends to find out, with the hel...

15/10/2025

Austin PBS Expands Facility-Wide Production Communications with Clear-Com

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

15/10/2025

Scality debuts industry-first AI certifications with more...

Scality, a global leader in cyber-resilient storage software for the AI era, today announced the advancement of its comprehensive AI ecosystem certification pro...

15/10/2025

2026 HPA Tech Retreat to Deliver Insight Innovation and I...

The Hollywood Professional Association (HPA) today unveiled key highlights of the 2026 HPA Tech Retreat, scheduled for Feb. 15 19 at the Westin Rancho Mirage Go...

15/10/2025

Interra Systems Drives Quality Compliance and Monetizatio...

At NAB Show New York 2025 (Stand 244), Interra Systems will showcase the future of media QC, monitoring, and captioning, highlighting its award-winning, AI- and...

15/10/2025

RMC BFM Group Selects Grass Valley to Power its Transitio...

Grass Valley today announced that RMC BFM, part of the CMA-CGM Group and France's third-largest private media group, has chosen Grass Valley's productio...