Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

28/01/2026

2026 Sundance Film Festival Reveals Short Film Program Award Winners

Top L-R: The Liars, Jazz Infernal, Living with a Visionary Second Row L-R: Paper Trail, The Baddest Speechwriter of All, Crisis Actor Third Row: The Boys and ...

28/01/2026

3 Easy Ways to Discover Music That Fits Your Moment on Spotify

Music discovery should feel intuitive and personal. That's why we're continuing to give you more control, so you can ask for what you want, shape what y...

28/01/2026

From $11B in 2025 Payouts to What We're Building for Artists in 2026

Today, Charlie Hellman, Spotify's Head of Music, shared the following note on the Spotify for Artists blog that the company paid out more than $11 billion t...

28/01/2026

Sediba Scriptwriting Training Programme - Oudtshoorn Municipality (Second Call)

The National Film and Video Foundation (NFVF), in partnership with the Oudtshoorn Municipality, invites aspiring and emerging filmmakers to apply for the Sediba...

28/01/2026

MVP makes a tactical switch to Calrec Argo M

As demand for more complex live sports coverage grows, Balkan broadcast specialist MVP has upgraded its flagship HD1 progressive OB truck with the installation ...

28/01/2026

Aussies' love of travel sees 12% surge in ad investment according to Nielsen

Airlines, cruise and tour operators double down on ad spend as Australians' prioritise travel Sydney January 28, 2026 - New Nielsen Ad Intel data shows a...

28/01/2026

Daniel Finn Joins LABF in Philanthropy Role

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

28/01/2026

Tegna Expands Local News Offering with Revamped Mobile App

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

28/01/2026

Marshall Electronics Unveils CV420 27X UHD Camera at ISE...

Marshall Electronics launches the CV420-27X, its next-generation ultra-high-definition (UHD) IP camera, at ISE 2026 (Stand 4N900). Engineered for modern IP-base...

28/01/2026

TVM Selects Grass Valley Technology for OB Truck Refurbis...

Grass Valley has announced that Television Mobiles Ltd. (TVM), one of Europe's leading independent outside broadcast providers, has carried out a major refu...

28/01/2026

FOR-A to show cutting edge technology at FOMEX 2026

AI, graphics and virtual software power new production capabilities FOR-A is bringing remarkable new technologies to FOMEX, the Future of Media Exhibition (ex...

28/01/2026

Riedel and Media Tailor Deliver Unified Broadcast and AV...

Continuing a longstanding collaboration, Riedel Communications and Nordic media technology company Media Tailor have once again joined forces to deliver a state...

28/01/2026

Pebble appoints Paul Nagle-Smith to drive fulfilment

Pebble has appointed Paul Nagle-Smith as vice president for customer fulfilment, strengthening its senior leadership focus on customer delivery and operational ...

28/01/2026

TV Azteca Strengthens Disaster Recovery Capabilities with...

Cloud playout solutions provider, Veset has announced that leading Mexican broadcaster, TV Azteca is using Veset Nimbus on AWS as a disaster recovery (DR) playo...

28/01/2026

MVP kicks off major football tournament with a tactical s...

Ensuring it can keep pace with a rapidly evolving live sports market, Balkan broadcast facility provider MVP Most Valuable Production has upgraded its flags...

28/01/2026

Akamai and Yospace Deliver Seamless Personalized Ad Exper...

Akamai Technologies, Inc. (NASDAQ: AKAM), the cloud solutions provider that powers and protects life online, and Yospace, the leader in dynamic ad insertion tec...

28/01/2026

Clear-Com Empowers Reykjavik City Theatre with New Upgrad...

The renowned Reykjavik City Theatre (RCT) recently underwent a major intercom system upgrade using Clear-Com solutions. This milestone project utilizes Clear-C...

28/01/2026

SES Acknowledges Fitch's Rating Action and Reiterates Deleveraging Plan

Luxembourg, January 26, 2026 - SES S.A. ( SES or the Company ), a leading space solutions company, acknowledges the credit rating action announced by Fitch to...

28/01/2026

OpenDrives Announces New Funding, Appoints Trevor Morgan CEO

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

28/01/2026

AWARN Alliance Backs ATSC Sunset, NextGen TV Security Measures

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

28/01/2026

More Than Two Dozen Groups Tell FCC to Reject Nexstar-Tegna Deal

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

28/01/2026

Screen Australia refreshes Market & Audience approach to increase the impact of local content

28 01 2026 - Media release Screen Australia refreshes Market & Audience approach...

28/01/2026

Boston Conservatory Orchestra Premieres a New Piano Concerto by Peter and Leonardo Dugan

Boston Conservatory Orchestra Premieres a New Piano Concerto by Peter and Leonar...

28/01/2026

VEON Notes Kyivstar Group Publication of Selected Full Year 2025 Financial Information

28 Jan 2026 VEON Notes Kyivstar Group Publication of Selected Full Year 2025 Fi...

28/01/2026

Rohde & Schwarz to host 2026 edition of its online event Demystifying EMC

Rohde & Schwarz to host 2026 edition of its online event Demystifying EMC Rohde & Schwarz invites the global EMC community to join a crucial discussion on pre...

28/01/2026

The Wait Is Over: Teaser Trailer Drops for 'Jo Nesbo's Detective Hole'

Back to All News The Wait Is Over: Teaser Trailer Drops for Jo Nesbo's Dete...

28/01/2026

Netflix Announces a Fictional Miniseries Inspired by the Marta del Castillo Case

Back to All News Netflix Announces a Fictional Miniseries Inspired by the Marta del Castillo Case Entertainment 28 January 2026 GlobalSpain Link copied to ...

28/01/2026

Netflix Announces Santiago Mitre's New Film Starring Vernica Llins and Peter Lanzani

Back to All News Netflix Announces Santiago Mitres New Film Starring Ver nica L...

28/01/2026

Netflix Unveils the Teaser Trailer for 'Berlin and the Lady with an Ermine'

Back to All News Netflix Unveils the Teaser Trailer for Berlin and the Lady wit...

28/01/2026

Stadtwerke Wolfhagen modernize customer management with AEP.EnergySuite from Arvato Systems

Stadtwerke Wolfhagen Modernize Customer Management with AEP.energysuite from Arv...

27/01/2026

Akamai and Yospace Deliver Seamless, Personalised Ad Experiences to Tens of Millions of ABEMA Users

Click for Japanese version Tokyo, Japan - January 27, 2026 - Akamai Technolo...

27/01/2026

Alfred P. Sloan Foundation and Sundance Institute Name Winners of Science-In-Film Initiative's Feature Film Prize and Artist Grants

L-R: Jonathan Cuchacovich, Sonia Kennebeck, Alan Fischer, Daeil Kim, Andrew Sta...

27/01/2026

B-LINE Is Here to Help: Backline Launches 24/7 Music Industry Mental Health & Crisis Support Line in Partnership with Spotify

Today, Spotify is proud to support our partner Backline, an industry-leading men...

27/01/2026

Netn Vega's Genre-Bending Sound Hits a Crossover Moment on Spotify's RADAR

With nearly 29 million monthly listeners and clear momentum on Spotify, Net n Ve...

27/01/2026

25 Ontario Named One of Torontos Best New Buildings

January 14, 2026 We are proud to share that 25 Ontario, First Gulf's commercial project located just two minutes from our head office, has been recognized ...

27/01/2026

Full-Building Lease Secured at Speers Road

January 22, 2026 First Gulf is excited to share that a full-building lease has been secured at 625 Bronte Rd in Oakville, part of Bronte Station Business Park,...

27/01/2026

Another Gold for First Gulf and 351 King Street East

January 23, 2026 First Gulf continues to demonstrate its commitment to high-performance, sustainable real estate with 351 King Street East achieving BOMA BEST ...

27/01/2026

Clear-Com Empowers Reykjavik City Theatre with New Upgrades

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

27/01/2026

Hubbard Broadcasting Renews Partnership With Nielsen in Albany and Albuquerque-Santa Fe Markets

Nielsen will continue to drive growth and provide local audience measurement in...

27/01/2026

Pebble Adds Paul Nagle-Smith as VP of Customer Fulfillment

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

27/01/2026

Study: Top Reason for Cancelling Streaming Service Is Programming

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

27/01/2026

U.K.'s Digital TV Group Taps Leslie Mackenzie as Chair

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

27/01/2026

Amagi becomes the first cloud-native SaaS company offerin...

Amagi Media Labs Limited, the only cloud-native SaaS provider offering end-to-end solutions across live production, content preparation, distribution, and monet...

27/01/2026

Miri Technologies Launches V410 Live 4K Video Encoder-Dec...

Miri Technologies Inc. today unveiled its V410 live 4K video encoder/decoder for streaming, IP-based production workflows and AV-over-IP distribution. Designed ...

27/01/2026

UML Tsongas Center Upgrades with Ikegami UHK-X600 Cameras

The Paul E. Tsongas Center at UMass Lowell in Massachusetts has chosen Ikegami cameras for incorporation into its broadcast-quality television production facili...