Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

08/10/2026

Life Safety, Part 2: From Noise to Nice: The Evolution of Speech Intelligibility in Stadium Sound

Modern venues have come a long way since the tinny, echoing audio of the mid 20t...

08/10/2026

ESPN's First Super Bowl Adds Disney+ to U.S. Distribution Mix

ESPN's first Super Bowl production will stream in English and Spanish on Disney+, while the ESPN App carries the full slate of game, ManningCast, studio, an...

08/10/2026

SVG Students To Watch: Addison McGhee, Auburn University

From high-school videoboards to War Eagle Productions, the Opelika native is learning how to lead shows and capture big moments The future of live sports produ...

08/10/2026

Prime Video to Become Exclusive Global Home of Emmy Awards Beginning in 2027

The Television Academy and Prime Video have announced a six-year agreement making Prime Video the exclusive global home of the Emmy Awards beginning with the 20...

08/10/2026

Techex to Demonstrate Hybrid Satellite and IP Delivery Platform at NAB Show New York

Techex will exhibit at NAB Show New York 2026 (Booth 623, Javits Center, October...

08/10/2026

X Games Appoints Steve Rogers as Chief Operating Officer

X Games has announced the appointment of Steve Rogers as Chief Operating Officer. Rogers previously served as COO of World Supercross and spent nearly a decade ...

08/10/2026

Fonn Group Appoints Trevor Spielmann as Sales Director, DACH

Fonn Group has appointed Trevor Spielmann as Sales Director for Germany, Austria, and Switzerland. Spielmann joins from EVS, where he held sales and business de...

08/10/2026

Perfect Game Introduces New Studio Show on the Road With Launch of PG Central

The flagship program will originate from major PG events with a four-camera production, live distribution across PGTV, social platforms Perfect Game is bringin...

08/10/2026

Uplynk White Paper: The IP Convergence Framework for Distribution

Innovation rarely happens in a vacuum. More often, it happens at the point of collision: when worlds that have run on separate tracks begin to converge. That is...

08/10/2026

Gravity Media Op-Ed: Gravity Media's Next Act - From Service Provider to Strategic Content Partner

For decades, the production and broadcast services business has run on a familia...

08/10/2026

Uplynk, Zixi, BroadView Software, and Grass Valley Publish Satellite-to-IP Distribution Framework

Uplynk, Zixi, BroadView Software, and Grass Valley have published The IP Converg...

08/10/2026

NFL Announces Ninth Annual Big Data Bowl Powered by AWS

The NFL has announced the return of the Big Data Bowl, the league's analytics competition, now in its ninth year and again powered by AWS. Registration is o...

08/10/2026

Eutelsat Renews Partnership with Tldiffusion dAlgrie on EUTELSAT 7 West A

Eutelsat has renewed its partnership with T l diffusion d'Alg rie (TDA), Algeria's national broadcasting network operator, for continued distribution of...

08/10/2026

Disney+ to Stream Super Bowl LXI on February 14, 2027

Disney will livestream Super Bowl LXI on February 14, 2027, alongside the game's broadcast on ESPN and ABC. All Disney subscribers in the United States wi...

08/10/2026

RHStv to Stream Clemson vs. Coastal Carolina Baseball at Myrtle Beach Fall Showdown

RHStv and Red House Streaming have announced an expansion of their partnership w...

08/10/2026

Gray Media to Simulcast 15 Timberwolves Games Free Over-the-Air in Minnesota and Wisconsin

Gray Media has announced a distribution agreement with TEGNA and DAZN to simulca...

08/10/2026

SMPTE Media Technology Summit Returns to Pasadena Nov. 16-19; Get 10% Off With SVG Promo Code

SVG readers can save 10% on registration and receive a complimentary Solutions H...

08/10/2026

PROTON Camera Innovations Named Recipient of 2026 Technology and Engineering Emmy for FPV Drone Systems

PROTON Camera Innovations GmbH has been named a recipient of a 2026 Technology a...

08/10/2026

Silver Lining: Sharing Tales From the Trenches of Cloud-Based Production with NBC Sports, MLB, NHL, and Warner Bros. Discovery

Industry leaders discuss real-world cloud workflows for live game production, pl...

08/10/2026

Dolby Atmos Coming to Formula 1 on Apple TV Beginning with 2026 U.S. Grand Prix

The next-gen audio technology joins Dolby Vision as part of Apple TV's immersive F1 experience...

08/10/2026

Free Leonard Peltier Proves That the Fight for Justice Is Just Beginning

David France, Jesse Short Bull, Mato Wayuhi, N. Bird Runningwater, Jodi Archambau, Jhane Myers, Paul McGuire, Amber Morning Star Byars, Holly Macarro, Nick Tils...

08/10/2026

Sound Particles update Energy Panner 2 & Brightness Panner 2

Dynamic panning plug-ins get an upgrade Sound Particles have just announced major updates for two of their popular dynamic panning plug-ins. Energy Panner 2...

08/10/2026

The DMNO ON from UDO Audio

New expandable instrument boasts full DMNO engine UDO Audio have just announced the upcoming release of a new, expandable synth that packs the power of the ...

08/10/2026

ADAM Audio introduce the Sub8 PRO & Sub10 PRO

Two new subwoofers added to monitoring line-up ADAM Audio's monitoring range has just been expanded with two new DSP-equipped subwoofers, the Sub8 PRO a...

08/10/2026

Clear-Com Powers Critical Communications at Rock in Rio 2026

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

08/10/2026

NAB New York 2026 Preview

Calrec gives broadcasters freedom of choice at NAB Show New York We're looking forward to meeting up with you all at NAB New York on 21st-22nd October. Cal...

08/10/2026

ESPN Unveils First Studio W Refresh

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Pay-TV Operators Ask FCC to Pause TV Station Ownership Cap Rules

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Calrec Brings New Consoles, Software to NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Mediagenix Bows AI Content-Aware Scheduling

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ikegami to Unveil UHK-X700VN Camera at NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ed McGivern Joins USSI Global as Chief Revenue Officer

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Globecast Brings Media Orchestration and C-Band Transitio...

Globecast, a leading provider of broadcast, media and entertainment managed services, will showcase its next generation of media orchestration services at NAB S...

08/10/2026

Clear-Com Powers Critical Communications at Rock in Rio 2...

Clear-Com played a critical role in the production communications infrastructure for Rock in Rio 2026, one of the world's largest and most recognized music...

08/10/2026

Sohonet Launches ClearView Rush: A Leap Forward in Studio Review, Built for Creative Executives

Sohonet Launches ClearView Rush: A Leap Forward in Studio Review, Built for Crea...

08/10/2026

NAB Show New York Returns to Javits

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

FCC to Vote on Restrictions for Device Testing, Spectrum for D2D and Drones

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

World First' as DTM Deploys Riedel Private 5G for On-Track Coverage

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

LiveU Cranks Up Connectivity Across Tour de France

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ikegami to Introduce New UHK-X700VN Camera at NAB New Yor...

Ikegami announces a major expansion to its range of broadcast-quality live production cameras. Scheduled for introduction on Ikegami booth 708 at NAB New York, ...

08/10/2026

Calrec gives broadcasters freedom of choice at NAB Show...

Calrec will be located at Booth 444. Freedom to choose The media landscape is evolving quickly, and the broadcasters best placed for what comes next will be...

08/10/2026

LiveU LU900Q with LIQ Brings Unprecedented Connectivity t...

LiveU has announced that CRD Audiovisuel relied on LiveUs LU900Q intelligent production unit, with built-in native LiveU IQ (LIQ ) connectivity, to deliver live...

08/10/2026

Disney+ to Stream Super Bowl LXI Live

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Formula 1 U.S. Grand Prix to Be Carried in Dolby Atmos, Dolby Vision on Apple TV

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Marshall to Bring Newest PTZ and POV Cameras to NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Marshall Electronics to Showcase Award-winning Camera Sol...

Marshall Electronics, a globally recognized provider of high-performance video solutions for broadcast, streaming, AV and professional production, will exhibit ...

08/10/2026

UKTV acquires first two series of new Maigret for U and U&DRAMA in deal with Banijay Rights

14-hour package also includes A Remarkable Place to Die season 2 as well as libr...