Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

25/03/2026

Rohde & Schwarz joins FormFactor's MeasureOne partner program

Rohde & Schwarz joins FormFactor's MeasureOne partner program FormFactor and Rohde & Schwarz advance their partnership for on-wafer RF component character...

25/03/2026

L3Harris, RFTEQ Sign Agreement to Advance Sovereign Electronic Warfare Capability in Australia

L3Harris Technologies and RFTEQ Pty Ltd signed a memorandum of understanding to ...

25/03/2026

L3Harris to Provide Autonomous Underwater Capability for US Navy Submarines

L3Harris delivers combat-ready Torpedo Tube Launch and Recovery system, which deploys and retrieves Iver4 900 autonomous underwater vehicles through submarine t...

25/03/2026

Nielsen Names New Senior Leaders Supporting Sports, Advertising and Publishing Clients

The company expands leadership team under Chief Revenue Officer Amilcar Perez S...

25/03/2026

Stable TV Viewership in Poland in February as Warner Bros. Discovery Retains Top Spot

Winter Olympic Games Opening Ceremony features in top 10 programmes of the month...

25/03/2026

Mediaproxy to Show Upgrades to LogServer at 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

Hitomi transforms production synchronisation with the lau...

Providing wide view timing visibility across the entire production chain...

25/03/2026

Bitfocus showcases complete control at NAB Show 2026

Continuing development drives advances in security, availability, access and connectivity...

25/03/2026

Caudalie Paris HQ elevates brand experience with INFiLED...

Caudalie, the renowned French cosmetics brand, has unveiled a state-of-the-art 200-seat auditorium at its new headquarters in the historic Marais district of ce...

25/03/2026

Telestream Unlocks Adobe-Centric Media Pipeline and Strea...

Telestream, a global leader in media workflow technologies, today announced expanded integration with Adobe Premiere, Adobe Media Encoder (AME), and Frame.io, d...

25/03/2026

Marshall Electronics Showcases New Feature Rich CV320 and...

Marshall Electronics is expanding its lineup of high-performance POV cameras designed for broadcast, live production and professional AV applications with the d...

25/03/2026

OOONA Achieves TPN Gold Star Shield - the Highest Level o...

OOONA, a global provider of professional management and production tools for the media localization industry, announced today that it has been awarded the TPN G...

25/03/2026

Gray Media to Simulcast 2026 Atlanta Braves Home Opener

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

2026 NAB Show Exhibitor Insight: Appear

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

Deepfakes Vulnerable to AI Fingerprint Hacks, Study Finds

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

SipMX launches at NAB Show 2026 to democratize media orch...

SipRadius, specialists in secure, low-latency media transport, will drive innovation and interoperability still further with the launch of the SipMX Alliance at...

25/03/2026

QuickLink to Showcase StudioPro Video Production Ecosyste...

QuickLink, a leading provider of award-winning video production and remote contribution solutions, will showcase its award-winning StudioPro ecosystem at The 2...

25/03/2026

Alfalite returns to NAB Show alongside FOR-A showcasing L...

Alfalite, the only European manufacturer of LED screens, will once again be present at NAB Show, the leading global event for the broadcast, media and entertain...

25/03/2026

First Time Exhibitor IPC Introduces One Link Keypanels fo...

PC, a leading provider of integrated communication solutions, will make its NAB 2026 Show debut in Booth C 3341. The company will highlight the newly branded On...

25/03/2026

LTN showcases satellite-to-IP migration solutions for cha...

Open video transport network simplifies satellite transition with new partnerships and global reach as spectrum auction nears LTN will demonstrate how its purp...

25/03/2026

Leader to present full suite of advanced Test and Measure...

Test & measurement innovator, Leader Electronics, will present the full range of Leader, PHABRIX and LeaderPhabrix T&M solutions at the NAB Show, which takes pl...

25/03/2026

MNC Software Appoints Heartland Video Systems as North Am...

MNC Software, a global leader in network management and operational support systems tailored to the broadcast and media industry, today announced the appointmen...

25/03/2026

Samsung Launches Shoppable TV Experience with Amazon

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

Gray Media to Simulcast 2026 Atlanta Braves to Home Opener

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

Starfish highlights flexible TS Splicer releases and new Monitoring Dashboard at NAB Show

Starfish highlights flexible TS Splicer releases and new Monitoring Dashboard at...

25/03/2026

XLNTSOUND Elevates Video Production with Blackmagic Design

XLNTSOUND Elevates Video Production with Blackmagic Design Brie Clayton March 24, 2026 0 Comments Audio company upgrades workflow with Blackmagic Cine...

25/03/2026

First Time Exhibitor IPC Introduces One Link Keypanels for One Connect Intercom Platform at NAB 2026

First Time Exhibitor IPC Introduces One Link Keypanels for One Connect Intercom ...

25/03/2026

Netflix Announces the Start of Production for 'Reasonable Doubts'

Back to All News Netflix Announces the Start of Production for Reasonable Doubts Entertainment 25 March 2026 GlobalSpain Link copied to clipboard Download...

25/03/2026

FOR-As Software-Defined, AI-Powered Development Advances with Nippon TV and NVIDIA Technology

NBC Sports Deploys viztrick AiDi to Stream Live Events in 9:16 Mobile-First Form...

25/03/2026

Blowing Off Steam: How Power-Flexible AI Factories Can Stabilize the Global Energy Grid

At the half-time whistle of the UEFA EURO 2020 round of 16 football match betwee...

24/03/2026

Utah Scientific to Showcase a Variety of Hybrid SDI/IP Innovations at the 2026 NAB Show

Utah Scientific to Showcase a Variety of Hybrid SDI/IP Innovations at the 2026 N...

24/03/2026

NAB 2026: Mediaproxy Highlights Enhancements to its LogServer suite at NAB Show 2026

Mediaproxy will showcase an updated version of its LogPlayer interface at NAB Sh...

24/03/2026

Canada's Cgep de Jonquire and Calrec Take Five With a TV Studio Upgrade

C gep de Jonqui re, a public college in Qu bec, has upgraded its TV studio complex with five Calrec Brio consoles and a Dante IP network. The installation was c...

24/03/2026

American Association of Professional Baseball Expands Broadcast Partnerships with RYZ, Bally Sports Live, NLSE, FTF Sports, and SLVR

The American Association of Professional Baseball (AAPB) has announced new and r...

24/03/2026

Ateme KYRION Enabled NT's Nationwide Contribution Network During Southeast Asian Games 2025

National Telecom Public Company Limited (NT) used Ateme's KYRION platform fo...

24/03/2026

FDJ United Upgrades Lottery Production with Grass Valley UHD Cameras

Grass Valley has expanded its relationship with ImSoPROD, the TV production entity of FDJ United, with the deployment of LDX C98 compact cameras across its nati...

24/03/2026

Scripps Sports Launches Free Streaming Channel Scripps Sports Network on March 24

The E.W. Scripps Company is launching Scripps Sports Network (SSN), a free, ad-s...

24/03/2026

SVG Sit-Down: NEP Platform VP Dan Murphy on Software-Driven Production and the Future of Live Sports Workflows

NEP Group has launched NEP Platform, a new software orchestration system that un...

24/03/2026

Daktronics Installs New Video Display and Ribbon Boards at Chase Field

Daktronics has partnered with the Arizona Diamondbacks to design, manufacture and install a new LED video display and three ribbon boards at Chase Field in Phoe...

24/03/2026

Grass Valley Upgrades University of Pittsburgh Athletics to ST 2110 IP Production Infrastructure

Grass Valley has completed an upgrade of University of Pittsburgh Athletics'...

24/03/2026

Daktronics to Upgrade LED Displays at Wrigley Field

Daktronics is upgrading eight LED displays at Wrigley Field in Chicago, totaling more than 8,300 square feet, using the Daktronics Renew product line. The upgra...

24/03/2026

ASG Appoints Kevin Poole as Senior Project and Support Manager

Advanced Systems Group has appointed Kevin Poole as Senior Project and Support Manager within the ASG Workflow and Tools practice. The position is newly created...

24/03/2026

SVG New Sponsor Spotlight: Verimatrix's Juan Martinez on Safeguarding Live Sports Content

In an increasingly streaming-centric world, protecting high-value live sports co...

24/03/2026

The Countdown Is On! Prep for Vegas with SVG's SportsTech@NABShow Blog

Mediaproxy will showcase an updated version of its LogPlayer interface at NAB Show, April 19-22 in Las Vegas, booth W1423. The update includes AI tools, native ...