Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

24/03/2026

Utah Scientific to Showcase a Variety of Hybrid SDI/IP Innovations at the 2026 NAB Show

Utah Scientific to Showcase a Variety of Hybrid SDI/IP Innovations at the 2026 N...

24/03/2026

NAB 2026: Mediaproxy Highlights Enhancements to its LogServer suite at NAB Show 2026

Mediaproxy will showcase an updated version of its LogPlayer interface at NAB Sh...

24/03/2026

Canada's Cgep de Jonquire and Calrec Take Five With a TV Studio Upgrade

C gep de Jonqui re, a public college in Qu bec, has upgraded its TV studio complex with five Calrec Brio consoles and a Dante IP network. The installation was c...

24/03/2026

American Association of Professional Baseball Expands Broadcast Partnerships with RYZ, Bally Sports Live, NLSE, FTF Sports, and SLVR

The American Association of Professional Baseball (AAPB) has announced new and r...

24/03/2026

Ateme KYRION Enabled NT's Nationwide Contribution Network During Southeast Asian Games 2025

National Telecom Public Company Limited (NT) used Ateme's KYRION platform fo...

24/03/2026

FDJ United Upgrades Lottery Production with Grass Valley UHD Cameras

Grass Valley has expanded its relationship with ImSoPROD, the TV production entity of FDJ United, with the deployment of LDX C98 compact cameras across its nati...

24/03/2026

Scripps Sports Launches Free Streaming Channel Scripps Sports Network on March 24

The E.W. Scripps Company is launching Scripps Sports Network (SSN), a free, ad-s...

24/03/2026

SVG Sit-Down: NEP Platform VP Dan Murphy on Software-Driven Production and the Future of Live Sports Workflows

NEP Group has launched NEP Platform, a new software orchestration system that un...

24/03/2026

Daktronics Installs New Video Display and Ribbon Boards at Chase Field

Daktronics has partnered with the Arizona Diamondbacks to design, manufacture and install a new LED video display and three ribbon boards at Chase Field in Phoe...

24/03/2026

Grass Valley Upgrades University of Pittsburgh Athletics to ST 2110 IP Production Infrastructure

Grass Valley has completed an upgrade of University of Pittsburgh Athletics'...

24/03/2026

Daktronics to Upgrade LED Displays at Wrigley Field

Daktronics is upgrading eight LED displays at Wrigley Field in Chicago, totaling more than 8,300 square feet, using the Daktronics Renew product line. The upgra...

24/03/2026

ASG Appoints Kevin Poole as Senior Project and Support Manager

Advanced Systems Group has appointed Kevin Poole as Senior Project and Support Manager within the ASG Workflow and Tools practice. The position is newly created...

24/03/2026

SVG New Sponsor Spotlight: Verimatrix's Juan Martinez on Safeguarding Live Sports Content

In an increasingly streaming-centric world, protecting high-value live sports co...

24/03/2026

The Countdown Is On! Prep for Vegas with SVG's SportsTech@NABShow Blog

Mediaproxy will showcase an updated version of its LogPlayer interface at NAB Show, April 19-22 in Las Vegas, booth W1423. The update includes AI tools, native ...

24/03/2026

The Creator Economy's Growing Impact: Building the Modern Production Studio With Second Rodeo Productions' CEO Scott Brown

The production studio has worked with content juggernauts such as MrBeast, The R...

24/03/2026

MLB Local Media To Keynote Regional Sports Production Summit, June 29-30, Denver

The event will also feature a State of the Industry address from sports-media veteran and strategic advisor Patrick Crakes....

24/03/2026

Victory+ Launches NWSL Sunday Night Soccer Franchise

Victory , a free sports streaming service owned by A Parent Media Co. (APMC), has launched its NWSL Sunday Night Soccer franchise. The platform says the launch ...

24/03/2026

FAST Sports: Contrary to Some Data, Sports Does Have a Future on FAST

Sports content in free streaming is still relatively scant, but it's growing, right along with its monetization capabilities Streaming-tech company Wurl re...

24/03/2026

New Doc Sports Heaven: The Birth of ESPN' Produced by ESPN Historian Mike Soltys Arriving April 6

Directed by Greg DeHart, the doc will feature Sports Broadcasting Hall of Famers...

24/03/2026

Tubi Unveils Plans for Creator-Driven Formula 1 Altcasts in Partnership With Apple TV

For the first time ever, Tubi - Fox's free streaming service - is working w...

24/03/2026

What Does 19% Year-Over-Year Growth Sound Like? For Canadian Artists, It Sounds Like a Career

As the music industry gathers for Canada's Juno Awards, the local edition of...

24/03/2026

Meet SongDNA, a New Beta Feature That Reveals the Creative Connections Behind Your Favorite Tracks

Behind every great song is a complex web of people, stories, and inspirations th...

24/03/2026

The Big Picture' Co-Host Sean Fennessey on Spielberg and the Art of the Interview

Few filmmakers have shaped popular cinema as profoundly as Steven Spielberg. So ...

24/03/2026

ALM/Busy Circuits announce the Quaid Gigaslope & FMco

Latest Eurorack modules revealed ALM/Busy Circuits have just introduced another two Eurorack modules, delivering a powerful new modulator that builds on the...

24/03/2026

Akai Pro unveil the MPC Sample

Smallest, most affordable MPC to date Akai Pro have just introduced their most accessible standalone sampler to date, making the iconic MPC experience avail...

24/03/2026

Electro-Harmonix release Oceans Abyss editor

Create & manage presets on Windows & macOS Electro-Harmonix have announced that their free Mac/Windows application now allows users of their Oceans Abyss re...

24/03/2026

Rohde & Schwarz amplifiers enable high-field immunity testing expansion at IB Lenhardt Lab

Rohde & Schwarz amplifiers enable high-field immunity testing expansion at IB Le...

24/03/2026

NFVF CALL FOR PROPOSALS: FEMALE FILMMAKER PROJECT FACILITATING COMPANY 2026

The National Film and Video Foundation (NFVF) invites eligible Tier 1 and 2 South African production companies to submit proposals to serve as the Facilitating ...

24/03/2026

L3Harris Ramps Up Production for Counter-Unmanned Systems

L3Harris ramps up production of its VAMPIRE C-UxS system....

24/03/2026

Delivering Victory Through Fuzing Precision and Scale

For more than 70 years, L3Harris has delivered essential fuzes and safe-and-arm solutions that bring the might to multi-domain battlefields across the globe, ...

24/03/2026

Clear-Coms EQUIP Wireless System Keeps Youth With A Mission - South Korea Connected

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

24/03/2026

Craft Interview: Rick Bernier, Senior Broadcast Audio A1 Engineer

Rick Bernier reflects on a career that has taken him to the very top of live broadcast audio. As a Senior Broadcast Audio A1 Engineer and Music Director, he has...

24/03/2026

FDJ United Leaves Nothing to Chance with UHD Lottery Prod...

Grass Valley has strengthened its long-standing relationship with ImSoPROD, the TV production entity of the FDJ United, with the deployment of Grass Valley LDX ...

24/03/2026

Utah Scientific to Showcase a Variety of Hybrid SDI IP In...

At the 2026 NAB Show in Las Vegas, Utah Scientific will spotlight its expanding portfolio of hybrid SDI/IP routing, conversion, control, and signal management s...

24/03/2026

Miri V410 Live 4K Encoder-Decoder to Make North American...

Fresh off its global reveal at ISE 2026 in Barcelona, the new V410 live 4K encoder/decoder from Miri Technologies Inc. will make its North American debut at the...

24/03/2026

Cinegy delivers software defined television for the real...

Cinegy GmbH, premier provider of software-defined television technology, will show how its solutions answer the real challenges facing content creators and broa...

24/03/2026

ArtSound FM Futureproofs with DHD Audio Production Consol...

Canberra-based radio and online broadcast network ArtSound FM (https://artsound.fm/) has invested in DHD audio mixing consoles for two new studios at its headqu...

24/03/2026

IBC unveils 2026 Accelerator projects tackling industry c...

IBC today announced the nine projects selected for its 2026 Accelerator Media Innovation Programme, bringing together organisations from across broadcast, strea...

24/03/2026

Mediaproxy Highlights Significant Enhancements to its Log...

Mediaproxy, the global standard for software-based IP compliance monitoring and multiviewing solutions, will showcase the next generation of its industry-leadin...

24/03/2026

Cegep de Jonquiere and Calrec take five with a substantia...

Underscoring its global reputation as one of Canada's most renowned colleges for television production, the C gep de Jonqui re public college in Qu bec has ...

24/03/2026

Synamedia launches industry-first edge watermarking solut...

Leading video software provider Synamedia today announced the launch of the industry's first edge watermarking solution that enables faster disruption of pi...

24/03/2026

Experience Commerce Wins Social Media Mandate for Fintech...

Experience Commerce, a leading full-service digital marketing agency and part of the Cheil SWA Group, has secured the annual social media mandate for Fiat Payme...

24/03/2026

FCC Approves TV Station License Transfers to Gray

Share Copy link Facebook X Linkedin Bluesky Email...

24/03/2026

Study: Globally HBO Max Is Most Widely Bundled Streaming Service

Share Copy link Facebook X Linkedin Bluesky Email...

24/03/2026

Charter Communications Names John Lee Head Of Intelligence Ventures

Share Copy link Facebook X Linkedin Bluesky Email...