Sony Pixel Power calrec Sony

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model

18/07/2024

Mistral AI and NVIDIA today released a new state-of-the-art language model, Mistral NeMo 12B, that developers can easily customize and deploy for enterprise applications supporting chatbots, multilingual tasks, coding and summarization.

By combining Mistral AI's expertise in training data with NVIDIA's optimized hardware and software ecosystem, the Mistral NeMo model offers high performance for diverse applications.

We are fortunate to collaborate with the NVIDIA team, leveraging their top-tier hardware and software, said Guillaume Lample, cofounder and chief scientist of Mistral AI. Together, we have developed a model with unprecedented accuracy, flexibility, high-efficiency and enterprise-grade support and security thanks to NVIDIA AI Enterprise deployment.

Mistral NeMo was trained on the NVIDIA DGX Cloud AI platform, which offers dedicated, scalable access to the latest NVIDIA architecture.

NVIDIA TensorRT-LLM for accelerated inference performance on large language models and the NVIDIA NeMo development platform for building custom generative AI models were also used to advance and optimize the process.

This collaboration underscores NVIDIA's commitment to supporting the model-builder ecosystem.

Delivering Unprecedented Accuracy, Flexibility and Efficiency

Excelling in multi-turn conversations, math, common sense reasoning, world knowledge and coding, this enterprise-grade AI model delivers precise, reliable performance across diverse tasks.

With a 128K context length, Mistral NeMo processes extensive and complex information more coherently and accurately, ensuring contextually relevant outputs.

Released under the Apache 2.0 license, which fosters innovation and supports the broader AI community, Mistral NeMo is a 12-billion-parameter model. Additionally, the model uses the FP8 data format for model inference, which reduces memory size and speeds deployment without any degradation to accuracy.

That means the model learns tasks better and handles diverse scenarios more effectively, making it ideal for enterprise use cases.

Mistral NeMo comes packaged as an NVIDIA NIM inference microservice, offering performance-optimized inference with NVIDIA TensorRT-LLM engines.

This containerized format allows for easy deployment anywhere, providing enhanced flexibility for various applications.

As a result, models can be deployed anywhere in minutes, rather than several days.

NIM features enterprise-grade software that's part of NVIDIA AI Enterprise, with dedicated feature branches, rigorous validation processes, and enterprise-grade security and support.

It includes comprehensive support, direct access to an NVIDIA AI expert and defined service-level agreements, delivering reliable and consistent performance.

The open model license allows enterprises to integrate Mistral NeMo into commercial applications seamlessly.

Designed to fit on the memory of a single NVIDIA L40S, NVIDIA GeForce RTX 4090 or NVIDIA RTX 4500 GPU, the Mistral NeMo NIM offers high efficiency, low compute cost, and enhanced security and privacy.

Advanced Model Development and Customization

The combined expertise of Mistral AI and NVIDIA engineers has optimized training and inference for Mistral NeMo.

Trained with Mistral AI's expertise, especially on multilinguality, code and multi-turn content, the model benefits from accelerated training on NVIDIA's full stack.

It's designed for optimal performance, utilizing efficient model parallelism techniques, scalability and mixed precision with Megatron-LM.

The model was trained using Megatron-LM, part of NVIDIA NeMo, with 3,072 H100 80GB Tensor Core GPUs on DGX Cloud, composed of NVIDIA AI architecture, including accelerated computing, network fabric and software to increase training efficiency.

Availability and Deployment

With the flexibility to run anywhere - cloud, data center or RTX workstation - Mistral NeMo is ready to revolutionize AI applications across various platforms.

Experience Mistral NeMo as an NVIDIA NIM today via ai.nvidia.com, with a downloadable NIM coming soon.

See notice regarding software product information.
LINK: https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

12/08/2026

ACLU Requests ABC Station Probe Documents from FCC

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

Roger Keating To Retire from Hearst Television

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

Netflix Closes U.S. Upfronts, Nearly Doubles Ad Commitments

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

CBS Pittsburgh Debuts New AR/VR News Studio

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

Matthews Intros T-Go Extreme Rigging Solutions

Matthews Studio Equipment introduces T-Go Mounting Solutions extreme camera rigging systems, engineered for the most demanding environments in motion picture pr...

12/08/2026

Anton Bauers EDEN Becomes Only Mobile Power Station in it...

Anton/Bauer, a Videndum brand and the industry leader in mobile power solutions for broadcast and cinematic production, announces that the EDEN Mobile Power Sta...

12/08/2026

TAG Video Systems Cuts Hardware Costs for Customers with...

TAG Video Systems, the global leader in software-based IP monitoring and multiviewer solutions, today announced a memory usage optimization that lowers the tota...

12/08/2026

Unified Streaming Launches Trusted Media - C2PA in Dynami...

Unified Streaming announces Trusted Media, a new solution that enables broadcasters, streaming platforms, and premium content owners to attach verifiable authen...

12/08/2026

Tedial Powers the AI-Driven Media Supply Chain at IBC 202...

Combining intelligent automation, composable business services and user-centric experiences The media industry is entering a new phase where AI intelligence is...

12/08/2026

DPA Microphones Appoints Raul Contreras as West Coast Reg...

DPA Microphones welcomes Raul Contreras as its new West Coast Regional Sales Manager. In this role, Contreras will oversee sales and customer relationships thro...

12/08/2026

Weather is Not a Factor for Marshall Electronics New CV57...

Marshall Electronics' first all-weather, all-IP 4K POV camera, the CV574-WP, makes its European debut at IBC 2026 (Stand 10.C11). Built for the elements, th...

12/08/2026

A double off-switch helps cells respond to stress

LA JOLLA, CA-Scientists at Scripps Research have discovered that two seemingly unrelated cellular enzymes become locked together during times of stress, simulta...

11/08/2026

Apple To Bring Friday Night Baseball Live to Apple Immersive on Vision Pro Beginning Aug. 28

Weekly immersive broadcasts will feature 8K 3D video, a 180-degree field of view...

11/08/2026

Looking for a New Cameraperson? ProductionHUB Guide Lays Out Considerations, Pitfalls

By Briana Brady, Social Media Manager, Production Hub Sports content is having ...

11/08/2026

SVG Sit-Down: Backlight CEO Kathleen Barrett on Building Media Infrastructure for a Global, AI-Driven Sports Landscape

She addresses why media organizations need more than asset storage, how sports t...

11/08/2026

FloSports Dennis LeMire on Implementing Cloud-Based Workflows on Lower Tier Sports

Remote commentary has improved significantly on these broadcasts At a clip of ...

11/08/2026

Miami HEAT's Revamped IP-Based Control Room Coordinates Workflows With Meinberg Intelligent Modular Synchronization System

A pair of LANTIME IMS M2000 PTP Grandmasters deliver resilient timing infrastruc...

11/08/2026

LTN Expands Live Event Master Control Capabilities for Sports Organizations

LTN has announced expanded capabilities for its Live Event Master Control offering, providing sports broadcasters, leagues, rights holders, and content owners w...

11/08/2026

WTA Ventures Appoints IMG as Managed Production Services Partner

WTA Ventures has appointed IMG as its managed production services partner in a multi-year agreement commencing with the 2027 season. The partnership is the late...

11/08/2026

New York Jets and CBS New York Extend Multi-Year Partnership

The New York Jets and CBS New York have agreed to a multi-year extension of their partnership, keeping CBS New York as the official broadcast home of the team. ...

11/08/2026

Nielsen Acquires DoubleVerify to Create New Combined Media Intelligence Platform

Nielsen Holdings and DoubleVerify have announced a definitive agreement under which Nielsen will acquire DoubleVerify in an all-cash transaction with an enterpr...

11/08/2026

AES Elects David v.R. Bowles as President-Elect for 2027, Unveils Other Election Results

The Audio Engineering Society has announced the results of its 2026 Board of Dir...

11/08/2026

SVG Sit-Down Creator Sports Network's Barrick Prince on Building the Next Layer of the Live-Sports Rights Stack

The CSN co-founder details its network and affiliate' model, how creator wi...

11/08/2026

Gravity Media Providing Host Broadcast Operations for Esports World Cup 2026

Gravity Media is providing host broadcast operations for the Esports World Cup (EWC) 2026, supporting ESL FACEIT Group (EFG) in delivering the tournament to glo...

11/08/2026

TAG Video Systems Reduces Memory Requirements for Compressed Workflows

TAG Video Systems has released a memory usage optimization for its MCM software that reduces the cost per channel by up to two-thirds for compressed workflows. ...

11/08/2026

SMT Expands LED Production and Scoring Services at 2026 Cincinnati Open

SMT is expanding its technology partnership with the Cincinnati Open this year, adding new LED displays, production capabilities, and fan-facing experiences at ...

11/08/2026

Pac-12 to Stream Fall Olympic Sports Home Events Free on YouTube

The Pac-12 has announced that home Olympic sports broadcasts throughout the fall season will be available free on the conference's YouTube channel at youtub...

11/08/2026

Case Study: Real Life Network Taps LiveU for Broadcast-Grade Streaming

Spreading a message of faith requires both widespread accessibility and uncompromising visual quality. Real Life Network (RLN), a free, faith-based digital stre...

11/08/2026

Tennessee Titans' New Nissan Stadium Will Live Up to Its Music City Location

Taking the synergy of sports and entertainment a step further, the NFL venue in Nashville will house iterations of two iconic music clubs The marriage of Taylo...

11/08/2026

The Crow Hill Company introduce Pocket Strings

Free library captures pro classical string section There's no shortage of freebies in The Crow Hill Company's line-up, with their Vaults series offe...

11/08/2026

Emergence Audio unveil Envoy

Percussion instrument introduces all-new engine Emergence Audio have just introduced a instrument that brings together a vast collection of percussive analo...

11/08/2026

Boris FX reveal Sequoia 2026.5

Introduces new all-in-one Spatial Panner tool Boris FX have recently announced the latest major update for their mastering and broadcast-focused DAW softwar...

11/08/2026

Rohde & Schwarz installs millimeter wave security scanners at Airports of Thailand (AOT) Airports

Rohde & Schwarz installs millimeter wave security scanners at Airports of Thaila...

11/08/2026

Dolby Acquires VVC Patents From Florida Atlantic University

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

Alyson Stewart Joins Zixi as Senior Director, Sales

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

FCC Issues Alert Over Scammers Impersonating Its Commissioners

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

Comcast, Disney Ink Deal to End NFL Network Blackout

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

farmerswife and Cirkus are Exhibiting at IBC 2026

farmerswife and Cirkus will return to IBC 2026 to showcase new tools designed to help broadcast, media and post-production teams manage workflows with greater s...

11/08/2026

LiveU Powers Cross-Venue Coverage of Glasgow Commonwealth...

LiveUs LU900Q intelligent production unit played a central role in the host broadcast operation for the Games in Glasgow (July 23 to August 2, 2026). The host b...

11/08/2026

Jigsaw24 Appoints James Morse as Client Director to Drive...

Jigsaw24 has appointed James Morse as Client Director, Media Sales, as it deepens its focus on sports, live events and integrated production. His appointment co...

11/08/2026

Net Insight enables one of Europes largest broadcast grad...

Net Insight today announced that DMC Production Norway has selected its Open Live Media solution to centralize the production of Blinkfestivalen 2026. Combining...

11/08/2026

Vivaro Supports Record World Cup Audiences with the Appea...

Modular HEVC and JPEG XS workflows enabled resilient, ultra-low-latency delivery for leading linear and digital media platforms across all 104 matches Appear A...

11/08/2026

Homecoming Artist Spotlight: Fabiola Mndez

Homecoming Artist Spotlight: Fabiola M ndez The first cuatrista to graduate from Berklee talks about the community that shaped her career ahead of her Homecom...

11/08/2026

FOR-A To Highlight MixBoard, Viztrik AiDi Enhancement At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

AMWA and EBU to Host Demos at IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/08/2026

Dalet Solution Suites Enable Media Teams to Move Like a S...

Dalet, a leading technology and service provider for media-rich organizations, today announced Dalet Solution Suites, a new portfolio of cloud-native solutions ...

11/08/2026

Mediagenix Helps Broadcasters Prepare for Brazil DTV Futu...

Mediagenix, a global leader in smart content solutions to profitably connect the right content to the right audience, will showcase how media companies can prep...