
Generative AI is rapidly transforming industries, driving demand for secure, high-performance inference solutions to scale increasingly complex models efficiently and cost-effectively.
Expanding its collaboration with NVIDIA, Amazon Web Services (AWS) revealed today at its annual AWS re:Invent conference that it has extended NVIDIA NIM microservices across key AWS AI services to support faster AI inference and lower latency for generative AI applications.
NVIDIA NIM microservices are now available directly from the AWS Marketplace, as well as Amazon Bedrock Marketplace and Amazon SageMaker JumpStart, making it even easier for developers to deploy NVIDIA-optimized inference for commonly used models at scale.
NVIDIA NIM, part of the NVIDIA AI Enterprise software platform available in the AWS Marketplace, provides developers with a set of easy-to-use microservices designed for secure, reliable deployment of high-performance, enterprise-grade AI model inference across clouds, data centers and workstations.
These prebuilt containers are built on robust inference engines, such as NVIDIA Triton Inference Server, NVIDIA TensorRT, NVIDIA TensorRT-LLM and PyTorch, and support a broad spectrum of AI models - from open-source community ones to NVIDIA AI Foundation models and custom ones.
NIM microservices can be deployed across various AWS services, including Amazon Elastic Compute Cloud (EC2), Amazon Elastic Kubernetes Service (EKS) and Amazon SageMaker.
Developers can preview over 100 NIM microservices built from commonly used models and model families, including Meta's Llama 3, Mistral AI's Mistral and Mixtral, NVIDIA's Nemotron, Stability AI's SDXL and many more on the NVIDIA API catalog. The most commonly used ones are available for self-hosting to deploy on AWS services and are optimized to run on NVIDIA accelerated computing instances on AWS.
NIM microservices now available directly from AWS include:
NVIDIA Nemotron-4, available in Amazon Bedrock Marketplace, Amazon SageMaker Jumpstart and AWS Marketplace. This is a cutting-edge LLM designed to generate diverse synthetic data that closely mimics real-world data, enhancing the performance and robustness of custom LLMs across various domains.
Llama 3.1 8B-Instruct, available on AWS Marketplace. This 8-billion-parameter multilingual large language model is pretrained and instruction-tuned for language understanding, reasoning and text-generation use cases.
Llama 3.1 70B-Instruct, available on AWS Marketplace. This 70-billion-parameter pretrained, instruction-tuned model is optimized for multilingual dialogue.
Mixtral 8x7B Instruct v0.1, available on AWS Marketplace. This high-quality sparse mixture of experts model with open weights can follow instructions, complete requests and generate creative text formats.
NIM on AWS for Everyone Customers and partners across industries are tapping NIM on AWS to get to market faster, maintain security and control of their generative AI applications and data, and lower costs.
SoftServe, an IT consulting and digital services provider, has developed six generative AI solutions fully deployed on AWS and accelerated by NVIDIA NIM and AWS services. The solutions, available on AWS Marketplace, include SoftServe Gen AI Drug Discovery, SoftServe Gen AI Industrial Assistant, Digital Concierge, Multimodal RAG System, Content Creator and Speech Recognition Platform.
They're all based on NVIDIA AI Blueprints, comprehensive reference workflows that accelerate AI application development and deployment and feature NVIDIA acceleration libraries, software development kits and NIM microservices for AI agents, digital twins and more.
Start Now With NIM on AWS Developers can deploy NVIDIA NIM microservices on AWS according to their unique needs and requirements. By doing so, developers and enterprises can achieve high-performance AI with NVIDIA-optimized inference containers across various AWS services.
Visit the NVIDIA API catalog to try out over 100 different NIM-optimized models, and request either a developer license or 90-day NVIDIA AI Enterprise trial license to get started deploying the microservices on AWS services. Developers can also explore NIM microservices in the AWS Marketplace, Amazon Bedrock Marketplace or Amazon SageMaker JumpStart.
See notice regarding software product information.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
21/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
21/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
21/11/2026
A larger studio puts more distance between the lights and the people who need to look good under them. Brightline Lighting, a manufacturer of energy-efficient l...
21/11/2026
LA JOLLA, CA-Despite its enormous impact on individuals, families and communities, addiction remains an area of significant unmet medical need.
A $7 million gi...
21/11/2026
27 FANGORIA Chainsaw Awards Nominees Created with Blackmagic Design
Brie Clayton November 20, 2026
0 Comments
Blackmagic Design hardware and software ...
20/11/2026
The sports broadcaster's chairman sees the upcoming game as an opportunity t...
20/11/2026
In-venue and creative video staffers at the professional and collegiate level have one major thing in common: the intensity and attention to detail ramps up dur...
20/11/2026
A variety of LED displays, integrated broadcast infrastructure covers every angl...
20/11/2026
Real American Freestyle (RAF) has announced a distribution partnership with Migu Video, a Chinese digital sports platform, to carry the RAF15 main event between...
20/11/2026
Apple and F1 Academy have announced that the all-female racing series will stream on Apple TV in the U.S. beginning in 2027. Fans will be able to watch every qu...
20/11/2026
Regional broadcaster m nchen.tv has modernized its production infrastructure at a new location in northern Munich. Riedel MediorNet provides decentralized signa...
20/11/2026
Eutelsat has announced three appointments to its Executive Committee, effective November 2026, under CEO Jean-Fran ois Fallacher.
Jean-Hubert Lenotte is appoin...
20/11/2026
After more than two decades at Harbour Esplanade in Docklands, the Seven Network has relocated its Melbourne headquarters to a new, custom-built ST 2110 facilit...
20/11/2026
Brazil is among the first markets deploying Versatile Video Coding (VVC) as part...
20/11/2026
The Soccer Tournament (TST), the $1 million winner-take-all 7v7 world championsh...
20/11/2026
Enhancements include a larger compound, an elevated camera count, and a whole lo...
20/11/2026
Leaders from ESPN, iHeartMedia, and Just Women's Sports explore creating new...
20/11/2026
New EQ plug-in aimed at mastering duties
Lemur Audio's latest plug-in has just arrived, delivering a characterful EQ that's aimed primarily at maste...
20/11/2026
Discounts of up to 75% now available
Soundtoys' annual Black Friday sale is now live, with discounts of up to 75% applied across the company's range...
20/11/2026
New creative looping tool revealed
Described as a cycling audio fragmenter , the latest addition to the SoundGhost range draws its inspiration from tape ph...
20/11/2026
Fairchild recreation gets plug-in counterpart
Heritage Audio's Herchild 670 offers a meticulous hardware recreations of the much-loved Fairchild 670 and...
20/11/2026
BONDI: 7 Minutes That Changed Australia
16 November, 2026
Media releases
A landmark documentary chronicling the worst terror attack in modern Australian hi...
20/11/2026
Statement regarding SBS non-Executive Director Aaron Fa'Aoso
20 November, 2026
Media releases
Aaron Fa'Aoso has advised that he is stepping down a...
20/11/2026
INVITATION FOR PUBLIC COMMENTS AND OBJECTIONS ON NOMINEES FOR APPOINTMENT TO THE COUNCIL OF THE NATIONAL FILM AND VIDEO FOUNDATION (NFVF) The Department of Spor...
20/11/2026
UEFA Nations League football and autumn premieres propel TVP to number one as YouTube grows its TV screen share
Warsaw, Poland, November 19, 2026 - Nielsen, a...
20/11/2026
October's autumn weather clearly encouraged Poles to spend more time in front of their screens, resulting in both longer viewing times and a higher overall ...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
DigitalGlue releases creative.space Pulse, a free Mac app that shows creatives w...
20/11/2026
How NBCUniversal Telemundo Used Virtual Production for its FIFA World Cup 2026 C...
20/11/2026
What Film School Pays and What it Costs: The Federal Numbers
Mark Santos November 20, 2026
0 Comments
Every editor has had the argument about film sch...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Beam Dynamics has introduced new Model Context Protocol (MCP) support, expanding how customers can work with the live operational data held in Beam. The new cap...
20/11/2026
Re:Vision Effects Cyber Week Sale Nov 24 to Nov 30
Pierre Jasmin November 19, 2026
0 Comments
Long time friends of the COW are up with a big sale!
Us...
20/11/2026
Avid is offering up to 33% off annual subscriptions!
Brie Clayton November 19, 2026
0 Comments
Hero image courtesy Deposit Photos
Pro Tools
Pro To...
19/11/2026
With a sports-bar vibe and all the teams onsite in a huge atrium in Ballpark Vil...
19/11/2026
The senior from Phoenix and England is balancing life as a Division I tennis player with a growing career behind the microphone
The future of live sports produ...
19/11/2026
RED Digital Cinema and Colorfront have partnered to integrate native Colorfront color management into RED Connect, letting productions apply Colorfront's co...
19/11/2026
SMPTE has published an engineering report summarizing an industry survey by its Study Group on Content Provenance and Authenticity in Media. The findings point ...
19/11/2026
CTech and Skyline Communications have announced a partnership to deliver integra...
19/11/2026
Euskal Irrati Telebista (EITB), the Basque Country's public media group, has completed Phase 1 of a five-studio renewal with the commissioning of a Lawo IP ...
19/11/2026
The Esports Foundation (EF) has announced an expanded Road to ENC 2027 for the E...
19/11/2026
All Women's Sports Network (AWSN) held its first awards show, VEON: Women W...
19/11/2026
Gracenote, the content intelligence business unit of Nielsen, has extended its relationship with DIRECTV. Gracenote will continue to supply visual imagery and p...