NVIDIA and Local AI Community Fuel Open Source Models and Intelligent Agents

The open source ecosystem is making it easier for AI enthusiasts and developers to build, customize and run increasingly capable agents locally.

Throughout August, NVIDIA is celebrating the partners and open source communities moving local AI forward, along with the models, applications and tools emerging across the ecosystem. That includes NVIDIA's latest open models, software and developer tools, plus the accelerated computing, libraries and educational resources that help users get started.

It's shaping up to be a big month for agents. Follow along for the latest developments in this special-edition NVIDIA Local AI blog series, with new updates added over the coming weeks.

Follow NVIDIA RTX Spark on X, Instagram, TikTok and Facebook - and stay informed by subscribing to the NVIDIA Local AI newsletter. Follow NVIDIA Workstation on LinkedIn and X.

Tuesday, Aug. 14, 10:00 a.m. PT

NVIDIA RTX GPUs Bring Frontier Quality Qwen3.8-27B Coding Agents to Local AI NVIDIA's RTX GPUs give developers a high-performance solution to frontier-quality local coding agents with the Qwen3.8-27B.

As the local companion to Qwen3.8-Max, the 27-billion-parameter open model is sized for a single GPU and built for responsive coding workflows with local files, tools and project context. Developers can keep sensitive code, proprietary data and project context on their own systems while using capable AI assistance throughout the development process.

Tested on GeForce RTX 5090 with an Intel Core Ultra 9 285K, 64GB RAM, Windows 11, NVIDIA driver 610.43. Using Q4_K_M checkpoint on llama.cpp with speedbench benchmark. MTP n_max = 3. Day-zero support is available now on NVIDIA RTX GPUs, including NVIDIA RTX PRO GPUs and the NVIDIA GeForce RTX 5090. Optimized with multi-token prediction, Qwen3.8-27B reaches 131 tokens per second on a single GeForce RTX 5090 with MTP, giving developers fast local inference for agentic coding, tool use and longer development tasks.

Developers can get started immediately with llama.cpp, Ollama , Unsloth and LM Studio Bionic, all of which support Qwen3.8-27B on NVIDIA RTX GPUs. Together, NVIDIA RTX performance, the CUDA software ecosystem and familiar open-source tools give developers broad support for new models and a strong foundation for responsive local agent coding workflows.

The model is also supported on DGX Spark and DGX Station - with additional optimizations, including NVFP4 support for all NVIDIA local AI devices, coming soon. Qwen3.8-27B brings frontier-quality local coding agents to NVIDIA's always-on personal AI systems.

Beyond PCs and personal AI systems, NVIDIA Jetson brings day-zero support for Qwen3.8-27B to the edge. We've found the model to be incredibly capable, with strong reasoning and agentic capabilities, while speculative decoding through MTP enables fast, responsive local inference at the edge.

Tuesday, Aug. 11, 10:00 a.m. PT

#ICYMI: New Open Models and More Available Today, Accelerated by NVIDIA GPUs NVIDIA recently released Cosmos 3 Edge, a 4-billion-parameter open world model for robotics, autonomous vehicles and vision AI. At a quarter the size of Cosmos 3 Nano, it runs on device on NVIDIA DGX Spark and NVIDIA Jetson.

MiniMax-H3 is a 33-billion-parameter open weights model that generates video and natively synchronized stereo audio from text, images, video, audio or a mix of all four. Creators can access it through ComfyUI and run it locally with checkpoints optimized for NVIDIA GPUs.

Poolside AI launched Laguna S 2.1, a 118-billion-parameter open weight agentic coding model that works through hours-long tasks. An NVFP4 checkpoint enables developers to run the model locally on a single NVIDIA DGX Spark with lower compute and memory requirements, without sacrificing accuracy.

DeepSeek recently refreshed DeepSeek-V4-Flash, a 284-billion-parameter MoE model with 13 billion active parameters and a 1 million-token context window. Developers can run it locally on an NVIDIA DGX Station using community-built GGUF versions available today.

Thinking Machines Lab's Inkling-Small is a frontier-class, open weight multimodal model with native reasoning across text, images and audio, plus adjustable thinking effort. Trained on NVIDIA GB300 NVL72, the 276-billion-parameter model activates just 12 billion parameters per token and runs on a single DGX Station or two DGX Spark systems. An NVFP4 checkpoint optimized for NVIDIA Blackwell is available on Hugging Face.

Unsloth launched Unsloth Desktop on Monday. The product brings local model inference, image and video diffusion, fine-tuning, agent integrations, web research and code execution into one fully open source desktop app. It's the first desktop app that both trains and runs AI models locally.

Unsloth Desktop brings local AI training and inference into one fully open source desktop app. It's the first desktop app to train and run AI models locally.

Alibaba recently released Wan-Animate-2, a 14-billion-parameter open weight model that transfers motion and facial expressions from a driving video onto a static character image - human, cartoon, robot or animal. With day-zero support in ComfyUI, it generates up to 26x faster on NVIDIA RTX PRO 6000 Blackwell and 22x faster on an NVIDIA RTX 5090 compared to Apple M3 Ultra.

Tuesday, Aug. 11, 9:00 a.m. PT

LTX Introduces LTX-2.5 LTX-2.5 is the latest state-of-the-art, open-world video generation model from LTX's leading research team, providing the foundation for use cases across media and entertainment, robotics and real-time generation, and delivering higher-quality video, stronger prompt adherence and more consistent characters, scenes and voices across generations.

New multishot support enables creators to generate sequences spanning multiple cuts while maintaining continuity, while an upgraded diffusion video de

LINK:	https://blogs.nvidia.com/blog/local-ai-open-source-models-agents-nemot...
	See more stories from nvidia

Most recent headlines