Sony Pixel Power calrec Sony

How to Run Coding Assistants for Free on RTX AI PCs and Workstations

10/07/2025

Coding assistants or copilots - AI-powered assistants that can suggest, explain and debug code - are fundamentally changing how software is developed for both experienced and novice developers.

Experienced developers use these assistants to stay focused on complex coding tasks, reduce repetitive work and explore new ideas more quickly. Newer coders - like students and AI hobbyists - benefit from coding assistants that accelerate learning by describing different implementation approaches or explaining what a piece of code is doing and why.

Coding assistants can run in cloud environments or locally. Cloud-based coding assistants can be run anywhere but offer some limitations and require a subscription. Local coding assistants remove these issues but require performant hardware to operate well.

NVIDIA GeForce RTX GPUs provide the necessary hardware acceleration to run local assistants effectively.

Code, Meet Generative AI Traditional software development includes many mundane tasks such as reviewing documentation, researching examples, setting up boilerplate code, authoring code with appropriate syntax, tracing down bugs and documenting functions. These are essential tasks that can take time away from problem solving and software design. Coding assistants help streamline such steps.

Many AI assistants are linked with popular integrated development environments (IDEs) like Microsoft Visual Studio Code or JetBrains' Pycharm, which embed AI support directly into existing workflows.

There are two ways to run coding assistants: in the cloud or locally.

Cloud-based coding assistants require source code to be sent to external servers before responses are returned. This approach can be laggy and impose usage limits. Some developers prefer to keep their code local, especially when working with sensitive or proprietary projects. Plus, many cloud-based assistants require a paid subscription to unlock full functionality, which can be a barrier for students, hobbyists and teams that need to manage costs.

Coding assistants run in a local environment, enabling cost-free access with:

Coding assistants running locally on RTX offer numerous advantages. Get Started With Local Coding Assistants Tools that make it easy to run coding assistants locally include:

Continue.dev - An open-source extension for the VS Code IDE that connects to local large language models (LLMs) via Ollama, LM Studio or custom endpoints. This tool offers in-editor chat, autocomplete and debugging assistance with minimal setup. Get started with Continue.dev using the Ollama backend for local RTX acceleration.

Tabby - A secure and transparent coding assistant that's compatible across many IDEs with the ability to run AI on NVIDIA RTX GPUs. This tool offers code completion, answering queries, inline chat and more. Get started with Tabby on NVIDIA RTX AI PCs.

OpenInterpreter - Experimental but rapidly evolving interface that combines LLMs with command-line access, file editing and agentic task execution. Ideal for automation and devops-style tasks for developers. Get started with OpenInterpreter on NVIDIA RTX AI PCs.

LM Studio - A graphical user interface-based runner for local LLMs that offers chat, context window management and system prompts. Optimal for testing coding models interactively before IDE deployment. Get started with LM Studio on NVIDIA RTX AI PCs.

Ollama - A local AI model inferencing engine that enables fast, private inference of models like Code Llama, StarCoder2 and DeepSeek. It integrates seamlessly with tools like Continue.dev.

These tools support models served through frameworks like Ollama or llama.cpp, and many are now optimized for GeForce RTX and NVIDIA RTX PRO GPUs.

See AI-Assisted Learning on RTX in Action Running on a GeForce RTX-powered PC, Continue.dev paired with the Gemma 12B Code LLM helps explain existing code, explore search algorithms and debug issues - all entirely on device. Acting like a virtual teaching assistant, the assistant provides plain-language guidance, context-aware explanations, inline comments and suggested code improvements tailored to the user's project.

This workflow highlights the advantage of local acceleration: the assistant is always available, responds instantly and provides personalized support, all while keeping the code private on device and making the learning experience immersive.

That level of responsiveness comes down to GPU acceleration. Models like Gemma 12B are compute-heavy, especially when they're processing long prompts or working across multiple files. Running them locally without a GPU can feel sluggish - even for simple tasks. With RTX GPUs, Tensor Cores accelerate inference directly on the device, so the assistant is fast, responsive and able to keep up with an active development workflow.

Coding assistants running on the Meta Llama 3.1-8B model experience 5-6x faster throughput on RTX-powered laptops versus on CPU. Data measured uses the average tokens per second at BS = 1, ISL/OSL = 2000/100, with the Llama-3.1-8B model quantized to int4. Whether used for academic work, coding bootcamps or personal projects, RTX AI PCs are enabling developers to build, learn and iterate faster with AI-powered tools.

For those just getting started - especially students building their skills or experimenting with generative AI - NVIDIA GeForce RTX 50 Series laptops feature specialized AI technologies that accelerate top applications for learning, creating and gaming, all on a single system. Explore RTX laptops ideal for back-to-school season.

And to encourage AI enthusiasts and developers to experiment with local AI and extend the capabilities of their RTX PCs, NVIDIA is hosting a Plug and Play: Project G-Assist Plug-In Hackathon - running virtually through Wednesday, July 16. Participants can create custom plug-ins for Project G-Assist, an experi
LINK: https://blogs.nvidia.com/blog/rtx-ai-garage-coding-assistants/...
See more stories from nvidia

North America Stories

30/08/2025

FCC Slightly Raises Regulatory Fees for TV Stations

WASHINGTON The Federal Communications Commission has adopted its FY 2025 Regulatory Fees Order that establishes the regulatory fee rates for the broadcast stati...

29/08/2025

L3Harris Launches Counter-Unmanned Systems Initiative

L3Harris Technologies has concentrated decades of expertise across the entire enterprise to develop affordable and reliable best-of-breed solutions to rapidly c...

29/08/2025

The CW Network Extends Pac-12 Deal Through 2030-31 Season

BURBANK, Calif. The CW Network and the Pac-12 Conference have announced a new media rights deal that will extend their broadcast partnership beginning with the ...

29/08/2025

Global FAST Channel Count Continues to Spike

NEW YORK Gracenote has released a new analysis of its global video dataset showing that the number of FAST channels grew nearly 14% from Q1 2025 and 76% since 2...

29/08/2025

Harmonic Unveils New Capabilities for Its Live Sports Streaming Solution

SAN JOSE, Calif. Harmonic has announced a series of improvements to its live sports streaming solution that the company said will improve fan engagement, protec...

29/08/2025

Youtube TV, Fox Settle Differences, Renew Carriage Agreement

NEW YORK and LOS ANGELES Fox Corp. and YouTube TV last night announced a renewal of the full portfolio of Fox networks, including Fox News Channel, Fox Business...

29/08/2025

Lightware MTR integration brings advanced flexibility and...

Budapest, Hungary, August 2025 - The integration of Microsoft Teams Rooms (MTR) with Lightware's Taurus universal matrix switchers delivers a new level of f...

29/08/2025

Frequency Launches Studio Live - a Unified Platform to Br...

Frequency, the engine behind many of the world's best-known streaming television channels, today announced it will launch Studio Live, a next-generation uni...

29/08/2025

Scality Day 2025 Celebrating 10 years of global innovatio...

In an era when AI and cyber resilience are essential, Scality will mark the 10th anniversary of Scality Day on October 16, 2025 in Paris. This flagship global e...

29/08/2025

Disguise Drives New Immersive Racing Experience - F1 Box

Disguise's In-House Creative and Technical Teams Pre-Visualised, Programmed and Delivered Content for the Experience, All Powered by EX 3+ Technology solu...

29/08/2025

Disguise Supports Fellow Entertainment Tech Leaders at IB...

Disguise will be demonstrating the latest workflows for TV, film and live events on a number of partner booths at the show Disguise, the industry-leading tech...

29/08/2025

Accedo to Highlight Compose AI-Agent Enhanced Orchestration Layer

STOCKHOLM, Sweden Accedo will showcase Accedo Compose, its AI agent-powered modular orchestration layer that assists streaming providers in transitioning client...

29/08/2025

Cineverse Launches Streaming Apps for In-Vehicle Video Streaming

LOS ANGELES Cineverse has announced that it is working with Xperi to bring four of its streaming channels to automobiles for the first time as part of the DTS A...

29/08/2025

Gray Media to Simulcast 17 Dallas Stars NHL Games

DALLAS & ATLANTA Gray Media has announced an agreement with the sports streaming service Victory+ to simulcast 17 Dallas Stars NHL games in 15 television market...

29/08/2025

Comcast NBCU and Amazon Ink New Distribution Agreements

NEW YORK AND CULVER CITY Comcast NBCUniversal and Amazon have announced new and extended distribution agreements that will expand the content available on their...

29/08/2025

RED Digital Cinema To Highlight Cine-Broadcast Module At IBC2025

FOOTHILL RANCH, Calif. RED Digital Cinema will feature its Cine-Broadcast Module supporting live broadcast workflows during IBC2025, Sept. 12-15, at the RAI Ams...

29/08/2025

'RIV4LRIES': The Trailer of the New Series With Samuele Carrino Only on Netflix October 1

Back to All News RIV4LRIES: The Trailer of the New Series With Samuele Carrino ...

28/08/2025

Meet the 2025 Sundance Institute Documentary Edit Residency Artists

By Kristin Feeley, Director, Documentary Film & Artist Programs If you want to tell untold stories, if you want to give voice to the voiceless, you've got ...

28/08/2025

Watch These 9 Sundance Institute-Supported Documentaries That Spotlight Workers' Rights

Directed by Steven Bognar and Julia Reichert, Sundance Institute-supported Amer...

28/08/2025

Poland Selects L3Harris Electronic Warfare System for F-16 Fleet

L3Harris will provide the Polish F-16V fleet with the Viper Shield electronic warfare system as part of an upgrade program....

28/08/2025

Fubo to Launch Fubo Sports Skinny Bundle for $56 Per Month

NEW YORK FuboTV today announced that it will launch Fubo Sports, a skinny bundle that focuses on sports with a subscription price of $56 monthly....

28/08/2025

Telestream to Launch 'Global Ingest Workflow at IBC2025

NEVADA City, Calif. At IBC2025, Sept. 12-15 at the RAI Amsterdam, Telestream will debut its new Global Ingest strategy, introducing a next-generation ingest arc...

28/08/2025

Dr. Rhoda Bernard Releases Groundbreaking Debut Book on Accessible Arts Education

Dr. Rhoda Bernard Releases Groundbreaking Debut Book on Accessible Arts Educatio...

28/08/2025

TAG Strengthens Regional Presence with Appointment of Oli...

TAG Video Systems, the leader in software-based IP end-to-end workflow monitoring, deep probing, and real-time visualization, has named Oliver Gappa as Sales Di...

28/08/2025

DHD to Demonstrate AI-Based Voice Enhancement at IBC 2025

AI-based voice enhancement will be among a series of innovations making their IBC 2025 debut on the DHD stand B46 in Hall 8 at the RAI Amsterdam Convention Cent...

28/08/2025

Telefonica Servicios Audiovisuales Hit the Back of the Ne...

Telef nica Servicios Audiovisuales (TSA), the leading system integrator and service provider in the media sector in Spain, with the support of Appear, the globa...

28/08/2025

Optical Media Anchors LiveU IQ into its On site Productio...

To fully immerse sailing fans in the world's biggest offshore yacht race, production company, Optical Media turned to LiveU's On-site Production solutio...

28/08/2025

WNED Adopts Calrec Type R console to weather any storm an...

Working with Calrec on its most recent overhaul, radio and television broadcaster, WNED has migrated to a fully IP infrastructure with multiple Type R consoles,...

28/08/2025

Cleeng unveils first ever free D2C subscription platform...

Cleeng, the Subscriber Retention Management (SRM ) inventor, has unveiled Cleeng Pro, the first-ever direct-to-consumer (D2C) subscription management platform t...

28/08/2025

Zixi and OKAST Partner to Power Scalable Global FAST Chan...

Zixi, the industry leader in live broadcast-quality video over IP, today announced that French media distribution platform OKAST has selected Zixi to enable rel...

28/08/2025

Nixer to unveil CV1 AoIP monitoring tool to address evolv...

Solution offers a streamlined, speaker-free architecture to optimize integration with premium external loudspeakers and advanced loudness metering Nixer Pro Au...

28/08/2025

Cinegy Announces Strategic Partnership with One Touch Pro...

Cinegy, the premier provider of software-defined television technology, has announced a strategic partnership with Vision One Touch Film Production Services L.L...

28/08/2025

Telestream Global Ingest Workflow Powered by Vantage Open...

Telestream, a global leader in media workflow technologies, will debut its new Global Ingest strategy at IBC2025, introducing a next-generation ingest architect...

28/08/2025

Telenor partners with Broadpeak for multi-country content...

Tier 1 operator selects Broadpeak to power high-performance, unified CDN solution across Norway, Sweden and Finland Broadpeak, a leader in streaming and moneti...

28/08/2025

24 Frames Digital goes live with Synamedia Quortex Play f...

Leading video software provider, Synamedia, today announced that 24 Frames Digital, one of India's leading live event streaming service providers, has chose...

28/08/2025

VisualOn at IBC 2025 - Whats Next in AI Powered Video Str...

Meet VisualOn at IBC2025: See What's Next in AI-Powered Video Streaming Join VisualOn at IBC2025 and discover how our AI-driven Optimizer and advanced media...

28/08/2025

Wowza to Reveal Next-Gen Video Streaming Innovations at I...

IBC stand 5.F81 Wowza to Reveal Next-Gen Video Streaming Innovations at IBC 2025 Amsterdam, August 28, 2025 Wowza, a leader in video streaming infrastructur...

28/08/2025

VIDA Launches Media Factory Agentic AI-Powered Workflow A...

VIDA, the secure cloud-native media asset management platform, is launching at IBC Show 2025 Media Factory, a drag-and-drop workflow automation engine designed ...

28/08/2025

FCC Restores Accidentally Deleted ATSC 3.0 Rules

WASHINGTON The Federal Communications Commission has admitted that it inadvertently removed some rules relating to NextGen TV/ATSC 3.0 and has moved to correct ...

28/08/2025

NAB Launches NextGen TV News Technology Lab to Advance Local Journalism

WASHINGTON The National Association of Broadcasters (NAB) has announced the launch of the NextGen TV News Technology Lab, a three-year initiative designed to he...

28/08/2025

Brazil Makes It Official: New DTV+ Standard Leverages ATSC 3.0 Tech

BRASILIA Brazilian President Luiz In cio Lula da Silva has signed an official presidential decree establishing DTV+ (TV 3.0) incorporating many parts of the ATS...

28/08/2025

Airwaves Battle Brews Over Upper C-Band at FCC

With the FCC's spectrum auction authority back in hand, lines in the sand are being drawn for the potential reallocation of the Upper C-Band for 5G mobile b...

28/08/2025

Netflix Lays Out Guidance for Using Generative AI in Content Production

As the use of generative AI becomes more common in media operations and production, Netflix has laid out detailed guidelines for their use and provided guidance...

28/08/2025

Fox, YouTube TV Agree on Short Extension in Carriage Talks

Fox and YouTube TV have agreed to a short-term extension in their carriage talks as they try to replace the existing agreement that expired on August 27 at 5 pm...

28/08/2025

Boston Conservatory at Berklee Announces Center Stage Performances for 2025-2026 Season

Boston Conservatory at Berklee Announces Center Stage Performances for 2025-2026...

28/08/2025

Esports World Cup 2025: Saudis Share Masterplan to Boost Esports on Global Stage

The new oil is sports': Saudis share masterplan to boost esports on global stage By Adrian Pennington Tuesday, August 26, 2025 - 08:49 Print This Story...

28/08/2025

Esports World Cup 2025: Team Falcons Defend Title as Broadcast Production Ramps Up the Game

Esports World Cup 2025: Team Falcons Defend Title as Broadcast Production Ramps ...

28/08/2025

Report: Mobile-First Content has Overtaken the Big Screen as the Way Fans Watch Sports

Report: Mobile-first content has overtaken the big screen as the way fans watch ...

28/08/2025

New Era: A Pro's Guide to ESPN's Expanded College Football Playoff Graphics Package

New Era: A Pro's Guide to ESPN's Expanded College Football Playoff Graph...

28/08/2025

College Football Kickoff 2025: The CW Heads Into ACC, Pac-12 Schedule With New Pregame CW Football Saturday Countdown'

College Football Kickoff 2025: The CW Heads Into ACC, Pac-12 Schedule With New P...