Get Plugged In: How to Use Generative AI Tools in Obsidian

06/11/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for GeForce RTX PC and NVIDIA RTX workstation users.

As generative AI evolves and accelerates industry, a community of AI enthusiasts is experimenting with ways to integrate the powerful technology into common productivity workflows.

Applications that support community plug-ins give users the power to explore how large language models (LLMs) can enhance a variety of workflows. By using local inference servers powered by the NVIDIA RTX-accelerated llama.cpp software library, users on RTX AI PCs can integrate local LLMs with ease.

Previously, we looked at how users can take advantage of Leo AI in the Brave web browser to optimize the web browsing experience. Today, we look at Obsidian, a popular writing and note-taking application, based on the Markdown markup language, that's useful for keeping complex and linked records for multiple projects. The app supports community-developed plug-ins that bring additional functionality, including several that enable users to connect Obsidian to a local inferencing server like Ollama or LM Studio.

Using Obsidian and LM Studio to generate notes with a 27B-parameter LLM accelerated by RTX. Connecting Obsidian to LM Studio only requires enabling the local server functionality in LM Studio by clicking on the Developer icon on the left panel, loading any downloaded model, enabling the CORS toggle and clicking Start. Take note of the chat completion URL from the Developer log console ( http://localhost:1234/v1/chat/completions by default), as the plug-ins will need this information to connect.

Next, launch Obsidian and open the Settings panel. Click Community plug-ins and then Browse. There are several community plug-ins related to LLMs, but two popular options are Text Generator and Smart Connections.

Text Generator is helpful for generating content in an Obsidian vault, like notes and summaries on a research topic.

Smart Connections is useful for asking questions about the contents of an Obsidian vault, such as the answer to an obscure trivia question previously saved years ago.

Each plug-in has its own way of entering the LM Server URL.

For Text Generator, open the settings and select Custom for Provider profile and paste the whole URL into the Endpoint field. For Smart Connections, configure the settings after starting the plug-in. In the settings panel on the right side of the interface, select Custom Local (OpenAI Format) for the model platform. Then, enter the URL and the model name (e.g., gemma-2-27b-instruct ) into their respective fields as they appear in LM Studio.

Once the fields are filled in, the plug-ins will function. The LM Studio user interface will also show logged activity if users are curious about what's happening on the local server side.

Transforming Workflows With Obsidian AI Plug-Ins Both the Text Generator and Smart Connections plug-ins use generative AI in compelling ways.

For example, imagine a user wants to plan a vacation to the fictitious destination of Lunar City and brainstorm ideas for what to do there. The user would start a new note, titled What to Do in Lunar City. Since Lunar City is not a real place, the query sent to the LLM will need to include a few extra instructions to guide the responses. Click the Text Generator plug-in icon, and the model will generate a list of activities to do during the trip.

Obsidian, via the Text Generator plug-in, will request LM Studio to generate a response, and in turn LM Studio will run the Gemma 2 27B model. With RTX GPU acceleration in the user's computer, the model can quickly generate a list of things to do.

The Text Generator community plug-in in Obsidian enables users to connect to an LLM in LM Studio and generate notes for an imaginary vacation. The Text Generator community plug-in in Obsidian allows users to access an LLM through LM Studio to generate notes for a fictional vacation. Or, suppose many years later the user's friend is going to Lunar City and wants to know where to eat. The user may not remember the names of the places where they ate, but they can check the notes in their vault (Obsidian's term for a collection of notes) in case they'd written something down.

Rather than looking through all of the notes manually, a user can use the Smart Connections plug-in to ask questions about their vault of notes and other content. The plug-in uses the same LM Studio server to respond to the request, and provides relevant information it finds from the user's notes to assist the process. The plug-in does this using a technique called retrieval-augmented generation.

The Smart Connections community plug-in in Obsidian uses retrieval-augmented generation and a connection to LM Studio to enable users to query their notes. These are fun examples, but after spending some time with these capabilities, users can see the real benefits and improvements for everyday productivity. Obsidian plug-ins are just two ways in which community developers and AI enthusiasts are embracing AI to supercharge their PC experiences. .

NVIDIA GeForce RTX technology for Windows PCs can run thousands of open-source models for developers to integrate into their Windows apps.

Learn more about the power of LLMs, Text Generation and Smart Connections by integrating Obsidian into your workflow and play with the accelerated experience available on RTX AI PCs

Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.

LINK:	https://blogs.nvidia.com/blog/ai-decoded-obsidian/...
	See more stories from nvidia

North America Stories

17/07/2026

Foundry Unlocks Professional-Grade AI for VFX with Gripta...

Creative software developer Foundry today announced Griptape Enterprise, a new tier of the Griptape AI workflow orchestration platform, extended to meet the str...

17/07/2026

Foundry Releases SmartRoto for Nuke

Creative software developer Foundry today announced the availability of SmartRoto, a new AI-powered plugin upgrade for Nuke, NukeX, Nuke Studio, and Nuke Indie ...

17/07/2026

The Final Release of Blackmagic Fairlight Live is Now Available!

The Final Release of Blackmagic Fairlight Live is Now Available! Brie Clayton July 16, 2026 0 Comments Fairlight Live is a new audio mixer designed fo...

17/07/2026

Leveraging All of Entertainment's IP

Leveraging All of Entertainment's IP Andy Marken July 16, 2026 0 Comments Nobody ever wins the games. Period. There are survivors. There\s no win...

16/07/2026

SVG Students To Watch: Kaden Sherman, Albany State University

This recent graduate and Georgia native has turned an early fascination with live production into a growing passion for camera work In the live-sports-video in...

16/07/2026

TNDV Marks First Year of Aspiration 35 Cinematic Production Truck

TNDV is marking the first anniversary of Aspiration 35, a mobile production truck built around ARRI Alexa 35 Live camera systems. Over its first year, the truck...

16/07/2026

ATSC Releases First Major Revision to A/85 Audio Loudness Recommended Practice Since 2013

ATSC has completed a major revision to its A/85 Recommended Practice: Techniques...

16/07/2026

FloSports Named Exclusive Global Media Partner for 2026 CrossFit Games

FloSports has announced an exclusive global media partnership with CrossFit for the 2026 CrossFit Games, presented by Air National Guard, beginning July 21 in S...

16/07/2026

Sennheiser Releases Spectera Firmware 1.4 and Command Button

Sennheiser has released firmware version 1.4 for its Spectera wireless system and announced the Spectera Command Button (Cat. No. 701014). The update adds comma...

16/07/2026

ESPN and Southwestern Athletic Conference Announce Multi-Year Media Rights Agreement Through 2030-31

ESPN and the Southwestern Athletic Conference (SWAC) have announced a multi-year...

16/07/2026

Audio-Technica Releases 20 Series Control Application for Elgato Stream Deck

Audio-Technica has announced the 20 Series Control Application, a Stream Deck plug-in for compatible Audio-Technica USB microphones. The application is compatib...

16/07/2026

SSL Live L550 Plus Consoles Power Audio Production for The Voice France Season 15

The fifteenth season of The Voice - La plus belle voix on TF1 used four Solid St...

16/07/2026

Gray Media and Atlanta Hawks Announce Georgia-Wide Broadcast Partnership for 2026-27 NBA Season

Gray Media and the Atlanta Hawks have announced a broadcast partnership that wil...

16/07/2026

SVG Sit-Down: Quarterback Showrunner Joe Zucco on Cinematography, Building Trust, Carrying On the NFL Films Legacy

Season 3 of Netflix's docuseries, which dropped this week, follows Jayden Da...

16/07/2026

Texas Rangers Switch Direct-to-Consumer Streaming Partner to BZZR

The Texas Rangers and Rangers Sports Network presented by Progressive (RSN) have announced BZZR as the new direct-to-consumer distributor for Rangers game broad...

16/07/2026

FIFA World Cup 2026: BBC Sport on Moving Across the Pond to Bring the Atmosphere of the Final Matches to Fans

With England's FIFA World Cup 2026 team getting ready to fly home after losi...

16/07/2026

With 36 Unilateral Cameras, NBC Sports Shapes 154th Open Championship Coverage for U.S. Viewers

In a return to Royal Birkdale, the team enjoys partnering with ETP and Gravity M...

16/07/2026

Altitude Sports & Entertainment's Tim De Lay on New SkyCam Digital Feed, Upgraded Studio Space

Along with a new studio at Ball Arena, the Colorado-based RSN is working with XR...

16/07/2026

FIFA World Cup 2026: Inside ORF's Austria-Based Production to Bring All the Emotions of the Tournament to Fans

Austria was back at the World Cup for the first time in 28 years, and the team d...

16/07/2026

Inside Gravity Media's Effort To Power the 154th Open Championship Production

With 42 RF cameras and high-power radio mics deployed, the spectrum environment ...

16/07/2026

The Gauge: Poland | June 2026

June brought stabilization to the television market. Poles spent an average of 3 hours and 36 minutes a day in front of their TV screens exactly the same as i...

16/07/2026

New studio monitoring leads Glensound's 60th year line-up...

Glensound returns to IBC with a major new addition to its intelligent loudspeaker range, the Greater Divine Supernal studio monitor, alongside recent developmen...

16/07/2026

Complete spectrum of innovation from British exhibitors a...

33 leading exhibitors are taking part in the GREAT Britain and Northern Ireland Pavilions and linked locations across IBC2026 (Amsterdam RAI, 11 14 September)...

16/07/2026

Hitomi Broadcast to showcase HDR colour verification and...

Hitomi Broadcast will introduce Spectra, a new HDR colour verification solution measured in picture, not using VPID, at IBC2026 (Hall 10, Stand A40). Expanding ...