Sony Pixel Power calrec Sony

Get Plugged In: How to Use Generative AI Tools in Obsidian

06/11/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for GeForce RTX PC and NVIDIA RTX workstation users.

As generative AI evolves and accelerates industry, a community of AI enthusiasts is experimenting with ways to integrate the powerful technology into common productivity workflows.

Applications that support community plug-ins give users the power to explore how large language models (LLMs) can enhance a variety of workflows. By using local inference servers powered by the NVIDIA RTX-accelerated llama.cpp software library, users on RTX AI PCs can integrate local LLMs with ease.

Previously, we looked at how users can take advantage of Leo AI in the Brave web browser to optimize the web browsing experience. Today, we look at Obsidian, a popular writing and note-taking application, based on the Markdown markup language, that's useful for keeping complex and linked records for multiple projects. The app supports community-developed plug-ins that bring additional functionality, including several that enable users to connect Obsidian to a local inferencing server like Ollama or LM Studio.

Using Obsidian and LM Studio to generate notes with a 27B-parameter LLM accelerated by RTX. Connecting Obsidian to LM Studio only requires enabling the local server functionality in LM Studio by clicking on the Developer icon on the left panel, loading any downloaded model, enabling the CORS toggle and clicking Start. Take note of the chat completion URL from the Developer log console ( http://localhost:1234/v1/chat/completions by default), as the plug-ins will need this information to connect.

Next, launch Obsidian and open the Settings panel. Click Community plug-ins and then Browse. There are several community plug-ins related to LLMs, but two popular options are Text Generator and Smart Connections.

Text Generator is helpful for generating content in an Obsidian vault, like notes and summaries on a research topic.

Smart Connections is useful for asking questions about the contents of an Obsidian vault, such as the answer to an obscure trivia question previously saved years ago.

Each plug-in has its own way of entering the LM Server URL.

For Text Generator, open the settings and select Custom for Provider profile and paste the whole URL into the Endpoint field. For Smart Connections, configure the settings after starting the plug-in. In the settings panel on the right side of the interface, select Custom Local (OpenAI Format) for the model platform. Then, enter the URL and the model name (e.g., gemma-2-27b-instruct ) into their respective fields as they appear in LM Studio.

Once the fields are filled in, the plug-ins will function. The LM Studio user interface will also show logged activity if users are curious about what's happening on the local server side.

Transforming Workflows With Obsidian AI Plug-Ins Both the Text Generator and Smart Connections plug-ins use generative AI in compelling ways.

For example, imagine a user wants to plan a vacation to the fictitious destination of Lunar City and brainstorm ideas for what to do there. The user would start a new note, titled What to Do in Lunar City. Since Lunar City is not a real place, the query sent to the LLM will need to include a few extra instructions to guide the responses. Click the Text Generator plug-in icon, and the model will generate a list of activities to do during the trip.

Obsidian, via the Text Generator plug-in, will request LM Studio to generate a response, and in turn LM Studio will run the Gemma 2 27B model. With RTX GPU acceleration in the user's computer, the model can quickly generate a list of things to do.

The Text Generator community plug-in in Obsidian enables users to connect to an LLM in LM Studio and generate notes for an imaginary vacation. The Text Generator community plug-in in Obsidian allows users to access an LLM through LM Studio to generate notes for a fictional vacation. Or, suppose many years later the user's friend is going to Lunar City and wants to know where to eat. The user may not remember the names of the places where they ate, but they can check the notes in their vault (Obsidian's term for a collection of notes) in case they'd written something down.

Rather than looking through all of the notes manually, a user can use the Smart Connections plug-in to ask questions about their vault of notes and other content. The plug-in uses the same LM Studio server to respond to the request, and provides relevant information it finds from the user's notes to assist the process. The plug-in does this using a technique called retrieval-augmented generation.

The Smart Connections community plug-in in Obsidian uses retrieval-augmented generation and a connection to LM Studio to enable users to query their notes. These are fun examples, but after spending some time with these capabilities, users can see the real benefits and improvements for everyday productivity. Obsidian plug-ins are just two ways in which community developers and AI enthusiasts are embracing AI to supercharge their PC experiences. .

NVIDIA GeForce RTX technology for Windows PCs can run thousands of open-source models for developers to integrate into their Windows apps.

Learn more about the power of LLMs, Text Generation and Smart Connections by integrating Obsidian into your workflow and play with the accelerated experience available on RTX AI PCs

Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.
LINK: https://blogs.nvidia.com/blog/ai-decoded-obsidian/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

25/04/2026

Spotify and Vogue Celebrate Music and Culture in Mexico City

In the heart of Mexico City, music, culture, and fashion converged last night as Spotify and Vogue Latin America welcomed guests to an intimate gathering at Soh...

25/04/2026

Brainworx introduce bx_tonebox

New modular multi-effects plug-in revealed The latest plug-in from Brainworx delivers a modular set of effects designed to offer a convenient alternative to...

25/04/2026

Mediagenix Sweeps 2026 NAB Awards With Wins for Product of the Year and Best of Show for Scheduling Optimization

Mediagenix Sweeps 2026 NAB Awards With Wins for Product of the Year and Best of ...

25/04/2026

SCHOEPS Microphones Announces Desert Island Boom Set for NAB 2026

SCHOEPS Microphones Announces Desert Island Boom Set for NAB 2026 Brie Clayton April 24, 2026 0 Comments Compact modular set ideal for location sound ...

25/04/2026

Berklee Africana Studies Hosts Gospel Extravaganza 2026

Berklee Africana Studies Hosts Gospel Extravaganza 2026 The Signature Series event will honor three new inductees to the Berklee Gospel Hall of Fame and celeb...

25/04/2026

Student Spotlight: Siva

Student Spotlight: Siva Maja Gierszewska, who performs under the artist name Siva, shares how she found her songwriting confidence at Berklee. April 24, 2026...

25/04/2026

WNBA Offers Free Streaming of all Preseason Games

Share Copy link Facebook X Linkedin Bluesky Email...

24/04/2026

Churchill Downs Inc. Acquires Preakness Stakes for $85 Million

Churchill Downs Inc. (CDI) has announced a definitive agreement to acquire the intellectual property of the Preakness Stakes and Black-Eyed Susan Stakes from 1/...

24/04/2026

Inter Miami CF Opens Miami Freedom Park with 26 LED Displays From Daktronics, DCL

Daktronics has partnered with DCL (Design Communications, Ltd.) to design, manuf...

24/04/2026

NAB 2026: Chyron Launches PRIME Translate for Multi-Language Live Production

Chyron has announced PRIME Translate, a workflow solution that produces live content simultaneously in multiple languages within the PRIME platform. The system ...

24/04/2026

Eutelsat Supports Co-op Cable in Launching Expanded DTH Offering Across the Caribbean

Eutelsat has announced a new partnership with Co-op Cable, introducing an expand...

24/04/2026

Pitch Dublin Deploys Panasonic Laser LCD Projectors for Indoor Golf and Hospitality Venue

Pitch Dublin, an indoor golf simulation and hospitality venue on Dawson Street i...

24/04/2026

G&D and VuWall Appoint Mirko Aubel as EVP Sales EMEA/APAC, Eric Hnique as Chief Revenue Officer

G&D and VuWall have announced two senior leadership appointments, effective Apri...

24/04/2026

Victory+ Becomes Exclusive Local Streaming Home for Minnesota Lynx

Victory , the free sports streaming service from A Parent Media Co. Inc. (APMC), has announced a multi-year agreement to become the exclusive local streaming ho...

24/04/2026

SVG Students To Watch: Jason Weitz, University of South Florida

The former business major from Massachusetts has found his home in graphics and bug operation while contributing to live ESPN productions In the live-sports-vi...

24/04/2026

MASN and Spectrum Announce Multiyear Carriage Agreement

The Mid-Atlantic Sports Network (MASN) and Spectrum have announced a multiyear carriage agreement making MASN available to Spectrum customers in areas of southe...

24/04/2026

Case Study: 4Wall Entertainment Powers 2026 NFL Draft on NETGEAR AV Line Network

The NFL Draft is rebuilt from the ground up in a new city every year. The three-day fan festival is expected to draw 500,000 or more attendees, with millions fo...

24/04/2026

Diversified Continues Live Sports Expansion, Supports Mobile TV Group Ops Center Buildout

Diversified has continued expansion of its sports and media capabilities to supp...

24/04/2026

NAB Show 2026 Is In The Books! Our Coverage Continues at SVG's SportsTech@NABShow Blog

NAB reports that the 2026 NAB Show wrapped with more than 58,000 registered atte...

24/04/2026

NAB 2026: Clear-Com Announces Updates to Arcadia Central Station and Eclipse HX with New ARC Architecture

Clear-Com has announced significant updates to its Arcadia Central Station and E...

24/04/2026

NAB Reports 58,000+ Registered Attendees at 2026 NAB Show, Up From 2025 but Down From 2024

NAB reports that the 2026 NAB Show wrapped with more than 58,000 registered atte...

24/04/2026

Ratings Roundup: NHL Sees Best Regular Season Average Since 2013; CBS Sports Secures Most Watched Final Round Masters

Ratings Roundup is a rundown of recent rating news and is derived from press rel...

24/04/2026

Bleacher Reports Live NFL Draft Stream Builds on Record-Breaking Audience With Player-Driven, Interactive Production

B/R NFL Draft Live' refines the digital giant's productions around footb...

24/04/2026

Sportradar Report: The Viewing Experience Is the Product' as Sports Media Enters New Era of Personalization, Data-Driven Storytelling

Study highlights five pillars shaping modern fan engagement as broadcasters reth...

24/04/2026

ESPN/ABC, NFL Network Prepare for Record-Setting NFL Draft Presentation From Pittsburgh

The 2026 event, the first Draft with NFL Network under the ESPN umbrella, will b...

24/04/2026

SVG GameDay, Ep. 12: Detroit Lions' Jessica Shlemon - Motor City Football at Ford Field

In-venue and creative video staffers at the professional and collegiate level ha...

24/04/2026

Van Wagner Brings Warhol-Inspired Pop Art Vision to NFL Draft Videoboard Production

Integral to the Draft production for three almost decades, the company tells the...

24/04/2026

Film Festival Watch: 17 Sundance Institute-Supported Films to Screen at the 2026 Hot Docs Festival

Championing documentaries that illuminate and expand the artform is at the core ...

24/04/2026

Audiobooks About Climate, Conservation, and the Stories They Inspire

Earth Day is a chance to reflect on our connection to the natural world. To mark the 57th Earth Day on April 22, Spotify's editors have pulled together a co...

24/04/2026

From Page to Stage: Spotify Celebrates Storytelling at the LA Times Festival of Books

This past weekend, Spotify was at the heart of the largest literary event in the...

24/04/2026

What 20 Years of Spotify Data Reveals About Our Listeners

All data tells a story, and in our case, that story is written by you. To celebrate 20 years of Spotify, we're sharing bite sized moments that capture how t...

24/04/2026

The Look Behind the Sound

Over the past 20 years, Spotify's look and feel has evolved with the way people use our platform, while ensuring we preserve an intuitive, personal, and fam...

24/04/2026

Spotify at 20: The Most Streamed Music, Podcasts, and Audiobooks of All Time

It's been 20 years since Spotify began, but the real story is what the world chose to play. For the first time, we're unveiling the most streamed artist...

24/04/2026

Spotify Brings Music and Podcast Recommendations to Claude

Whether you're relaxing at home or on the go, Spotify is there across more than 2,000 devices, ready with your favorites or something new to discover. Now, ...

24/04/2026

Nintendo and Spotify Bring Nostalgia with New Super Mario Galaxy' Playlists

Nintendo and Spotify are welcoming fans to the Super Mario Bros. 40th anniversary and the release of The Super Mario Galaxy Movie with new playlists and a speci...

24/04/2026

AES Show moves to Nashville

30 October - 1 November 2026 The Audio Engineering Society (AES) have announced that the AES Show 2026 will be held on Halloween weekend - Friday 30 October...

24/04/2026

Sennheiser introduce the HD 480 Pro

New closed-back design promises honest' low end Sennheiser have just announced the launch of a new pair of flagship closed-back headphones which they s...

24/04/2026

Cre8audio unveil the Programm

Powerful 12-channel hardware sequencer announced Cre8audio are renowned for their innovative, and often visually striking, designs and although their latest...

24/04/2026

IK Multimedia ARC X Immersive arrives

Room correction now supports full 9.1.6 Dolby Atmos setups The software element of IK Multimedia's room-correction system has just received an update th...

24/04/2026

VSL announce free Big Bang Orchestra expansions

New content for BBO Tutti & BBO Riffs VSL have recently introduced some new free content expansions for two of their most popular Big Bang Orchestra Packs: ...

24/04/2026

Rohde & Schwarz to highlight its R&S EVSD1000 UAV-based navigation analyzer at IFIS 2026

Rohde & Schwarz to highlight its R&S EVSD1000 UAV-based navigation analyzer at I...

24/04/2026

Call for NFVF funding applications to attend Film Festivals and Markets taking place from 01 30 June 2026

The National Film and Video Foundation (NFVF) is pleased to announce that the ca...

24/04/2026

Andrea Riseborough & Ashley Walters To Star In ITV Thriller First Woman' About Race To Find Missing Astronaut

ITV's Director of Drama Polly Hill has commissioned six part propulsive, lun...