Get Plugged In: How to Use Generative AI Tools in Obsidian
06/11/2024
As generative AI evolves and accelerates industry, a community of AI enthusiasts is experimenting with ways to integrate the powerful technology into common productivity workflows.
Applications that support community plug-ins give users the power to explore how large language models (LLMs) can enhance a variety of workflows. By using local inference servers powered by the NVIDIA RTX-accelerated llama.cpp software library, users on RTX AI PCs can integrate local LLMs with ease.
Previously, we looked at how users can take advantage of Leo AI in the Brave web browser to optimize the web browsing experience. Today, we look at Obsidian, a popular writing and note-taking application, based on the Markdown markup language, that's useful for keeping complex and linked records for multiple projects. The app supports community-developed plug-ins that bring additional functionality, including several that enable users to connect Obsidian to a local inferencing server like Ollama or LM Studio.
Using Obsidian and LM Studio to generate notes with a 27B-parameter LLM accelerated by RTX. Connecting Obsidian to LM Studio only requires enabling the local server functionality in LM Studio by clicking on the Developer icon on the left panel, loading any downloaded model, enabling the CORS toggle and clicking Start. Take note of the chat completion URL from the Developer log console ( http://localhost:1234/v1/chat/completions by default), as the plug-ins will need this information to connect.
Next, launch Obsidian and open the Settings panel. Click Community plug-ins and then Browse. There are several community plug-ins related to LLMs, but two popular options are Text Generator and Smart Connections.
Text Generator is helpful for generating content in an Obsidian vault, like notes and summaries on a research topic.
Smart Connections is useful for asking questions about the contents of an Obsidian vault, such as the answer to an obscure trivia question previously saved years ago.
Each plug-in has its own way of entering the LM Server URL.
For Text Generator, open the settings and select Custom for Provider profile and paste the whole URL into the Endpoint field. For Smart Connections, configure the settings after starting the plug-in. In the settings panel on the right side of the interface, select Custom Local (OpenAI Format) for the model platform. Then, enter the URL and the model name (e.g., gemma-2-27b-instruct ) into their respective fields as they appear in LM Studio.
Once the fields are filled in, the plug-ins will function. The LM Studio user interface will also show logged activity if users are curious about what's happening on the local server side.
Transforming Workflows With Obsidian AI Plug-Ins Both the Text Generator and Smart Connections plug-ins use generative AI in compelling ways.
For example, imagine a user wants to plan a vacation to the fictitious destination of Lunar City and brainstorm ideas for what to do there. The user would start a new note, titled What to Do in Lunar City. Since Lunar City is not a real place, the query sent to the LLM will need to include a few extra instructions to guide the responses. Click the Text Generator plug-in icon, and the model will generate a list of activities to do during the trip.
Obsidian, via the Text Generator plug-in, will request LM Studio to generate a response, and in turn LM Studio will run the Gemma 2 27B model. With RTX GPU acceleration in the user's computer, the model can quickly generate a list of things to do.
The Text Generator community plug-in in Obsidian enables users to connect to an LLM in LM Studio and generate notes for an imaginary vacation. The Text Generator community plug-in in Obsidian allows users to access an LLM through LM Studio to generate notes for a fictional vacation. Or, suppose many years later the user's friend is going to Lunar City and wants to know where to eat. The user may not remember the names of the places where they ate, but they can check the notes in their vault (Obsidian's term for a collection of notes) in case they'd written something down.
Rather than looking through all of the notes manually, a user can use the Smart Connections plug-in to ask questions about their vault of notes and other content. The plug-in uses the same LM Studio server to respond to the request, and provides relevant information it finds from the user's notes to assist the process. The plug-in does this using a technique called retrieval-augmented generation.
The Smart Connections community plug-in in Obsidian uses retrieval-augmented generation and a connection to LM Studio to enable users to query their notes. These are fun examples, but after spending some time with these capabilities, users can see the real benefits and improvements for everyday productivity. Obsidian plug-ins are just two ways in which community developers and AI enthusiasts are embracing AI to supercharge their PC experiences. .
NVIDIA GeForce RTX technology for Windows PCs can run thousands of open-source models for developers to integrate into their Windows apps.
Learn more about the power of LLMs, Text Generation and Smart Connections by integrating Obsidian into your workflow and play with the accelerated experience available on RTX AI PCs
Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.
More from Nvidia
11/12/2024
Into the Omniverse: How OpenUSD-Based Simulation and Synthetic Data Generation Advance Robot Learning
Editor's note: This post is part of Into the Omniverse, a series focused on ...
10/12/2024
AI Pioneers Win Nobel Prizes for Physics and Chemistry
Artificial intelligence, once the realm of science fiction, claimed its place at the pinnacle of scientific achievement Monday in Sweden. In a historic ceremon...
10/12/2024
Turn Down the Noise: CUDA-Q Enables Industry-First Quantum Computing Demo With Logical Qubits
Quantum computing has the potential to transform industries ranging from drug di...
09/12/2024
Crowning Achievement: NVIDIA Research Model Enables Fast, Efficient Dynamic Scene Reconstruction
Content streaming and engagement are entering a new dimension with QUEEN, an AI ...
06/12/2024
Thailand and Vietnam Embrace Sovereign AI to Drive Economic Growth
Southeast Asia is embracing sovereign AI. The prime ministers of Thailand and Vietnam this week met with NVIDIA founder and CEO Jensen Huang to discuss initiat...
05/12/2024
2025 Predictions: Enterprises, Researchers and Startups Home In on Humanoids, AI Agents as Generative AI Crosses the Chasm
From boardroom to break room, generative AI took this year by storm, stirring di...
05/12/2024
Stream Indiana Jones and the Great Circle' at Launch With RTX Power in the Cloud at up to 50% Off
GeForce NOW is wrapping a sleigh-full of gaming gifts this month, stuffing membe...
04/12/2024
NVIDIA NIM on AWS Supercharges AI Inference
Generative AI is rapidly transforming industries, driving demand for secure, high-performance inference solutions to scale increasingly complex models efficient...
03/12/2024
NVIDIA Advances Physical AI With Accelerated Robotics Simulation on AWS
Field AI is building robot brains that enable robots to autonomously manage a wide range of industrial processes. Vention creates pretrained skills to ease deve...
03/12/2024
Latest NVIDIA AI, Robotics and Quantum Computing Software Comes to AWS
Expanding what's possible for developers and enterprises in the cloud, NVIDIA and Amazon Web Services are converging at AWS re:Invent in Las Vegas this week...
03/12/2024
How AI Can Enhance Disability Inclusion, Special Education
A recent survey from the Special Olympics Global Center for Inclusion in Education shows that while a majority of students with an intellectual and developmenta...
03/12/2024
New NVIDIA Certifications Expand Professionals' Credentials in AI Infrastructure and Operations
As generative AI continues to grow, implementing and managing the right infrastr...
02/12/2024
Siemens Healthineers Adopts MONAI Deploy for Medical Imaging AI
3.6 billion. That's about how many medical imaging tests are performed annually worldwide to diagnose, monitor and treat various conditions. Speeding up th...
28/11/2024
Get the Power of GeForce-Powered Gaming in the Cloud Half Off With Black Friday Deal
Turn Black Friday into Green Thursday with a new deal on GeForce NOW Ultimate an...
27/11/2024
How RTX AI PCs Unlock AI Agents That Solve Complex Problems Autonomously With Generative AI
Editor's note: This post is part of the AI Decoded series, which demystifies...
26/11/2024
Taste of Success: Zordi Plants AI and Robotics to Grow Flavorful Strawberries Indoors
With startup Zordi, founder Gilwoo Lee's enthusiasm for robotics, healthy ea...
25/11/2024
Why Workforce Development Is Key to Reaping AI Benefits
AI is changing industries and economies worldwide. Workforce development is central to ensuring the changes benefit all of us, as Louis Stewart, head of strate...
25/11/2024
Now Hear This: World's Most Flexible Sound Machine Debuts
A team of generative AI researchers created a Swiss Army knife for sound, one that allows users to control the audio output simply using text. While some AI mo...
21/11/2024
Efficiency Meets Personalization: How AI Agents Improve Customer Service
Editor's note: This post is the first in the AI On blog series, which explores the latest techniques and real-world applications of agentic AI, chatbots and...
21/11/2024
First Star Wars Outlaws' Story Pack Hits GeForce NOW
Get ready to dive deeper into the criminal underworld of a galaxy far, far away as GeForce NOW brings the first major story pack for Star Wars Outlaws to the cl...
21/11/2024
Into the Omniverse: How Generative AI Fuels Personalized, Brand-Accurate Visuals With OpenUSD
Editor's note: This post is part of Into the Omniverse, a blog series focuse...
20/11/2024
The Need for Speed: NVIDIA Accelerates Majority of World's Supercomputers to Drive Advancements in Science and Technology
Starting with the release of CUDA in 2006, NVIDIA has driven advancements in AI ...
19/11/2024
AI at COP29: Balancing Innovation and Sustainability
As COP29 attendees gather in Baku, Azerbaijan, to tackle climate change, the role AI plays in environmental sustainability is front and center. A panel hosted ...
19/11/2024
How the Department of Energy's AI Initiatives Are Transforming Science, Industry and Government
The U.S. Department of Energy oversees national energy policy and production. As...
19/11/2024
Microsoft and NVIDIA Supercharge AI Development on RTX AI PCs
Generative AI-powered laptops and PCs are unlocking advancements in gaming, content creation, productivity and development. Today, over 600 Windows apps and gam...
19/11/2024
NVIDIA and Microsoft Showcase Blackwell Preview, Omniverse Industrial AI and RTX AI PCs at Microsoft Ignite
NVIDIA and Microsoft today unveiled product integrations designed to advance ful...
18/11/2024
From Algorithms to Atoms: NVIDIA ALCHEMI NIM Catalyzes Sustainable Materials Research for EV Batteries, Solar Panels and More
More than 96% of all manufactured goods - ranging from everyday products, like l...
18/11/2024
Foxconn Expands Blackwell Testing and Production With New Factories in U.S., Mexico and Taiwan
To meet demand for Blackwell, now in full production, Foxconn, the world's l...
18/11/2024
Hopper Scales New Heights, Accelerating AI and HPC Applications for Mainstream Enterprise Servers
Since its introduction, the NVIDIA Hopper architecture has transformed the AI an...
18/11/2024
NVIDIA Releases cuPyNumeric, Enabling Scientists to Harness GPU Acceleration at Cluster Scale
Whether they're looking at nanoscale electron behaviors or starry galaxies c...
18/11/2024
Faster Forecasts: NVIDIA Launches Earth-2 NIM Microservices for 500x Speedup in Delivering Higher-Resolution Simulations
NVIDIA today at SC24 announced two new NVIDIA NIM microservices that can acceler...
18/11/2024
AI Will Drive Scientific Breakthroughs, NVIDIA CEO Says at SC24
NVIDIA kicked off SC24 in Atlanta with a wave of AI and supercomputing tools set to revolutionize industries like biopharma and climate science. The announceme...
14/11/2024
From Seed to Stream: Farming Simulator 25' Sprouts on GeForce NOW
Grab a pitchfork and fire up the tractor - the fields of GeForce NOW are about to get a whole lot greener with Farming Simulator 25. Whether looking for a time...
14/11/2024
Open for Development: NVIDIA Works With Cloud-Native Community to Advance AI and ML
Cloud-native technologies have become crucial for developers to create and imple...
14/11/2024
NVIDIA Ranks No. 1 as Forbes Debuts List of America's Best Companies 2025
NVIDIA ranked No. 1 on Forbes magazine's new list - America's Best Companies - based on more than 60 measures in nearly a dozen categories that cover fi...
14/11/2024
Keeping an AI on Diabetes Risk: Gen AI Model Predicts Blood Sugar Levels Four Years Out
Diabetics - or others monitoring their sugar intake - may look at a cookie and w...
13/11/2024
Indonesia Tech Leaders Team With NVIDIA and Partners to Launch Nation's AI
Working with NVIDIA and its partners, Indonesia's technology leaders have launched an initiative to bring sovereign AI to the nation's more than 277 mil...
13/11/2024
2025 Predictions: AI Finds a Reason to Tap Industry Data Lakes
Since the advent of the computer age, industries have been so awash in stored data that most of it never gets put to use. This data is estimated to be in the n...
13/11/2024
Peak Training: Blackwell Delivers Next-Level MLPerf Training Performance
Generative AI applications that use text, computer code, protein chains, summaries, video and even 3D graphics require data-center-scale accelerated computing t...
12/11/2024
Japan Tech Leaders Supercharge Sovereign AI With NVIDIA AI Enterprise and Omniverse
From call centers to factories to hospitals, AI is sweeping Japan. Undergirding...
12/11/2024
Japan's Startups Drive AI Innovation With NVIDIA Accelerated Computing
Lifelike digital humans engage with audiences in real time. Autonomous systems streamline complex logistics. And AI-driven language tools break down communicati...
12/11/2024
NVIDIA and Global Consulting Leaders Speed AI Adoption Across Japan's Industries
Consulting giants including Accenture, Deloitte, EY Strategy and Consulting Co.,...
12/11/2024
Lab Confidential: Japan Research Keeps Healthcare Data Secure
Established 77 years ago, Mitsui & Co stays vibrant by building businesses and ecosystems with new technologies like generative AI and confidential computing. ...
12/11/2024
Japan Develops Next-Generation Drug Design, Healthcare Robotics and Digital Health Platforms
To provide high-quality medical care to its population - around 30% of whom are ...
12/11/2024
Japan's Market Innovators Bring Physical AI to Industries With NVIDIA AI and Omniverse
Robots transporting heavy metal at a Toyota plant. Yaskawa's robots working ...
12/11/2024
Every Industry, Every Company, Every Country Must Produce a New Industrial Revolution,' Says NVIDIA CEO Jensen Huang at AI Summit Japan
The next technology revolution is here, and Japan is poised to be a major part o...
12/11/2024
GPU's Companion: NVIDIA App Supercharges RTX GPUs With AI-Powered Tools and Features
The NVIDIA app - officially releasing today - is a companion platform for conten...
07/11/2024
Jensen Huang to Discuss AI's Future with Masayoshi Son at AI Summit Japan
NVIDIA founder and CEO Jensen Huang will join SoftBank Group Chairman and CEO Masayoshi Son in a fireside chat at NVIDIA AI Summit Japan to discuss the transfor...
07/11/2024
Welcome to GeForce NOW Performance: Priority Members Get Instant Upgrade
This GFN Thursday, the GeForce NOW Priority membership is getting enhancements and a fresh name to go along with it. The new Performance membership offers more ...
06/11/2024
Hugging Face and NVIDIA to Accelerate Open-Source AI Robotics Research and Development
At the Conference for Robot Learning (CoRL) in Munich, Germany, Hugging Face and...