obsidian-local-llm

You can get almost the same results for free using Obsidian Canvas and one of the following plugins: - https://github.com/MetaCorp/obsidian-augmented-canvas - https://github.com/phasip/obsidian-canvas-llm-extender - https://github.com/rpggio/obsidian-chat-stream - https://github.com/zatevakhin/obsidian-local-llm

There are these plugins: https://github.com/zatevakhin/obsidian-local-llm https://github.com/hinterdupfinger/obsidian-ollama Which already exist and if nothing else are decent starting points. > Not sure if local LLMs are powerful enough yet to enable meaningful/reliable outcomes I've dabbled, briefly, with Ollama running Mistral locally on an M1 MacBook Pro with 32GB of unified memory, and throwing a couple of hundred markdown documents at it via a RAG resulted in quite decent output to prompts asking questions about abstract contents/summariesbbased on those docs. So I'd say we're already at a point where you can have meaningful outcomes; reliability is a whole other issue though.

Great job! I played around with this on a couple of small knowledge bases using an open Hermes model I had downloaded. The “related notes” feature didn't provide much value in my experience, often the link was so weak it was nonsensical. The Q&A mode was surprisingly helpful for querying notes and providing overviews, but asking anything specific typically just resulted in less than helpful or false answers. I'm sure this could be improved with a better model etc. As a concept, I strongly support the development of private, locally-run knowledge management tools. Ideally, these solutions should prioritise user data privacy and interoperability, allowing users to easily export and migrate their notes if a new service better fits their needs. Or better yet, be completely local, but have functionality for 'plugins' so a user can import their