llama.vscode

Have you tried llama.vscode [0]? I use the vim equivalent, llama.vim [1] with Qwen3 Coder 30B and personally feel that it's better than Copilot. I have hot keys that allow me to quickly switch between the two and find myself always going back to local. [0] https://github.com/ggml-org/llama.vscode [1] https://github.com/ggml-org/llama.vim

I am working on a larger project about containers and isolation stronger than current conventions but short kata etc… But if you follow the podman instructions for cuda, the llama.cpp shows you how to use their plugin here https://github.com/ggml-org/llama.vscode

how are you running qwen3 with llama-vscode? I am still using qwen-2.5-7b. There is an open issue about adding support for Qwn3 which I have been monitoring, would love to use Qwen3 if possible. Issue - https://github.com/ggml-org/llama.vscode/issues/55

I'm on a m1 max with 64gb ram, but i never use this vscode plugin before. Should I try? Is this the one? https://github.com/ggml-org/llama.vscode it sems to be built for code completion rather than outright agent mode

- https://github.com/cline/cline - https://github.com/ggml-org/llama.vscode - https://openrouter.ai I'm sure there are others if you're interesting in switching to something else.

Is this more or less the same as your VSCode version? (https://github.com/ggml-org/llama.vscode)

Hi HN, happy to see this here! I highly recommend to take a look at the technical details of the server implementation that enables large context usage with this plugin - I think it is interesting and has some cool ideas [0]. Also, the same plugin is available for VS Code [1]. Let me know if you have any questions about the plugin - happy to explain. Btw, the performance has improved compared to what is seen in the README videos thanks to client-side caching. [0] - https://github.com/ggerganov/llama.cpp/pull/9787 [1] - https://github.com/ggml-org/llama.vscode

You can run it all locally: https://github.com/ggml-org/llama.vscode