gpt4all

Nomic GPT4All https://www.nomic.ai/blog/posts/gpt4all-scaling-test-time-co... https://github.com/nomic-ai/gpt4all/releases

GPT4All for an even easier gui https://github.com/nomic-ai/gpt4all

From the moment Llama 3.1 was released, GPT4All developers have been working hard to make a beta version of tool calling available. We're happy to announce that the beta is now ready. The first tool is web search implemented through brave.com just as in the Llama 3.1 paper. A wiki has been made to walk users through the setup here: https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Rel... Join us on discord to give feedback and get help with the new Llama 3.1 Beta for GPT4All: https://discord.com/invite/4M2QFmTt2k

Thanks for taking the time to respond. I was thinking of something local, especially in light of: Google's Gemini AI caught scanning Google Drive PDF files without permission https://news.ycombinator.com/item?id=40965892 . Looks like GPT4All[1] and AnythingLLM[2] are worth exploring. There's also the closed-source macOS app RecurseChat[3,4] which appeared on HN a few months ago[5]. [1] https://github.com/nomic-ai/gpt4all [2] https://github.com/Mintplex-Labs/anything-llm [3] https://recurse.chat [4] https://recurse.chat/blog/posts/local-docs [5] https://news.ycombinator.com/item?id=39532367

Nice, adding these to my list. Here's a list that I put together, it has active GitHub projects for LLM UIs, ordered by stars: - https://github.com/nomic-ai/gpt4all - https://github.com/imartinez/privateGPT - https://github.com/oobabooga/text-generation-webui - https://github.com/FlowiseAI/Flowise - https://github.com/lobehub/lobe-chat - https://github.com/PromtEngineer/localGPT - https://github.com/h2oai/h2ogpt - https://github.com/huggingface/chat-ui - https://github.com/SillyTavern/SillyTavern - https://github.com/ollama-webui/ollama-webui - https://github.com/Chainlit/chainlit - https://github.com/LostRuins/koboldcpp - https://github.com/ParisNeo/lollms-webui/

The readme page is cryptic. What does 'mature' mean in this context? What is the sample text a continuation of? Having a gif the thing in use would be great, similar to the gpt4all readme page. (https://github.com/nomic-ai/gpt4all)

Check https://github.com/nomic-ai/gpt4all instead.

Totally misleading. What you actually are looking for is gpt4all: https://github.com/nomic-ai/gpt4all

It seems someone just automatically scraped all chatgpt-related apps. For example GPT4All is also there, which is very much alive and kicking: https://github.com/nomic-ai/gpt4all.

I run one. I built an iMessage-like frontend to it using plain JS and a Python websocket backend. I use it mostly for curiosity and playing with different prompts. I only have 16GB of RAM to dedicate to it, so I use an 13B parameter model which is enough for fun and chitchat, but I don't find it good enough to replace ChatGPT. In the future I would like to upgrade to Llama2 and observe the difference. https://github.com/nomic-ai/gpt4all

Agreed. Gpt4all[1] offers a similar 'simple setup' but with application exe downloads, but is arguably more like open core because the gpt4all makers (nomic?) want to sell you the vector database addon stuff on top. [1]https://github.com/nomic-ai/gpt4all I like this one because it feels more private / is not being pushed by a company that can do a rug pull. This can still do a rug pull, but it would be harder to do.

I have been researching methods and projects built around training and running LLMs locally. I'm interested in what others have been using on this front (including straight up Pytorch/Transformers). Here's what I've gathered so far: Engines/APIs: - vllm: Inference and serving engine for LLMs (none quantized models only?) [1] - ollama: Go project to run, create and share LLMs [2] - llama.cpp: Inference of LLaMA models in C/C++ w/UI (including quantized models) [3] - llama-cpp-python: run OpenAI compatible API bindings for llama.cpp [4] - llm-engine: engine for fine-tuning and serving LLMs [5] - Lamini: hosted? closed source? solution for training LLMs [6] - GPT4All: free, locally run chatbot [7] - SkyPilot: framework for running LLMs, AI, and batch jobs [8] - HuggingFace Transformers: APIs and tools to download and train

The most recent gpt4all (https://github.com/nomic-ai/gpt4all) includes a local server compatible with OpenAPI -- this could be a useful start!

Are you about to use GPT4ALL[^1] or anything else? If you're going with the second option, then please share any link to such resources... I'd be interested. And, to share with you something: I saw somewhere a tool (maybe it was GPT4ALL itself) that had the ability to expose a OpenAI-compatible local API on localhost:8080... Ah, yes. Here it is. Actually, there are two. They are described as possible backends for Bavarder (that's a free access to multiple online models, API key is not required): https://bavarder.codeberg.page/help/local/ [^1]: https://github.com/nomic-ai/gpt4all/blob/main/gpt4all-backen...