Open-Assistant

LLama hasn't been fine-tuned with RLHF, so it requires additional prompting, check out the open-assistant[0] project for an open-source ChatGPT equivalent (WIP). [0]: https://github.com/LAION-AI/Open-Assistant

There is a project along the lines you mention but it's still under development https://github.com/LAION-AI/Open-Assistant

The folks making Open Assistant [1] (opensource ChatGPT clone) gathered enough data to start initial training, so hopefully there will be something to play with soon. [1] https://github.com/LAION-AI/Open-Assistant

I was looking for open alternatives to self hosted, or crowd hosted finetuned LLMs like ChatGPT and found LAION Open Assistant. Then found resources to further optimize inference as well as training: - Open source fine tuned assistants like LAION Open-Assistant [1] - inference optimizations like VoltaML, FlexGenm Distributed Inference [2] - training optimizations like Hivemind [2] 1 https://github.com/LAION-AI/Open-Assistant 2 https://github.com/underlines/awesome-marketing-datascience/...

Hooking ChatGPT (and similar architectures) into applications is going to be the next big thing. It just takes time to hook up various systems. Eventually a vision module will be integrated and it will probably be able to "figure out" most systems. There's a lot of money to be made in hooking up these "brains" into apps. I hope people get on it, since it will be quite convenient. See: Act-1: https://news.ycombinator.com/item?id=32842860 Open-Assistant: https://github.com/LAION-AI/Open-Assistant Toolformer: https://arxiv.org/abs/2302.04761 Understanding HTML with LLMs: https://arxiv.org/abs/2210.03945

LAION is working on an open chatgpt like model [0] and there is a project discussed here recently that is about running the llms on single gpus [1] I agree, there is a very serious risk of newer AI advances being closed by default, and I think it's not being taken seriously enough. Even "open" players are still for-profit, say Huggingface. There really needs to be Linux or FSF like players that are motivated by freedom. [0] https://github.com/LAION-AI/Open-Assistant [1] https://github.com/FMInference/FlexGen

I'm stupid in this area and have only a very broad understanding of "AI". But isn't this already happening in this project? https://github.com/LAION-AI/Open-Assistant

There is the Open Assistant project: https://github.com/LAION-AI/Open-Assistant There is also EleutherAI (https://www.eleuther.ai/about/) with GPT-NeoX (https://github.com/EleutherAI/gpt-neox).

there is https://github.com/laion-ai/open-assistant being built in the open already. you can contribute too. please also notice that the article you linked is about the text classifier of the frontend and not the LLM itself

Look at OpenAssistant (https://github.com/LAION-AI/Open-Assistant); they are trying to give a chatbot the ability to trigger actions in other systems. I fleshed out a scenario in more detail here: https://news.ycombinator.com/item?id=34808674. But in brief, the short-term evolution of LLMs is going to involve something like letting it `eval()` some code to take an action as part of a response to a prompt. A recent paper, Toolformer: https://pub.towardsai.net/exploring-toolformer-meta-ai-new-t... which is training on a small set of hand-chosen tools, rather than `eval(<arbitrary code>)`, but hopefully it's clear that it's a very small step from the former to the latter.

Open Assistant (started by some of the people that started Stable Diffusion I think?) is very early, but looks very promising. https://open-assistant.io/ https://github.com/LAION-AI/Open-Assistant

I think this is a sad way to go. Hardware is super expensive to develop and the key IP here is in the software. There's probably some fancy microphone tech, but ultimately you could (should?) run Mycroft on a Raspberry Pi with an edge accelerator device. Technically I think we're getting close to a good offline system. Home Assistant solves the practical aspect of controlling systems and triggered routines - it really works well, at least on par with vendor software. Speech recognition models are usable and getting better. The interesting "glue" is parsing the commands into something reasonable and I think open source LLMs are likely to be the answer. See Open Assistant [0] for example. It doesn't solve the knowledge base issue (e.g. people seem to use Alexa either as a very fancy egg timer, or for querying facts), but it would probably a

They made T5 and released the weights, while T5 "only" goes up to 11B params, it's an efficient model for a wide variety of tasks and the base for a lot of other models/projects. Of note imagen[1] and open-assistant[2] use T5 and FlanT5. [1] https://imagen.research.google/ [2] https://github.com/LAION-AI/Open-Assistant

https://github.com/LAION-AI/Open-Assistant/issues/1110 > https://www.gutenberg.org/ has an extensive collection of ebooks in multiple languages and formats that would make great trianing data … > There is detailed legal information on which books are under public domain and which ones are copyrighted, it would be great if someone would go through these and decide which books are okay to crawl and use as training data (my understanding is that it is okay to scrape the contents as they are publicly available in a browser, but just to be sure) Yup, sure are the same folk who put together that dataset they used to train stable diffusion. Data? Yeah, just take everything. It’s all good.

I tried to find the source for https://github.com/LAION-AI/Open-Assistant/blob/v0.0.1-beta2... but based on the image inspector <https://hub.docker.com/layers/ykilcher/text-generation-infer...> it seems to match up with https://github.com/huggingface/text-generation-inference/blo...