llama-cookbook

It’s literally the title in the README: https://github.com/meta-llama/llama-recipes/tree/main/recipe...

This is in fact pretty explicitly not open source: https://github.com/meta-llama/llama-recipes/blob/d83d0ae7f5c... (And given there is no LICENSE file, I’m afraid you can only use this code as reference at best right now)

> Here is the Llama source code Correct me if I'm wrong, but that's the code for doing inference? Meta employee told me just the other day: "However, at the moment-we haven't open sourced the pre-training scripts", can't imagine they would be wrong about it? https://github.com/meta-llama/llama-recipes/issues/693 > For models I prefer the term "open weight" Personally, "Open" implies I can download them without signing an agreement with LLama, and I can do whatever I want with it. But I understand the community seems to think otherwise, especially considering the messaging Meta has around Llama, and how little the community is pushing back on it. So Meta doesn't allow downloading the Llama weights without accepting the terms from them, doesn't allow unrestricted usage of those weights, doesn't share the training scripts nor the training da

The resources for link to model card[1], research paper, and Prompt Guard Tutorial[2] on the page doesn't exist yet [1]: https://github.com/meta-llama/llama-models/blob/main/models/... [2]: https://github.com/meta-llama/llama-recipes/blob/main/recipe...

There are a whole bunch of prompts for this here: https://github.com/facebookresearch/llama-recipes/commit/109...

As mentioned in the OP's blog post, checkout https://github.com/facebookresearch/llama-recipes.git. specifically files in ft_datasets directory. I am able to finetune meta-llama/Llama-2-13b-chat-hf on a 3090 using instructions from quickstart.ipynb.