snowflake-arctic

By truly open, we mean our releases use an OSI-recognized license (Apache-2) and we go beyond just model weights. Here are the things that we are open-sourcing: i) Open-Sourced Model Weights ii) Open-Sourced Fine-Tuning Pipeline. This is essentially the training code if you want to adapt this model to your use cases. This along with an associated cookbook will be released soon, so keep an eye on our repo for updates: https://github.com/Snowflake-Labs/snowflake-arctic/ iii) Open-Sourced Data Information: We trained on publicly available datasets, and we will share information on what these datasets are, how we processed and filtered them, composition of our datasets etc. They will be published as part of the cookbook series here: https://www.snowflake.com/en/data-cloud/arctic/cookbook/, shortly. iv) Open-Sourced Research: We will share all

Arctic dev here. Yes keeping all experts in memory is the recommendation here and understandably that is a barrier to some. But once you have 1 H100 node or two (gpu middle-class I guess...?), then a few things to note: 1. FP6/FP8 inference is pretty good. How to on a single node: https://github.com/Snowflake-Labs/snowflake-arctic/tree/main... (vllm support coming soon!) 2. Small number of activated parameters shine in batch inference case for cloud providers.

The source code they're talking about is not the training code. The only thing I saw released was their inference code and weights. You can verify this by visiting the following: https://github.com/Snowflake-Labs/snowflake-arctic/tree/main https://huggingface.co/Snowflake/snowflake-arctic-base https://huggingface.co/Snowflake/snowflake-arctic-instruct To put it another way, when they share the weights for the model, that's like sharing the compiled output for some software - like releasing an executable instead of the source code that can produce the executable. They aren't sharing the things you need to produce the weights (the training code, training data, any preprocessing code, etc). Without those inputs you actually cannot even audit or verify how the model works. The team making the model might bias the model in all sorts of ways wi