tabby

Looks interesting! What are the main differences between this and https://github.com/TabbyML/tabby ?

TabbyML | Software Engineer (Rust) | Open Source | REMOTE Self-hosted AI coding assistant. An opensource / on-prem alternative to GitHub Copilot. Project: https://github.com/TabbyML/tabby TabbyML is seeking a Software Engineer proficient in Rust to join our core engineering team. In this role, you will be responsible for developing the following features: - Source code indexing and searching - LLM model serving and optimization We have an ambitious roadmap ahead, and we need your help! If you are interested in being an early member of a fast-growing startup team(spoiler: 100% remote , open source , and transparent compensation). Please reach out and apply at https://www.notion.so/tabbyml/Careers-35b1a77f3d1743d9bae06b...

Hi HN, after five months of hard work since Tabby's previous Show HN (https://news.ycombinator.com/item?id=35470915), I'm thrilled to share you the release of Tabby v0.1.1. Previously, Tabby ran exclusively on CUDA devices, posing a significant barrier for developers looking to effectively utilize LLMs in their day-to-day coding. The Tabby team made a significant contribution by enhancing support for the StarCoder series models (1B/3B/7B) in llama.cpp. This enhancement allows these models to run on Metal, providing comparable performance to that of an NVIDIA GPU. I eagerly look forward to receiving feedback from the community and witnessing the enhanced on-edge deployment experience! References: [1] Apple Installation Instructions: https://tabby.tabbyml.com/docs/installation/apple/ [2] Launch blog: https://tabby.tabbyml.com/blog/2023/09/1

Check out https://github.com/TabbyML/tabby, which is fully self-hostable and comes with niche features. On M1/M2, it offers a convenient single binary deployment, thanks to Rust. You can find the latest release at https://github.com/TabbyML/tabby/releases/tag/latest (Disclaimer: I am the author)

A less hyped inference engine with INT8/FP16 inference supports on both CPU / GPU (cuda). Model supports list: GPT-2, GPT-J, GPT-NeoX, OPT, BLOOM, LLAMA, T5, WHISPER ( Found this library during my research on alternatives to triton/FasterTransformer in Tabby https://github.com/TabbyML/tabby)

TabbyML | Full Stack Engineer / Machine Learning Engineer | REMOTE Self-hosted AI coding assistant. An opensource / on-prem alternative to GitHub Copilot. Project: https://github.com/TabbyML/tabby Show HN post: https://news.ycombinator.com/item?id=35470915 We have an ambitious roadmap ahead, and we need your help! If you are interested in being an early member of a fast-growing startup team(spoiler: 100% remote , open source , and transparent compensation). Please reach out and apply at https://tabbyml.notion.site/Careers-35b1a77f3d1743d9bae06b7d...

This is awesome, and glad to see that SkyPilot is useful in distributing Tabby on any cloud! https://github.com/TabbyML/tabby/blob/main/deployment/skypil...

Tabby collected the source code from the related repository and built them into a dataset. I already have some proof-of-concept pipelines built [1] and [2], but I still need some time to polish the data pipeline.. [1]: https://github.com/TabbyML/tabby/blob/main/tabby/tools/repos... [2]: https://github.com/TabbyML/tabby/blob/main/tabby/tools/train...

I would like to introduce Tabby, which is a self-hosted alternative to GitHub Copilot that you can integrate into your hardware. While GitHub Copilot has made coding more efficient and less time-consuming by assisting developers with suggestions and completing code, it raises concerns around privacy and security. Tabby is in its early stages, and we are excited to receive feedback from the community. Its Github repository is located here: https://github.com/TabbyML/tabby. We have also deployed the latest docker image to Huggingface for a live demo: https://huggingface.co/spaces/TabbyML/tabby. Tabby is built on top of the popular Hugging Face Transformers / Triton FasterTransformer backend and is designed to be self-hosted, providing you with complete control over your data and privacy. In Tabby's next feature iteration, you can fine-tune

That‘ll be super interesting! Local context is definitely the key factor for small models achieving better quality than copilot (related: [1], [2]) . One things I’d really wanna have in Sourcegraph: A Search API supports custom retrieval / ranking. Research works (e.g [2]) show simple BoW fetched context is more efficient for code completion tasks. Disclaimer: I’m building https://github.com/TabbyML/tabby an open source alternative of copilot. [1]: https://arxiv.org/abs/2206.12839 [2]: https://arxiv.org/abs/2303.12570

Cody is more like a wrapper on top of GPT API (gpt-3.5-turbo) endpoint, with related code snippets embed in prompt. It’s not competing the low latency scenario that Github Copilot seats in. There’re recent works show a potential of beating Copilot’s performance (e.g https://arxiv.org/abs/2303.12570) with much smaller models (500M vs 10B+). Inspired by these work, I’m building Tabby (https://github.com/TabbyML/tabby), a OSS GitHub Copilot alternative. Hopefully it could make low cost AI coding accessible to everyone.