After playing around with different open source alternatives to GitHub Copilot, I have my winner: Tabby 🏆

1) Easy to install 🔨
2) Good recommendation for models to use (which support for Fill-in-the-Middle) 🤖
3) VSCode Plugin which gives the same feeling as the official GitHub Copilot (V1) plugin.

Notice: I think, currently it does not support Copilot Chat, but I do not need that right now anyways.

https://tabby.tabbyml.com/

#Tabby #LLM #LocalLLM #StarCoder #StarCoder2 #Copilot #OpenSource

StarCoder2 is a family of code generation models (3B, 7B, and 15B), trained on 600+ programming languages from The Stack v2 and some natural language text such as Wikipedia, Arxiv, and GitHub issues. The models use Grouped Query Attention, a context window of 16,384 tokens, with sliding window attention of 4,096 tokens. The 3B & 7B models were trained on 3+ trillion tokens, while the 15B was trained on 4+ trillion tokens. For more details check out the paper.

— StarCoder2 @ Github

StarCoder2 is a family of open LLMs for code and comes in 3 different sizes with 3B, 7B and 15B parameters. The flagship StarCoder2-15B model is trained on over 4 trillion tokens and 600+ programming languages from The Stack v2. All models use Grouped Query Attention, a context window of 16,384 tokens with a sliding window attention of 4,096 tokens, and were trained using the Fill-in-the-Middle objective.

StarCoder2 offers three model sizes: a 3 billion-parameter model trained by ServiceNow, a 7 billion-parameter model trained by Hugging Face, and a 15 billion-parameter model trained by NVIDIA using NVIDIA NeMo on NVIDIA accelerated infrastructure:

— StarCoder2 @ Hugging Face

https://www.symphora.com/2024/03/starcoder2-open-source-code-completion-models/

#AI #codeCompletion #Huggingface #LLM #NVIDIA #StarCoder2

🌟 Discover #SoftwareHeritage's mission: preserving human code knowledge! Learn about our journey, challenges, and groundbreaking milestone: #StarCoder2, the first #AI model for code using our #repository.

Join us in shaping ethical AI!

👉 Read more: https://www.softwareheritage.org/2024/02/28/responsible-ai-with-starcoder2/