Tabby : Your Open-Source AI Coding Assistant

Tabby is an innovative, self-hosted AI coding assistant designed to provide developers with an open-source and on-premises alternative to proprietary tools like GitHub Copilot.

By offering a robust set of features and seamless integration options, Tabby empowers teams to maintain full control over their development environments while leveraging the power of AI-assisted coding.

Key Features

• Self-Contained Design: Tabby operates without requiring a database management system (DBMS) or external cloud services, ensuring data privacy and simplicity.
• OpenAPI Interface: Its OpenAPI support allows easy integration with existing infrastructures, including cloud-based integrated development environments (IDEs).
• GPU Support: Tabby is optimized for consumer-grade GPUs, making it accessible for a wide range of users.

Setting up Tabby is straightforward. The quickest way to launch the server is by using Docker. With a single command, users can deploy Tabby and start leveraging its capabilities:

docker run -it \
  --gpus all -p 8080:8080 -v $HOME/.tabby:/data \
  tabbyml/tabby \
  serve --model StarCoder-1B --device cuda --chat-model Qwen2-1.5B-Instruct

For advanced configurations such as inference type or parallelism, users can refer to the comprehensive documentation provided.

Tabby encourages community contributions. Developers can clone the repository, set up the Rust environment, and build the project using tools like cargo.

The platform supports various operating systems, with dependencies such as protobuf and sqlite3 required for building on Ubuntu or macOS.

To contribute, developers can follow the detailed guide in the CONTRIBUTING.md file and submit pull requests to enhance Tabby’s functionality.

Tabby’s development is dynamic, with frequent updates:

• v0.21.0 (12/06/2024): Integration with Llamafile deployment and improved Answer Engine user experience.
• v0.20.0 (11/10/2024): Support for switching between backend chat models.
• v0.19.0 (10/30/2024): Enhanced discoverability of shared threads on the main page.

Tabby fosters an active community through platforms like Twitter/X, LinkedIn, and its newsletter, enabling developers to stay informed about updates and share insights.

With its open-source ethos and robust feature set, Tabby is a powerful tool for developers seeking a customizable AI coding assistant that prioritizes privacy and flexibility.