Rewriting our engine on Rust and going open source!
We are rewriting our engine on Rust making it open source.
On Sep 27, we announced Dosei with the vision of providing AI Developers with the best infrastructure. This meant prioritising Python, and we plan to continue this approach! Our vision hasn't changed, but the AI revolution in 2023 has taught us a lesson: companies are rightly concerned about safety, and not many have gone to production yet, despite all the hype. We believe there are two main pillars holding companies back from going to production: the already mentioned safety concerns and a lack of infrastructure. The latter is why we started building Dosei, and we plan to address safety and trust by going open source.
To delve a bit deeper into why Dosei exists
When we talk about AI Developers, we are specifically referring to engineers working on the application layer. There's already a lot of infrastructure in place for MLOps, and while there is room for improvement—which we hope to contribute to further down the line—we feel there are plenty of tools available already.
The challenge we continue to see is at the application layer. We aim to provide developer tools so individuals and companies can leverage advancements in foundational models for their use cases without investing millions in ML Research and Development.
Open source
Today, we're making our engine for orchestrating Dosei Cron Jobs open source, along with our proxy. We are transitioning away from our existing proprietary code, which is predominantly based on Kubernetes, as part of an effort to simplify our system giving birth to the Dosei Engine, the first component we are releasing as open source. Our goal is to eventually open source everything, possibly except the console UI view. Thus, all functionality on Dosei will be available for enterprises or individuals who choose to self-host.
We will simply offer a managed version of this, so we can be default alive and invest more engineering resources on our tooling.
Not only the engine, but our SDKs, CLI, and everything else is already open source as of today. Check it out on our GitHub Profile! Here are some links:
- Engine: https://github.com/doseiai/engine
- Python SDK: https://github.com/doseiai/python-sdk
- Examples, base images, others…: https://github.com/doseiai/dosei
- Dosei Command Line Interface (CLI): https://github.com/doseiai/dctl
- Docs: https://github.com/doseiai/docs
Regarding our open source journey, we acknowledge that the current repo does not represent the full Dosei platform. However, we are in the process of transferring and open-sourcing additional components. We decided to start this phase earlier to allow the community to participate in the journey!
Writing the Engine on Rust
Let's be honest: at this stage, choosing Rust over other high-level programming languages doesn't have much impact, as most of our work involves calling the Docker API and exposing endpoints. However, we are building a distributed system for orchestrating containers and jobs, and Rust's network reliability is rock-solid. Rust will play an even bigger role in our pipelines for zero-config deployments, which we believe will significantly improve performance. We plan to open source this and blog about it soon, so stay tuned! We are choosing rust to build infrastructure that can be highly performant and also provide developer tooling writing on lower languages like rust so everyday working on interpreted languages, specially python, can leverage the performance of our tooling. That’s the path we believe is going forward!
Joining the community
We would love to have you on board on our transition to open source, if you have any feedback, or ideas to share or want to contribute on any way, join our Discord Server!