DrBusySloth

@drbusysloth
34 Followers
93 Following
83 Posts
Open source, infrastructure, AI, and tech (and more).
Research-trained. Production-scarred.
Making AI infrastructure boring again with https://mlox.org 🦥
https://mlox.orgMLOX Website
https://github.com/BusySloths/mloxGithub

If you're into infra, MLOX is fully open source: backends, plugins, and service definitions are just code. Star the repo, read the internals, and send a PR to add your favorite tool or cloud provider. Let's build a better ML stack together.

#opensource #contributors #selfhosting

Every MLOX-created project comes with a secret manager integrated from day one. Credentials for DBs, object stores, and services are handled consistently, so you don’t end up with ad-hoc env var sprawl in CI/CD and local dev.
#security #MLOps

Observability by default: using OpenTelemetry in MLOX, you can track traces, logs, and metrics from the start. No more "we'll add monitoring later": the infra is ready when your first model ships.

#selfhosting #ai #mlops

Want to experiment with LLM serving? With the Docker backend, MLOX can provision LiteLLM + Ollama and wire them into your stack. Quickly test prompt flows, local models, or gateways without learning yet another deployment toolchain.

#LLM #MLOps #SelfHosting

MLOX lets you deploy models with security and tracking built-in: Log your model to MLflow and then deploy with one command via MLServer. Auth and wiring are handled for you, so you go from “logged run” to “live endpoint” without manual glue scripts.

#opensource #selfhosting #AI

MLOX has a plugin system designed for extension: add new backends or services by dropping in plugins instead of forking the core. Ideal if you want to integrate your own orchestrator, model store, or custom infra tooling.

#opensource #selfhosting

Kubernetes feels heavy? MLOX wraps cluster creation into a guided flow: configure once, get a working K8s cluster with the right addons for ML workloads. Less kubectl boilerplate, more time on models and pipelines.
#Kubernetes #MLOps
Need a remote playground fast? Point MLOX at a fresh Ubuntu VPS and let it handle SSH hardening, system updates, Git, Docker/Kubernetes installs, and more. You get a reproducible, remote environment in minutes.
#infra #automation #selfhosting

Es gibt immer mehr Gründe, nicht *komplett* auf Hyperscaler zu setzen. Hier ist ein neuer: 🚀

In einem aktuellen Konflikt hat der Iran eine Liste mit 29 Tech-Standorten von Amazon, Google, Microsoft & Co. als mögliche Ziele veröffentlicht.

Wenn kritische Infrastruktur zentralisiert ist, wird sie auch geopolitisch relevant.

https://www.golem.de/news/krieg-iran-nennt-29-us-tech-standorte-als-ziele-2603-206419.html

#Cloud #SelfHosting #OpenSource

Krieg: Iran nennt 29 US-Tech-Standorte als Ziele - Golem.de

Iran hat nach Drohnenangriffen auf AWS-Rechenzentren eine Zielliste mit Infrastruktur von Amazon, Google und Microsoft veröffentlicht und droht mit Angriffen.

Golem.de

The Docker backend is our most complete environment: spin up Airflow, MLflow, InfluxDB, Postgres, Milvus, LiteLLM, Ollama, and deploy your models via MLServer using the MLOX UI or CLI.

#AI #MLOps #SelfHosting