And, finally, success. Figuring out access controls took a bit of work too. It was particularly weird to see that I could navigate to the 'create user' section through the browser, but not actually create the user. The solution to that was setting the --cors-allowed-origins flag to be the sites own URL (I'm sure this makes perfect sense to a webdeveloper).
It will take a bit of getting used to that some management will happen through python scripts (such as changing user passwords)
For anyone curious: 'Invalid Host header' means that the '--allowed-hosts' flag has to be set, with the actual web address through which mlflow will be accessed. That works now.
Next step is checking that the python api also works, and then figuring our access control(s).
Given my zero web developing knowledge, I am feeling very technical.
Next hurdle was acually connecting to the machine through the internet. There are two ways which need to work:
- through a browser, so we can inspect our results.
- through the python API, so we can actually log our results.
This morning I figured out how to get the browser thing to work. Or, more precisely, a friendly IT guy told me what my error message meant, so I could figure out what to change in the setup.
I thought I would start a thread documenting my exploration of #mlflow as a #neptune replacement to track machine learning experiments and results in my group.
First results:
I got the university to set up a virtual machine (which was, disappointingly, not-free) on which to run the service. That took a lot of back-and-forth with IT until both I and a few phd students could actually log in. But we got there.
MLflow로 AI 에이전트 안전성 테스트: GPT vs Gemini 레드팀 실험
MLflow를 활용해 AI 에이전트 안전성을 체계적으로 평가하는 3-모델 레드팀 프레임워크. GPT vs Gemini 실험 결과와 실무 적용 방법을 소개합니다.
AI Skills 2025: LangChain, RAG & MLOps—The Complete Guide
https://techlife.blog/posts/ai-skills-2025-langchain-rag-mlops-guide/
#LangChain #RAG #MLOps #LangGraph #DeepAgents #Kubernetes #VectorDatabases #ChromaDB #Weaviate #Pinecone #MLflow
Benchmark Driven Development: почему мы перестали верить чужим бенчмаркам
В этой статье расскажем, как мы пришли к подходу, который внутри называем Benchmark Driven Development (BDD) — разработка, движимая бенчмарками на своих данных. (Да, мы знаем, что BDD — это ещё и Behavior Driven Development, тут у нас своя расшифровка 🙂)
🚀 New blog post: Choosing the Right LLM with MLflow
How do you systematically evaluate which open-source LLM performs best for your use case?
I wrote a hands-on guide covering:
✅ Comparing multiple models (Llama, Mistral, DeepSeek)
✅ Docker Compose infrastructure
✅ Complete Python & bash code
The evaluation pipeline works unchanged from local → staging → production.
#MLOps #LLM #MLflow #Python #DevOps #MachineLearning #OpenSource #AI
Единый вход для ML-стека на примере Keycloak
Привет! Я Саша Абакумов, DevOps-инженер в KTS . Нашей команде часто приходится поднимать инфраструктуру под ML-проекты. Со временем число ML-инженеров и разработчиков на таких проектах росло, и логиниться в каждый по отдельности становилось все больнее. Чтобы упростить коллегам жизнь, мы интегрировали Single Sign-On (SSO) в стек одного из наших проектов, состоящий из JupyterHub, Airflow и MLflow. SSO позволяет единообразно аутентифицироваться во всех инструментах под одной учетной записью. Помимо очевидного удобства, нам это также дало возможность централизованно управлять доступом и внедрить RBAC — сопоставление ролей в инструментах с группами или ролями в IdP. В качестве инструмента для реализации SSO я использовал OIDC-провайдер Keycloak, наверняка многим хорошо знакомый. Ниже я расскажу о том, как с его помощью настроить SSO для JupyterHub, MLflow и Airflow (все компоненты разворачиваются с помощью Helm-чартов).
https://habr.com/ru/companies/kts/articles/971982/
#ml #mlflow #sso #sso_аутентификация #jupyterhub #airflow #keycloak
Thiết lập homelab trong phòng trọ: Lựa chọn giữa Laptop 16GB RAM hay Xeon E5-2680v4 mạnh hơn? Cần tối ưu cho GitLab, CI/CD và MLflow (không huấn luyện mô hình). Lo ngại về ồn, nhiệt và mạng 2Mbps upload. #Homelab #DevOps #MLOps #GitLab #MLflow #Xeon #GiayTocLap #StudentTech #SelfHosted
https://www.reddit.com/r/selfhosted/comments/1p69f7f/student_homelab_in_a_dorm_laptop_vs_xeon_for/
Kaare Mikkelsen
AI Sparkup
TechLİfe
Habr
Lothar Schulz
Reddit Tech VN Bot