asolThe best #Airflow setup I've managed to achieve using #Dockerfile and Docker Compose.
The Dockerfile setup is quite straightforward. You can either pull a prebuilt container directly from the Airflow repository, or use it as a foundation to create your own customized container.
FROM apache/airflow:2.9.1-python3.10
USER root
RUN apt-get update \
&& apt-get install -y --no-install-recommends \
vim \
&& apt-get autoremove -yqq --purge \
&& apt-get clean \
&& rm -rf /var/lib/apt/lists/*
USER airflow
COPY requirements.txt requirements.txt
RUN uv pip install --no-cache-dir -r requirements.txt
USER root
RUN apt-get update \
&& apt-get install -y --no-install-recommends \
vim \
&& apt-get autoremove -yqq --purge \
&& apt-get clean \
&& rm -rf /var/lib/apt/lists/*
USER airflow
COPY requirements.txt requirements.txt
RUN uv pip install --no-cache-dir -r requirements.txt
|~hamu_sandowicz~|@asol I've not looked at airflow, any idea how it compares to Domino as a platform?
@ham_sando Never heard of Domino. Airflow provides scheduling and triggering, plus a good webui and rich plugin ecosystem.
@asol sounds neat, this is what I was referring to btw: https://domino.ai/ there are versions available in azure/aws marketplace.
@ham_sando paid solution, tries to do too much.
@asol I think it has some important features for regulated industries, but each to their own.