I did bash into docker007-airflow-scheduler-1, docker007-airflow-triggerer-1, docker007-airflow-webserver-1, docker007-airflow-worker-1 and in each of the containers I see /opt/airflow/output directory where docker-compose ps output is NAME COMMAND SERVICE STATUS PORTSĭocker007-airflow-init-1 "/bin/bash -c 'funct…" airflow-init exited (0)ĭocker007-airflow-scheduler-1 "/usr/bin/dumb-init …" airflow-scheduler running (healthy) 8080/tcpĭocker007-airflow-triggerer-1 "/usr/bin/dumb-init …" airflow-triggerer running (healthy) 8080/tcpĭocker007-airflow-webserver-1 "/usr/bin/dumb-init …" airflow-webserver running (healthy) 0.0.0.0:8080->8080/tcpĭocker007-airflow-worker-1 "/usr/bin/dumb-init …" airflow-worker running (healthy) 8080/tcpĭocker007-docker-proxy-1 "socat TCP4-LISTEN:2…" docker-proxy running 0.0.0.0:2376->2375/tcpĭocker007-postgres-1 "docker-entrypoint.s…" postgres running (healthy) 5432/tcpĭocker007-redis-1 "docker-entrypoint.s…" redis running (healthy) 6379/tcp When I change the mounts line from type='volume' to type='bind': mounts=[īad Request ("invalid mount config for type "bind": bind source path Includes invalid characters for a local volume name, only In the DAG code, I am trying to pass the mounts parameters as following: eod_price = DockerOperator(Ĭommand='/bin/touch /output/run_docker_touch.txt',īad Request ("create /opt/airflow/output: "/opt/airflow/output" My airflow-docker-compose.yaml (in section airflow-common) looks as follows volumes:
I am trying to pass a local directory as a volume to airflow, which in turn is being passed to a dag DockerOperator
0 kommentar(er)
