Unleash Data Pipeline Power: Effortless Python Package Installation in Airflow with Docker

Поділитися
Вставка
  • Опубліковано 9 лис 2024

КОМЕНТАРІ • 11

  • @alongsandusit8303
    @alongsandusit8303 7 місяців тому

    good tutorial bro

  • @JourneyDi
    @JourneyDi Рік тому +1

    thank you, it helps me fix my error

    • @sumitkumar2955
      @sumitkumar2955  Рік тому

      Thanks for watching. I am happy to see that it helped you 😊
      Please share and subscribe 🙏

  • @arafatabsi6546
    @arafatabsi6546 Місяць тому

    hi
    the command
    docker-compose up -d --no-deps --build airflow-webserver airflow-scheduler
    is changing the containers (you can notice from the containers IDs) means when i want to add a requirement all my data in the containers will be lost!
    what is the solution!

  • @AMITDAS-mr8xj
    @AMITDAS-mr8xj 5 місяців тому

    Hi Sumit bro, i have applied this approach to get the dbt packages installed but still im getting module not found error. Although the installation went smooth. Need help

  • @praveena1752
    @praveena1752 7 місяців тому

    Hi, I am trying to install langchain py package with the dockerfile, import is unsuccessful due to python version. How to change python version to 3.10 with same airflow version

    • @sumitkumar2955
      @sumitkumar2955  7 місяців тому

      You have mention python version in your dockerfile

  • @bellapilar3237
    @bellapilar3237 8 місяців тому

    hi, i follow it step by step but i can not start ok de airflow when i try to use dependencies , my container is unhealthy, i do not why

    • @sumitkumar2955
      @sumitkumar2955  8 місяців тому

      Please check docker desktop installation.
      Please let me know the error message