Master Apache Airflow: 5 Real-World Projects to Get You Started

Поділитися
Вставка
  • Опубліковано 29 лис 2024

КОМЕНТАРІ • 103

  • @klgulen650
    @klgulen650 Місяць тому +1

    I wanna say thank from the buttoom of my heart ، i had 0 exprience because of you and your content I Landed an apprenticeship in big company in France, on big project of migration talend to airflow , I worked on very complexe pipelines in diffrent environnement (Gcp,sap , salesforce , oracle ...)and because of that exprience I Landed a job in with big Airline company, I learned more (streaming , powerbi , ci cd ... )

  • @DarshilParmar
    @DarshilParmar  3 місяці тому +14

    Suggest topic for Part 2 of FREE Fundamentlas of Data Engineering Course, also don't forget to LIKEEEE

    • @aseempasha2373
      @aseempasha2373 3 місяці тому

      Challanges that we can explain in each techstack (spark kafka cloud airflow)

    • @srh1034
      @srh1034 3 місяці тому

      Once upon a time your channel was a good source for learning. Now it has become a platform to just advertise your premium courses!!! If that is so, there might not be a case to follow you and subscribe!

    • @nobodyinparticula100
      @nobodyinparticula100 3 місяці тому

      Iceberg. Hearing a lot about open table format.
      That or pipeline testing/data verification and quality checks.
      Love your content.

    • @VarunSharma-jb2fr
      @VarunSharma-jb2fr 3 місяці тому

      @@DarshilParmar The aspects of being a DE other than tech. The soft skills, understanding the business, building a rapport with stakeholders, etc. Would appreciate real life examples from your journey. There are tons of DE Roadmaps that talk about tech. If you can give some genuine advice on how to navigate and enhance non tech skills especially in DE domain, that would be awesome. Should one focus on getting aligned with one industry like finance or utilities or it's fine to jump domains given one has competent tech skills - from long term perspective in industry Thanks.

    • @pratikgohil4848
      @pratikgohil4848 3 місяці тому

      ​@@srh1034This channel also has a free roadmap to become DE, but we have to do a lot of hard work to connect all the dots. If we buy his course we get everything at one place no need to do so much research on what to study and what not to. All the courses he has are pretty affordable, with good clarity. I think we should appreciate him for providing and supporting his hardwork in creating such courses.❤

  • @Duke-m4v
    @Duke-m4v Місяць тому +1

    I am starting new in IT, so what do you recommend should I go for data engineer or software development? Please shed some light on salary and scope as well. I really appreciate your guidance.

  • @praveenbhandari2516
    @praveenbhandari2516 Місяць тому

    Hey darshil I have a question. I’m a bit confused right now. I got a job in the data domain as a Data Analyst, and I want to upskill myself. Nowadays, Generative AI is booming, and my mind is getting diverted in that direction since I’m curious about it. However, I also love data engineering. Could you please advise me on which career path I should follow: Data Engineer or Generative AI Engineer? Also, please let me know about the future scope, salary, and which offers better job prospects

  • @detectivepk8917
    @detectivepk8917 3 місяці тому +1

    Hi Darshil and I'm eager to learn. Could you let me know how long it will take to release the other courses, specifically the end-to-end ones?

    • @DarshilParmar
      @DarshilParmar  3 місяці тому

      Kafka will be available next month

  • @AadarshBaskar-x4v
    @AadarshBaskar-x4v 3 місяці тому +1

    Pls post a video on data mesh

  • @amankhandelwal8293
    @amankhandelwal8293 3 місяці тому

    Hi Darshil, I want to purchase airflow and snowflake only, any coupon for these seperately?

  • @sairam2731
    @sairam2731 2 місяці тому

    Hi Darshil , tell me the duration of the each course

  • @sayanmanik8823
    @sayanmanik8823 3 місяці тому +1

    Hi Darshil
    How can I join the discord server??

  • @FA-tz9wk
    @FA-tz9wk 2 місяці тому

    Hi Darshil, I would like to know your opinion on the IBM Data Engineering certificate on Coursera. Its seems to cover the important tools used in DE like Hadoop, Kafka, Spark. Would completing this certification help me get a job?(I am coming from a marketing background of over 20 years.)

  • @gnavarrolema
    @gnavarrolema 3 місяці тому

    Hi. Are you planning to release courses related to cloud computing? Are they going to be part of the combo pack?

  • @pratikgohil4848
    @pratikgohil4848 3 місяці тому

    Hey Darshil, Thank you for providing such a good clarity about data engineer. I am from non tech background want to transition into DE, so which course I should buy from your site. I want to learn everything from scratch.

  • @dhananjayapattnaik7428
    @dhananjayapattnaik7428 Місяць тому

    EMI option is available for payment

  • @AlphaK-n1q
    @AlphaK-n1q 3 місяці тому +1

    Hello Darshil, Thanks for making video on Airflow, I am intrested in Full course of Apache Airflow course with End to end advance project using GCP Composer. Could you please give me link with coupon code ??

    • @DarshilParmar
      @DarshilParmar  3 місяці тому

      Link is in the description with coupon code

  • @cesarlara3974
    @cesarlara3974 3 місяці тому

    If we get the zero to hero combo pack, will we get access to the other courses that you are currently working on once they are available?

    • @DarshilParmar
      @DarshilParmar  3 місяці тому +1

      No, this combo pack is only for 5 courses that are mentioned

  • @whierthy2608
    @whierthy2608 3 місяці тому

    Hey Darshil, Planning to buy the spark course from your site wanted to know if there is any probability of updating the course, if yes then will it reflect in my current purchased course it will be a brand new one
    Thanks

  • @VarunSharma-jb2fr
    @VarunSharma-jb2fr 3 місяці тому

    Is the access to structured notes limited to 5 course combo?? Or it's included with Airflow course too?

  • @sayanmanik8823
    @sayanmanik8823 3 місяці тому

    Hi Darshil
    For cloud related resources in gcp, AWS, will we get free subscription if we buy this course??

  • @pranavtambre7632
    @pranavtambre7632 3 місяці тому

    I don't have aws, azure or google cloud subscription. Will the course still be helpful while doing the projects ?

  • @dineshkumar-kc7vt
    @dineshkumar-kc7vt 3 місяці тому +1

    Its very useful but don't you think its over priced

    • @DarshilParmar
      @DarshilParmar  3 місяці тому

      No, you get everything hands-on + theory + 5 projects in just one course
      more than that you pay of structured learning

  • @deepakdoddera1
    @deepakdoddera1 3 місяці тому

    I am unable to see the link for the discord community and also link for the notes. How do I access it?

  • @parwezattar4228
    @parwezattar4228 3 місяці тому

    Can you please make video on DBT

  • @deaspirant
    @deaspirant 3 місяці тому

    Hi Darshil, like Apache airflow is there any course available for Apache Beam it is also mandatory for these days right ? correct me if am wrong ?

    • @DarshilParmar
      @DarshilParmar  3 місяці тому

      That will help covered in GCP course with dataflow

    • @adharshsunny5154
      @adharshsunny5154 3 місяці тому

      @@DarshilParmardid you have any course on GCP data engineering

    • @Beginner-g4v
      @Beginner-g4v 3 місяці тому

      do you have any course on GCP data engineering?

  • @ezequielsaldana8279
    @ezequielsaldana8279 Місяць тому

    Have course the subtitles in spanish?

  • @vinayakjaiswal9976
    @vinayakjaiswal9976 3 місяці тому

    hey darshil , installing airflow or similar software on linux machine specially other than debian are painsome, are there any ways through which we can use airflow directly on the web? and if yes what % of performance issue will we see?

    • @DarshilParmar
      @DarshilParmar  3 місяці тому

      We use docker in course, it's platform independent

  • @hameedaj-c2w
    @hameedaj-c2w 2 місяці тому

    Hi Darshil, I have joined the Apache Airflow Course, I am not finding where to join the discord community.. I checked all course resources and could not find the discord community link to join. Can you please help out?

  • @ramadhanpermadi1442
    @ramadhanpermadi1442 2 місяці тому

    I hope you can put this course in udemy

  • @nihitverma5784
    @nihitverma5784 3 місяці тому +1

    how much time it will take to prepare apache kafka course ?

    • @DarshilParmar
      @DarshilParmar  3 місяці тому

      I am working on it right now, might take one more month

  • @tedduharish7474
    @tedduharish7474 3 місяці тому

    bro do you use chat gpt for help , ??????

    • @DarshilParmar
      @DarshilParmar  3 місяці тому +1

      of course, I use ChatGPT, Google, Stackoverflow, Claude everything for help
      Don't think you have to remember everything, as an engineer you should know where to look and solve problems

  • @Badkurdar
    @Badkurdar 3 місяці тому

    Only video are there or will be getting project files ?

    • @DarshilParmar
      @DarshilParmar  3 місяці тому +1

      You'll get everything from videos to project files

    • @Badkurdar
      @Badkurdar 3 місяці тому +1

      @@DarshilParmar Thanks, Taken combo. waiting for kafaka as well. Thank you.

    • @nihitverma5784
      @nihitverma5784 3 місяці тому +1

      heyy, i am just a student doing ITI , you already purchaed the course can i also share it with your id if you agree ?

    • @Badkurdar
      @Badkurdar 3 місяці тому +1

      @@DarshilParmar how to see notes please ?

    • @nihitverma5784
      @nihitverma5784 3 місяці тому

      @@Badkurdar hi bro , can you share your email id please

  • @TarabShaikh-ij2dt
    @TarabShaikh-ij2dt 3 місяці тому

    Is Airflow written in Python?

  • @Hooow410
    @Hooow410 3 місяці тому

    sir one confusion has occurred whether DE field accept freshers? I have already discussed with someone in this field and he said that For fresher it really difficult to be hire as DE, eventually i also find in you tube that all person who have entered in DE field they all have some experienced in other field, please clarify and also one things that those combo courses are for fresher or experienced guy?
    N.B- I am pursuing Btech(IT) and currently in 3rd year and also very much interested to make a career in DE field

    • @DarshilParmar
      @DarshilParmar  3 місяці тому

      For fresher it is difficult but you can start with internship or entry level role, there are few but possible
      My courses will help you to get started, it will make you freshers to experienced person, you will get 14 projects, in-depth content and many more

    • @Hooow410
      @Hooow410 3 місяці тому

      @@DarshilParmar so it's means that after completing aforesaid courses i will manage to get some entry level job on the bases of completing those projects

    • @DarshilParmar
      @DarshilParmar  3 місяці тому

      @@Hooow410 I don't promise jobs but I guarantee you will become data engineer and have all skills you need as DE

    • @Hooow410
      @Hooow410 3 місяці тому

      @@DarshilParmar okey thanks a lot for sharing your valuable thoughts.

  • @ThiagoSilvaOfficial
    @ThiagoSilvaOfficial 3 місяці тому +1

    Could you put the course on udemy too, please?

    • @DarshilParmar
      @DarshilParmar  3 місяці тому +1

      No, udemy take 70-80% fees, you get lifetime access to course just like udemy so what's the difference?

    • @nvasudeva
      @nvasudeva 3 місяці тому +1

      @@DarshilParmar Price is the difference !
      I understand that quality doesn't come cheap but at the same the course could have been made a bit more affordable and for sure it's expensive even after applying coupon code.

    • @saadmultani7251
      @saadmultani7251 3 місяці тому

      ​@@nvasudevawhat is the price?

  • @pvsanathkumar8465
    @pvsanathkumar8465 3 місяці тому

    Sir can u suggest any free cource to learn these hard way because i cannot afford cource right now, after starting work i can do that. But for now can u suggest anything

    • @DarshilParmar
      @DarshilParmar  3 місяці тому

      I have projects available on my channel and also you can just find tutorials on UA-cam too

  • @Vian_venkat
    @Vian_venkat Місяць тому

    Hi Darshil! Your website is not working since 2 days. I have bought Python + SQL course.

    • @DarshilParmar
      @DarshilParmar  Місяць тому

      Can you mail on info@datavidhya.com I will get it checked

  • @amanarya289
    @amanarya289 3 місяці тому

    Just brought your course, where can I found the link to discord server? Also, I don't see anything in the resources section, can you please help me with accessing the notes and other links.

    • @DarshilParmar
      @DarshilParmar  3 місяці тому

      Please email on info@datavidhya.com I will share you there

    • @amanarya289
      @amanarya289 3 місяці тому

      @@DarshilParmar done, thanks !

    • @mahiticircle
      @mahiticircle 3 місяці тому

      Hi Aman, can you share your experience, is it worth to buy combo course

  • @Badkurdar
    @Badkurdar 3 місяці тому

    Is this covered in your combo
    Combo Package Python + SQL + Data warehouse (Snowflake) + Apache Spark + Apache Airflow ?

  • @merajmohammed9180
    @merajmohammed9180 3 місяці тому

    Bro I think I am ur first viewer I just want to ask that how to learn data like what are the parts of it which come under

    • @DarshilParmar
      @DarshilParmar  3 місяці тому

      I don't understand your questions, can you elaborate

    • @merajmohammed9180
      @merajmohammed9180 3 місяці тому

      @@DarshilParmar yeah sure I am sorry if I was not able to explain properly so I have started this journey a week ago… and I plan to study python,sql and Linux in the coming 5 months but I am confused and unable to plan how to go with Things that helps to manage, manipulate,transform,store,…. The data so for example I should study about tools like airflow or technologies like Apache Kafka can use pls explain in few lines the pathway of this tools and technology and which I should learn first and move next to which one …….hope this explains feels great to connect with a data engineer like u…..thanks

  • @정태민-g7l
    @정태민-g7l 3 місяці тому

    hello. I live in another country and was interested in this course, so I tried to pay with my Visa card, but the payment keeps failing. What should I do?

    • @DarshilParmar
      @DarshilParmar  3 місяці тому

      Please email me on info@datavidhya.com

    • @정태민-g7l
      @정태민-g7l 3 місяці тому

      @@DarshilParmar i sent mail

  • @BenthamSheila-c8o
    @BenthamSheila-c8o 2 місяці тому

    Davis Patricia Jackson Joseph Garcia Joseph

  • @dhananjayapattnaik7428
    @dhananjayapattnaik7428 Місяць тому

    Is there any WhatsApp channel .?? So that i can reach out and clarify all doubt to your customer care executive..

    • @DarshilParmar
      @DarshilParmar  Місяць тому

      Just mail here info@datavidhya.com

    • @dhananjayapattnaik7428
      @dhananjayapattnaik7428 Місяць тому

      @@DarshilParmar In data engineer combo package there is no cloud technology.how can some one will do project directly.. before doing project fundamental need to be clear right

    • @DarshilParmar
      @DarshilParmar  Місяць тому

      @@dhananjayapattnaik7428 You will learn everything in the course only.
      That's the best part, you don't need cloud course, you will learn cloud while doing other things

    • @dhananjayapattnaik7428
      @dhananjayapattnaik7428 Місяць тому

      @@DarshilParmar if possible please add cloud technology..

    • @DarshilParmar
      @DarshilParmar  Місяць тому

      @@dhananjayapattnaik7428 We have cloud technology, you will learn them in course only

  • @arjunmajumdar7288
    @arjunmajumdar7288 3 місяці тому +7

    Too expensive

    • @DarshilParmar
      @DarshilParmar  3 місяці тому

      I understand
      There are amazing free resources available on my channel and youtube too
      It takes lot of effort to create this course with multiple projects, in-depth content and notes so price is for that only

    • @nihitverma5784
      @nihitverma5784 3 місяці тому

      give me your mail id

  • @MohammedAmmar-e5e
    @MohammedAmmar-e5e 2 місяці тому

    Hey @DarshilParmar do You have any WhatsApp channel for Data Engineering??