Oozie job scheduling | Big data jobs with Oozie and Shell script

Поділитися
Вставка
  • Опубліковано 12 вер 2024

КОМЕНТАРІ • 27

  • @wandererv3557
    @wandererv3557 4 роки тому

    Your explanation flow is like a crystal clear water. 👏👏👏👍👍👍

  • @gurumoorthysivakolunthu9878

    Great explanation... Thank you...
    ...
    1 question :- how to schedule spark submit command with executor memory, executor core configurations...
    Thanks a lot for your effort in simplifying the topics...

  • @praneethbhat6361
    @praneethbhat6361 2 роки тому

    Thank you for the video. Nice explanation bro. Understood very well.

  • @mayankchouhan8977
    @mayankchouhan8977 4 роки тому +1

    Hi Arpit, Very nice explanation + demonstration.
    I have one question -
    I am trying to spark-submit a python script. To do it using Ozzie, i need to move the python script to HDFS, and to run it thru CRON, i need to run the script from some path in edge node?
    Also, what is the approach followed in real world industry projects? How is it implemented and maintained(Is it using GIT)?

  • @murthysagi5499
    @murthysagi5499 4 роки тому +1

    Nice explanations bro 👍👍👏👏

  • @abhishekjain3381
    @abhishekjain3381 5 років тому +1

    Thanks for the Video, this was crisp and easy to understand. However, in starting of session you mentioned to explain about interdependent jobs (various big data tasks like sqoop,hive,java,spark, etc.). Please share the link, if you already did that video. Thanks in advance!

    • @sachindubey4315
      @sachindubey4315 Рік тому

      yes really it is , i have searched and watch many video never found like this

  • @MechIT-KAH
    @MechIT-KAH 2 роки тому

    Awesome explaination yar, wonderful,
    Please give me the links of other videos of Oozie
    Thanks in advance

  • @hiteshgangwani9137
    @hiteshgangwani9137 Рік тому

    thanx alot bro very well explained on point.

  • @RAVIC3200
    @RAVIC3200 4 роки тому +3

    How to schedule Program in Oozie for integrated jar like - spark/hive/hbase ? do i need to select spark or any other way?

  • @datoalavista581
    @datoalavista581 3 роки тому

    Thank you for sharing !

  • @rktanakala8158
    @rktanakala8158 5 років тому

    Thanks for the video....Good explanation

  • @ririraman7
    @ririraman7 2 роки тому

    brilliant

  • @anilp1357
    @anilp1357 5 років тому

    Best explanation

  • @SpiritOfIndiaaa
    @SpiritOfIndiaaa 5 років тому

    Thank you bro ...any vid about airflow?

  • @mallinathbirajdar6610
    @mallinathbirajdar6610 4 місяці тому

    हे सर्व फुलपाखरांचे फोटो आणि व्हिडिओ कुठे घेतले आहेत.?
    म्हणजे गावाकडे की पुण्यामध्ये.?
    आणि पुण्यात घेतले असतील तर नेमका location काय आहे.?

  • @chrajeshdagur
    @chrajeshdagur 2 роки тому

    It is a helpful video but, you did not show the manual approach to configuring workflow.xml and job.properties files.

  • @wandererv3557
    @wandererv3557 4 роки тому

    Can you make a video about custom oozie job.?

  • @muhammadfayyaz7134
    @muhammadfayyaz7134 5 років тому +2

    latest interview questions that might help you make more videos.
    Difference between data frame and datasets
    **********
    We have a group of people arranged in males and females in equal numbers we have arrange them in alternative way like ...
    They are in random present in dataset but we have to arrange them in alternative way....
    ******
    How can we arrange ....!!!
    Suppose you have two files..... file a and file b
    We need to perform multiple query's on two files
    How to merge them and perform query's on that ?
    Again if I perform multiple query's on both files
    How do you save the output of each query's in separate file ???
    *******
    There is one aggregate query you need to implement in spark
    Tell me best approach way to do ...!!
    Suppose I have launched a product I want to know sales for region wise ... How do you perform the aggregate function in best way
    This query has lot of function that still prove in bulit fuctions are best way do ....?
    All over India
    ****†*****
    How did we un cache the data ?

    • @GKCodelabs
      @GKCodelabs  5 років тому +1

      Thanks for Sharing them Fayyaz ☺️

  • @DreamyTwinkle
    @DreamyTwinkle 2 роки тому

    I want to learn oozie can you take classes and you have more video

  • @vaishnavidwaragan7763
    @vaishnavidwaragan7763 3 роки тому

    How to do bulk data loading by using shell script in hive..Please help