Understanding Spark Application concepts and Running our first PySpark application

Поділитися
Вставка
  • Опубліковано 19 лис 2024

КОМЕНТАРІ • 31

  • @ZzCoding
    @ZzCoding 17 днів тому

    Really great content to learn. I found it difficult to read the spark documentation its boring, but you've made the Spark easy to learn and interesting. Thanks much.

  • @ImranAhmed-v4t
    @ImranAhmed-v4t Рік тому +1

    Great explanation Aashay.. i started learning spark recently, since then i found only theoretical content in youtube. Now i found your playlist which teach what i was looking for. Thanks for sharing valuable knowledge.

    • @ampcode
      @ampcode  10 місяців тому

      Thank you so much! Subscribe for more content 😊

  • @patrickwheeler7107
    @patrickwheeler7107 4 місяці тому

    Thanks for putting this together. I am learning sooooo much.

  • @manjorysaran-tl7ht
    @manjorysaran-tl7ht 9 місяців тому +4

    I think you can improve this video by actually demoing the application and walking through each step. I am new and I got almost no understanding after finishing watching it once, and then I watched other videos and came back to this it made a little sense only then.. I hope I make sense..?

  • @HemanthReddy-f5e
    @HemanthReddy-f5e Рік тому +1

    Osam Job Buddy, Thanks a Lot

    • @ampcode
      @ampcode  10 місяців тому

      Thank you so much! Subscribe for more content 😊

  • @sanchitfunsegment9972
    @sanchitfunsegment9972 2 місяці тому

    Hi Brother! your last simple SQL query is showing error for me saying "No connection could be made because the target machine actively refused it". any idea why it is so?

  • @ravisri3991
    @ravisri3991 9 місяців тому

    Py4JError: An error occurred while calling o24.sql. Trace:
    py4j.Py4JException: Method sql([class java.lang.String, class [Ljava.lang.Object;]) does not exist
    I am getting the above error when running the spark.sql on top of the temporary view. Can you please tell me the resolution.

  • @just_a_viewer5
    @just_a_viewer5 Рік тому +1

    awesome video, thank you so much!

    • @ampcode
      @ampcode  10 місяців тому

      Thank you so much! Subscribe for more content 😊

  • @tathagatadey1487
    @tathagatadey1487 8 місяців тому

    How to create dataframe from a csv stored in somewhere else other than "path"? What should be the syntax? .option("path","fakefriends.csv")

  • @ganeshawarde8037
    @ganeshawarde8037 3 місяці тому

    Thank you for the content.

  • @Ks-oj6tc
    @Ks-oj6tc Рік тому +1

    Wonderfull content

    • @ampcode
      @ampcode  Рік тому

      Thank you so much!

  • @mohammadteimouri534
    @mohammadteimouri534 Рік тому

    Thanks for sharing your knowledge.

    • @ampcode
      @ampcode  10 місяців тому

      Thank you so much! Subscribe for more content 😊

  • @krishnapandey6610
    @krishnapandey6610 Рік тому +1

    Great video bro... Thank you

    • @ampcode
      @ampcode  Рік тому

      Thank you so much! 😊

  • @joseLeonardoSanchezVasquez
    @joseLeonardoSanchezVasquez Рік тому +1

    Great thanks!

    • @ampcode
      @ampcode  10 місяців тому

      Thank you so much! Subscribe for more content 😊

  • @TeluguYogi13
    @TeluguYogi13 8 місяців тому

    great effort. I believe you are technically very sound but little more improve in teaching in explaining the concepts, it is like you are reading a PPT.

  • @172_venkateshtohgaonkar5
    @172_venkateshtohgaonkar5 8 місяців тому

    its showing connection refuse error while creating the sparksession

  • @shrikantbothe8186
    @shrikantbothe8186 Рік тому +1

    On the 2nd line of code, I am getting message: ModuleNotFoundError: No module named 'pyspark'

    • @ampcode
      @ampcode  Рік тому +1

      Could you please make sure you have pyspark package installed through the anaconda command prompt and please let me know?

    • @sidindian1982
      @sidindian1982 11 місяців тому

      @@ampcode Sir iam getting Error Pls help me to resolve this
      at java.lang.ProcessImpl.(ProcessImpl.java:386)
      at java.lang.ProcessImpl.start(ProcessImpl.java:137)
      at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
      ... 18 more

    • @deeksha6514
      @deeksha6514 8 місяців тому

      in terminal run pip install pyspark

  • @ayazyusafzai9074
    @ayazyusafzai9074 5 місяців тому

    Thanks for this course. What does ts stand for in intense_ts?

  • @HemanthReddyDhadham
    @HemanthReddyDhadham Рік тому

    Can i have that CSV file please

  • @PoojaTalreja-mx7if
    @PoojaTalreja-mx7if 6 місяців тому

    data is not getting loaded into table. getting warning as -24/05/20 18:01:48 WARN DataSource: All paths were ignored: