Getting Started with AWS Glue ETL

Поділитися
Вставка
  • Опубліковано 25 січ 2025

КОМЕНТАРІ • 37

  • @FAKETV96
    @FAKETV96 2 роки тому

    I do not see a link to the video you mentioned at 1:30 that you said would be in the description section of this video

  • @priyankapriyanka547
    @priyankapriyanka547 3 роки тому +2

    you explained the concept very clearly. Keep making more videos to make us understand more things.

  • @greyreynyn
    @greyreynyn 4 роки тому +13

    there's no link to other videos in the description

  • @sarmistha66
    @sarmistha66 5 років тому +8

    Mam please make other videos also, your way of explaining things are so interesting, as a experienced professional I feel connected when I here your explanation than other videos.

    • @jamiethedba
      @jamiethedba 5 років тому +3

      Mam? ... really?

    • @andyd568
      @andyd568 5 років тому +5

      @@jamiethedba it's a common designation of respect per Indian culture, especially towards people who teach. It seems out of place elsewhere.

  • @vishwanathsinha
    @vishwanathsinha 5 років тому +2

    Very clear explanation of AWS Glue, thanks!

  • @JacSteiner
    @JacSteiner 2 роки тому

    Referenced previous video:
    Getting Started with AWS Glue Data Catalog
    ua-cam.com/video/qNojanBn1NY/v-deo.html

  • @butterflymantis
    @butterflymantis 4 роки тому

    It seems glue job automatically create a default filename which is not so user friendly when you query it using athena. Any thoughts, or if i just missing something?

  • @shantanu83in
    @shantanu83in 6 років тому

    Hi I have applied the below Filter Transform code but nothing happens when I Generate the Diagram:
    ## @type: FilterMatch
    ## @args: [f = lambda x: x["Match"] !in ["Total", "On average(90 mins)"], transformation_ctx = "filterMatch"]
    ## @return: filterMatch
    ## @inputs: [frame = applymapping1]
    filterMatch = Filter.apply(frame = applymapping1, f = lambda x: x["Match"] !in ["Total", "On average(90 mins)"], transformation_ctx = "filterMatch")
    Could you please provide sme guidance?

  • @ashleylemos3977
    @ashleylemos3977 3 роки тому

    whats the folder _common_metadata_ in target s3 location?

  • @peteiscurious
    @peteiscurious 5 років тому

    HI, Jane. is there a place in the database or within the AWS which I can view only the table properties/data catalog aside from viewing it inside the AWS glue console?

  • @rvasconcelossilva
    @rvasconcelossilva 4 роки тому

    Hey guys, have any of you used AWS Glue ETL Library? I'm trying to installing it to my laptop, but I'm not getting it.

  • @aneekaatrocities2489
    @aneekaatrocities2489 5 років тому

    May I know why there are many files in S3. Basically I am trying to give this S3 path to Quicksight as the datasource to visualise. In that case , I would expect only one file or may be few files but not this huge number. Why is it basically uploading so many files?

    • @kumareshview
      @kumareshview 4 роки тому

      Helo ma'am, I'm from SSIS-etl background, I need to learn AWs related, pls tel me what are related to my technology.

  • @tebohobonganimasemola6549
    @tebohobonganimasemola6549 2 роки тому

    Very clear - Thank you

  • @theerakornprasutchai6578
    @theerakornprasutchai6578 5 років тому

    Very useful. Appreciated your video

  • @udaybhaskarchodagiri475
    @udaybhaskarchodagiri475 6 років тому

    Thanks Jane. Crystal clear explanation.

  • @nepatriots11
    @nepatriots11 5 років тому

    Can Glue run against UNSTRUCTURED data in S3? .. Can it run against ON-PREMISE datasource?

  • @vickymishra3520
    @vickymishra3520 3 роки тому

    hiii i need help in aws glue job can you plz help me

  • @udaybhaskarchodagiri475
    @udaybhaskarchodagiri475 6 років тому

    Hi Jane, if you provide a video to load the data from Aroura to Redshift will be more help ful for me.

  • @kumareshview
    @kumareshview 4 роки тому

    Awesome video, clear explanation..

  • @TheLeviathanDeath
    @TheLeviathanDeath 5 років тому

    So AWS Glue is hand-coding?

  • @varunsood8509
    @varunsood8509 6 років тому +1

    How to do incremental loading while reading the data from database? Is there a way to create a filter on date while reading from source database? Please let me know. Thank you!

  • @ygrillo
    @ygrillo 3 роки тому

    You just didnt show the most important part: the json you are working with.

  • @arunmanglick
    @arunmanglick 3 роки тому

    Awesome Details!

  • @gowthaman1992
    @gowthaman1992 6 років тому

    Team, Was this video pictured on June 2017 ? Omg!!!

  • @navinsai5726
    @navinsai5726 6 років тому +17

    This would have been more beneficial if you have explained more complex transformation example. What is the use of just converting from csv format to parquet format? Do we need an ETL tool for that? By giving this example, you are diluting the concept of ETL and capability of Glue itself. Grow up AWS Techies.

  • @ShivamAroraa
    @ShivamAroraa 6 років тому +2

    f