DP-203: 33 - Connecting to ADLSg2 from Azure Databricks

Поділитися
Вставка
  • Опубліковано 2 лис 2024

КОМЕНТАРІ •

  • @Ef-sy4qp
    @Ef-sy4qp 6 місяців тому +5

    OMG! Now I connect Azure databricks with ADLS in various ways. You are a real teacher. If you open the membership, I think I will be number one to join.
    Thanks

  • @amazhobner
    @amazhobner 6 місяців тому +2

    Excellent video. Just what I was looking for!! I have referred a lot of videos for this but none had this much clarity and ease of understanding!!

  • @heljava
    @heljava 5 місяців тому +1

    Thank you very much. It is really good to know all these methods. Just 2 months ago, I was in need of these access methods to connect ADLS Gen2 and ADB.
    The way you explain is very simple and straight to the point.

  • @bulaciox
    @bulaciox 5 місяців тому

    Tybul, it doesn't make sense how well you explain things. Thank you very much for your videos!!

    • @TybulOnAzure
      @TybulOnAzure  5 місяців тому +1

      Thanks! I just remember what confused me when I was learning about it and I'm trying to make it easier for you.

  • @michaelbyron1426
    @michaelbyron1426 6 місяців тому

    Thank you Piotr with your help I passed my exam last week! Couldn't have done it without you

    • @TybulOnAzure
      @TybulOnAzure  6 місяців тому

      Awesome Michael! Congratulations!

  • @prabhuraghupathi9131
    @prabhuraghupathi9131 6 місяців тому +1

    Thanks Piotr for this video on connecting ADLS from Databricks!! Great content to learn !!

  • @victorchu123
    @victorchu123 6 місяців тому

    Great content as always! (Love the meow at the end😂)

    • @TybulOnAzure
      @TybulOnAzure  6 місяців тому

      Yup, according to my cat it was the high time to end the episode and play with it.

  • @amataratsu006-xs6hv
    @amataratsu006-xs6hv 21 день тому

    Your assistent at the end 😂😼

  • @diegoalias2935
    @diegoalias2935 6 місяців тому

    Tybul thanks a lot for the videos! One quick question.. Basically, for creating the scope you must be a AKV owner user (or similar). Isn't it?

  • @qaz56q
    @qaz56q 5 місяців тому +1

    Can you cover how it works with Unity Catalog?

    • @TybulOnAzure
      @TybulOnAzure  5 місяців тому +1

      Yes, after core DP-203 part.

    • @qaz56q
      @qaz56q 5 місяців тому

      @@TybulOnAzure Great, this will be an interesting topic!

  • @kavyaReddyPonnapati
    @kavyaReddyPonnapati 6 місяців тому

    Thank you so much for the video.
    I tried connecting to storage account using service principal, i did everything created the service principal, assigned storage blob contributor role and created secret scope in databricks. And when I tried to list the files in the storage account, I am getting an error saying - this request is not authorised to perform this operation 403. Any idea why is this happening ?
    Thanks in advance

    • @TybulOnAzure
      @TybulOnAzure  6 місяців тому

      I would start troubleshooting in the following way:
      1. Can you connect if you hardcode service principal secret? If yes, then the issue is related to the secret scope.
      2. If not, then check it using hardcoded storage account key. If it works, then the issue is related to permissions granted to the service principal. If it doesn't then the issue might be on the networking side.
      Or simply the permissions were not propagated yet and you might need to wait few minutes.
      Please try those things and let me know the outcome.

    • @kavyaReddyPonnapati
      @kavyaReddyPonnapati 6 місяців тому

      I’m getting the same issue while hardcoding the account key as well.

    • @TybulOnAzure
      @TybulOnAzure  6 місяців тому

      Can you paste the command you use to list the contents of your container?

    • @kavyaReddyPonnapati
      @kavyaReddyPonnapati 6 місяців тому

      @@TybulOnAzure dbutils.fs.ls("abfss://init@apsaaclprod.dfs.core.windows.net")

    • @kavyaReddyPonnapati
      @kavyaReddyPonnapati 6 місяців тому

      @@TybulOnAzure also why is it taking so much time to start the cluster ? is there any way to speed up that ?

  • @chillvibe4745
    @chillvibe4745 6 місяців тому

    Hi Piotr :)
    Is git or github knowledge needed for the exam?

    • @TybulOnAzure
      @TybulOnAzure  6 місяців тому

      I don't think so. But definitely you'll need it for your daily work.

    • @chillvibe4745
      @chillvibe4745 6 місяців тому

      @@TybulOnAzure Thanks. Any tips on how I should get familiar with it? I want to know at least the basics and I wonder if UA-cam is going to be enough.

    • @TybulOnAzure
      @TybulOnAzure  6 місяців тому

      @chillvibe4745 try this page for learning git in a visual way: learngitbranching.js.org. It is not specific to Azure, just good old pure knowledge.