Copy data from ADLS to Azure SQL using Azure Data Factory

Поділитися
Вставка
  • Опубліковано 22 лип 2022
  • .
    00:00:01 Brief description about the project
    00:02:49 Deploy resource group
    00:06:18 Deploy Azure Storage Account
    00:12:11 Deploy Azure Data Factory
    00:18:13 Deploy Azure SQL Database
    00:26:17 Create Blob Container
    00:29:24 Create Linked Services in Azure Data Factory
    00:39:39 Create DataSet in Azure Data Factory
    00:45:19 Create Data Flow Job in Azure Data Factory
    00:59:25 Develop and Rune Pipeline Job in Azure Data Factory
    01:07:36 Create Trigger to automatically run the pipeline
    This video will help you understand the following components using a simple project.
    Azure Data Lake Storage
    Azure Data Factory
    Azure SQL
    Please check my Udemy course www.udemy.com/course/azure-da...
    Please fee free to reach out hadoopengineering@gmail.com if you have any queries.
  • Наука та технологія

КОМЕНТАРІ • 8

  • @dollypee_
    @dollypee_ 6 місяців тому

    Hi!
    I am a newbie in the data engineering world, and your video has been super helpful.
    Please can you provide the link to your dataset.
    Thanks.

  • @moverecursus1337
    @moverecursus1337 8 місяців тому +1

    Azure SQL can be substituted by the Azure SQL DATABASE for Postgres?

  • @malliarjun5250
    @malliarjun5250 Рік тому +1

    Sir u can plan" Hadoop admin training "
    & Linux Schell script online training
    With the vast knowledge u have
    Many people will be benefit from you

  • @TheDataArchitect
    @TheDataArchitect Місяць тому

    I did all the same, but getting below error, when i test the connection its working fine, but when i run the pipeline it immidiately terminates with the below error:
    Input Payload is invalid, validation result - '["Connector or activity name: ADLS_GEN2_LINKEDSERVICE, connector or activity type: AzureBlobFS, error: Calling partner RP EvaluatePolicyAsync returned an invalid status code 'Conflict', ReasonPhrase Conflict","Connector or activity name: AzureSqlDatabaseScalez, connector or activity type: AzureSqlDatabase, error: Calling partner RP EvaluatePolicyAsync returned an invalid status code 'Conflict', ReasonPhrase Conflict"]'

  • @akashrathod9701
    @akashrathod9701 Рік тому +1

    Hello sir,
    Can you suggest general issue facing in your cluster as Hadoop Admin 🙏🏻
    Please reply 😇

  • @prashanth-cz4xj
    @prashanth-cz4xj Рік тому

    how to transfer data from adls to sql server? can u do video on that it will helpful to us

  • @malliarjun5250
    @malliarjun5250 Рік тому

    Sir r u giving any online trainings if any are there please provide your details

    • @HadoopEngineering
      @HadoopEngineering  Рік тому

      You can check my course in Udemy www.udemy.com/course/azure-data-engineer-real-world-projects/?referralCode=D5569983A4ED7E87CB62 . I have uploaded similar projects in that course.