Відео

What is sequence number of these videos in Playlist?

Hi, I need training in ETL Testing with Azure platform (Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Azure SQL). If you provide training on the same, please share your contact details.

How do we search multiple items in single search? Example: Assign to field, how to check for items in which multiple people are assigned by using the list of names

Great series, when can we expect new video? How many episodes do you plan ?

Fantastic video. May I know the cluster type/creation steps which you are using to run the DLT notebook interactively? Also can you order/index these 8 videos in sequence, which is first to watch, second to last? Thanks

Thank you for making this. qq on DLT, is there a way I can control reading only from xth year and month from the s3bucket having tonnes of history partitioned by year and month? I know we can apply the filter condition on the dataframe, however, I do not want dlt to scan the entire history and filter and stream from the point I'm interested in. Appreciate your time in responding to it.

Give a shot at DLT-Meta.

For incremental files we use auto loader , Do we need to use auto loader if we use DLT. Since DLT have flows

One suggestion: vidoes are not sequenced properly.

Can we use the wildcard path for data loading In my scenario I have folders like Inc/table_12072024/data.parquet Inc/table_13072024/data.parquet Everyday new folders getting created inside inc folders and inside that data folder is getting updated So any suggestions how to handle this type of scenario incrementally in dlt tables

I think .. storing schema in table is not good sense.. we should pass dynamically schema location which managed by Autoloader😊.. think about 100 application and 10k tables😂

sir catalog by default is created to which storage... by default storage of databricks or the storage as you created with the databases connector you showed in second video of catalog??

sir does the unity catlog works on any cluster?? means you said... first you told metastore is connected to adls. then what is the work of this unity catlog cluster, and if we terminate it... does all the data of the unity catlog will be deleted??

you are saying, if you are having metastore in some different region and workspace in some other region we cannot connect both.... then you are saying we can have multiple metastore, but 2 metastore cannot be of same region. now due to this... if suppose we create 2 metastore in a workspace, one metastore is published in the same region where the workspace is there. but now suppose if we are having second metastore which is not in the region where the workspace is there, then what is the use of having multiple metastore for one workspace, since we cannot connect to remaining metastore.

this storage adls a/c is outside of the databricks a/c and it's not a default databricks storage.

thanks for such a clear and simple explanation. Please wear a mic for recording, becuase what you are saying I cannot hear that in laptop mics, then i used my earphone then also your voice is coming very low, then i connected a wireless speaker to listen to you. so, kindly use a mic. Thanks

How to track lineage as after Apply changes drops the Lineage

Nice explanation, Can we duplicate a test case and do changes in that duplicate test case?

Thank you so much bro, You saved my lot of time Got rid of boring work Also got good comments from seniors because of you

What if accidentally all the steps are deleted is there any steps to recover

very insightful👌👌👍

2. Can we use yarn as a cluster manager or resource manager in spark in databricks? In real time?

Recent interview questions: 1. If you are using unity catelog in your project then can we use service principals to connect adf to batabricks? Sir can you please explain in depth.

What is the difference in unity catelog and hive metastore

where are the tables, ? how we can see those tables which are created , ? like SQL server database style, how can we query our datasets after pipeline finished running.

Thanks for the excellent video. Can you please make a video on what to test in Azure Databricks and how to write test cases for Azure Databricks ETL. If you are planning any training for these, please let me know or can you please give me your contact number to talk to you on this? bit urgent for me!

Testcase title is validate the login functionality

I was searching more details about what you explain in your videos Awesome How can I approach to you if I have any questions

The way you explain is awesome, but that would great if you explain the steps of writing the testcases or show the testcases which are already written and then at the time of creating testsuite how does queries work to link the same testcases

If you code share the code in the description it will be helpful

If you share the the code and data file I can practice if will be easy for the first timmer to get similar with code.

I have basic version and dont see any of the options

Amazing, I like the matter covered in great depth here!

One of the best tutorial videos i have gone through. Explanation is very clear and pace is really good. Thank you making this playlist❤

Hi bro, How can we write the quiry with comparison of the system date & planned date?

I am glad that you did not edit the video to remove error part. it really helps to see all issues and how they can be removed as a learner. great effort and thanks a lot for the video

How to do collect on dlt streaming table using microbatch Can you help me

You can use the dropduplicate function it also takes list of columns ti check the duplicate data and drops it keeps one

can you please make a video on how to upload this framewor in azure devops then run it from there daily?

Crisp and Clear explanation, Thank you.

You are right bro. AS a QA tester how do we test this pipeline or business requirements in Azure. Can we test this in automated way? If it is automation do we need to do test pipeline in Azure itself? Pls do some video how exactly we are etl pipeline in azure.

Does any of the above operations costed you anything? Can we do it on community edition?

Hi, its a good video, can you make a video severity and priority of bug in Azure Devops in details

If we need to implement any transformation on silver table how to do it

what are you saying dude? Speak english plz

Hi thank you for the awesome series about delta live, I have a question can i read data from oracle using jdbc connection using delta live and run it daily by append mode, like Normal ETL.

Hi thank you for the awesome series about delta live, I have a question can i read data from oracle using jdbc connection using delta live and run it daily by append mode, like Normal ETL.