90% of Data Engineers doesn't know this - PySpark Azure Data Engineering Interview Question Tutorial

[@mr.ktalkstech]

Follow my LinkedIn profile to get regular updates:
www.linkedin.com/in/mrk-talkstech/
Did you face any interesting interview question recently? Leave the question in the comments section, will make a video about that if it is interesting.
Thank you!😊😊😊

[@NewNotificationLive]

Very useful! I’ve been watching your videos for some time now, and the time and effort you put into each one is truly amazing.
Looking forward to more interview questions like this 👍🏼

[@mr.ktalkstech]

Thank you so much :)

[@nagarajup382]

You will be blessed
What an explanation brother

[@mr.ktalkstech]

Thank you so much :)

[@joseanez2k12]

You are the best in this platform, all yours videos are outstanding. I hope you make this as a serie. Can't wait the next video

[@mr.ktalkstech]

Thank you so much :)

[@mgdesire9255]

Sir I'm following you from the last 1.5 years. Can you please create a playlist on pyspark and SQL.😊

[@mr.ktalkstech]

Thank you so much for the support :) Sure, ll do that :)

[@karszn]

Thank you . Are there any advantages or disadvantages of not creating a temp view . Can you pls explain ?

[@sonamgupta5736]

As always Great explanation....
Thanks a lot for explaining this new way...☺️ Will be waiting for the next interesting upload..

[@mr.ktalkstech]

Thank you so much :)

[@salmashaik6294]

Hope this helps me to my next week’s interview. Thank you 😊

[@mr.ktalkstech]

All the best :)

[@salmashaik6294]

@@mr.ktalkstech Thank you

[@ProDriverLearning]

thanks you Mr. K, please share more used case Azure Data projects (live data) as i have practiced all of your clean and great projects

[@mr.ktalkstech]

Thank you, sure, ll do that :)

[@omkarm7865]

Very helpful... please come up with interview questions series

[@mr.ktalkstech]

Thank you so much :) Sure, will do :)

[@sharaniyaswaminathan8760]

Great explanation with example thank you 🙏🏻

[@mr.ktalkstech]

Thank you so much :)

[@paretostroll]

Thanks for clear explanation. Could you still explain what is the reason to use spark.sql command instead of just using spark dataframe operations?

[@mr.ktalkstech]

using spark.sql we can write SQL commands in it for performing transformation. SO, if someone is comfortable in using SQL, they can use spark.sql to write SQL queries.

[@rupeshreddy4408]

What are the benefits of using the new way instead of creating a Temp View? In terms of Space we still assign the data frame to a variable right?

[@mr.ktalkstech]

the benefits is not around space, just reducing the total number of codes we write. When comes to complex transformation, we can minimize so many lines of code in real-time :)

[@d.yoganidhi6682]

So many lines of code ? It's just that createOrReplaceTempView() statements right ? Do temp views occupy memory ?

[@MyLearningdrive]

great iam waiting your paid online training iam sure you ll show us the best scenarios

[@smderoller]

Greatt...Thanks!!!

[@reach2puneeths]

I have to convert all the Oracle stored procedure to pyspark code, could you please make a video content on the same.

[@mr.ktalkstech]

Sure, will try to do that :)

[@reach2puneeths]

@@mr.ktalkstech thank you very much

[@sasikumar.p6382]

Good explanation

[@mr.ktalkstech]

Thank you so much :)

[@soumikdas7709]

Can you pls provide the notebook ?

[@hazarath540]

Thank you

[@mr.ktalkstech]

Thank you so much for watching :)