103. Databricks | Pyspark |Delta Lake: Spark/Databricks Interview Question Series - III

[@whymeiy]

Genuinely one of the best data engineering related courses I've ever seen. Clear and concise with practical demonstrations of the concepts discussed. I've recommended this playlist to the rest of my colleagues. Thank you very much for pulling this together! 💜

[@rajasdataengineering7585]

Thanks for your comment and recommendation to your colleagues. Hope this course helps you gaining knowledge in bigdata and databricks

[@SureshBabu-kf5jx]

Hi Raja, Thank you so much for wonderful videos, Please do not mind to reduce the length of the videos and continue like however you want to post the videos. Each detailed point and explanation are very important for everyone. Whomever do not want lengthy videos they have option of forwarding or skipping. But if content is not there then, We will miss the information. Please consider this. Thanks again

[@rajasdataengineering7585]

That's great suggestion! Thanks

[@tanushreenagar3116]

Finally watched 🙌 whole playlist of delta lake it helped me a lot thank you 😊 🎉

[@rajasdataengineering7585]

🙌 happy to hear that!

[@jhonsen9842]

I don't want to name others but for this same content some are charging heavy fees well its may be their way to feed their Family . But many thanks to you on this content.

[@rajasdataengineering7585]

Thanks for sharing your thoughts! Keep watching

[@ruinmaster5039]

Thanks for sharing all this valuable inormation!!!

[@rajasdataengineering7585]

Glad it was helpful!

[@prabhatgupta6415]

He is iron man of Big data

[@rajasdataengineering7585]

Thank you!

[@sabesanj5509]

Thank you so much raja bro for all your efforts in giving us those quality contents which will surely help aspiring big data candidates.

[@rajasdataengineering7585]

Glad to know it helps aspiring big data candidates!

[@Learn2Share786]

Thank you sir, pls make a detailed video on Question 18 ( SelectiveReplace) & Question 20(Deletion Vector)

[@rajasdataengineering7585]

Ho Fahad, noted down. Sure will create videos on replacewhere and deletion vector

[@latartecutieke772]

Hello sir can you pls create video on deployment from dev to uat or other higher environments

[@rajasdataengineering7585]

Hello, sure will create a video on this requirement

[@VKGT11]

I would like to know whether you provide any online training? I dropped you a mail regarding this. Thank you.

[@lalithroy]

Hi Raja could you please make videos on delta live tables.

[@rajasdataengineering7585]

Hi Lalith, sure will create videos on DLT

[@hritiksharma7154]

Please create video on unity catalog setup.

[@rajasdataengineering7585]

Sure, will create a video on this requirement

[@sundarrajan211]

Bro do u know tamil?

[@starmscloud]

Question No 23 :
Drop UnManaged/ External Table :
Run Below Commands in PySpark :
First :Check the Path of the Table using following Piece of code :
++++++++++++++++++++++++++++++++++++++++++++++++++++++++
spark.sql("DESCRIBE EXTENDED ") .show(truncate=False)
Second : Drop the Table
++++++++++++++++++++++++++++++++++++++++++++++++++++++++
if (spark.catalog._jcatalog.tableExists(""):
spark.sql("DROP TABLE ")
Third: Remove the File & Folder
++++++++++++++++++++++++++++++++++++++++++++++++++++++++
dbutils.fs.rm(" " , recurse =true )

[@rajasdataengineering7585]

Thanks for sharing an approach