RDD vs Dataframe vs Dataset | With sample code | Spark Interview Questions

Hi Friends,
In this video, I have explained the differences between rdd, df and ds.
github.com/sra...
Please subscribe to my channel for more interesting learnings.

[@Jay-vh3gx]

Thank you for clear cut explanation Sravana

[@sravanalakshmipisupati6533]

Thank you.

[@sravankumar1767]

Nice explanation sravana, thanks for sharing 👍

[@sravanalakshmipisupati6533]

Thanks a lot Sravan.

[@padmsrikanth1672]

After long time you uploaded video, pls upload regularly.your explanation superb.

[@sravanalakshmipisupati6533]

Sure, thanks a lot.

[@anky986]

Hi Lakshmi,
Nice video. Can you please create a video on Spark submit and client and explain how these are work with different with example.

[@sravanalakshmipisupati6533]

Thanks Ankit. Please checkout the video for the differences between modes - ua-cam.com/video/BLut7duRhTM/v-deo.html and video for spark-submit - ua-cam.com/video/APb6vwQz1_M/v-deo.html

[@kaladharnaidusompalyam851]

Hi Dear Lakshmi, Thank you for video
what is the diff b/w foreach() & collect() actions . I know we can't use collect for larger dataset it will spill over disk if we don't have prior experience.
Than other doubt is.
If we have two files a, b j need to know duplicates present in both files how do you do it with spark. Can I have overview for the approach .👍

[@sravanalakshmipisupati6533]

Sure, I will get back on the differences. you can use df.dropDuplicates() - ua-cam.com/video/Vrs011lwrmM/v-deo.html

[@ShubhamRai06]

Could you demonstrate , how df and ds handle runtime & compile time safety?