Spark SQL Mastery: How to Format Amounts with 'format_number'

Welcome to another Spark SQL tutorial! In this video, we tackle the challenge of formatting the 'total_profit' column in a dataset ('profits.csv') using the powerful 'format_number' function in Spark.
📋 Problem Statement:
We explore an input dataset with columns 'year,' 'month,' and 'total_profit.' Our mission is to format the 'total_profit' column by adding commas and prefixing it with the Rupees (₹) symbol.
👍 If you find this tutorial helpful, don't forget to like, share, and subscribe for more Spark tips and tricks! 🌟
profits.csv:
2022,January,82994023.49
2022,February,28329.33
2022,March,100.5
2022,April,93839493.34
2022,May,100.4
#SparkTutorial #DataScience #UA-camTutorial #CodingTips #Programming

[@yogeshkadam8483]

Thanks for the valuable session

[@rahul_upadhya]

Thank you Yogesh 😊

[@aniketjain3875]

Thanks for this video 🎉
Question - how can we save notebook for future purpose coz cluster is getting disconnected after 1-2 hours if it’s in idle state.
Thanks

[@aniketjain3875]

Question - Why we make as a false?
InputDF.show(false)
I’m waiting for your response
Thanks 🙏