How to show dataframe in pyspark? how to view dataframe in pyspark? To answer these questions we use show() function to see the contents of our pyspark dataframe.
This pyspark tutorial in Hindi for data engineers is about df.show(), show is a very basic function of pyspark. Pyspark show is used to see the contents of the dataframe into a table structure.
#pyspark #dataengineering #interviewquestions #googlecolab
There are several options that you can pass to df.show() and can get really interesting results. I am explaining few of them in this pyspark tutorial for beginners.
vertical: Displays the DataFrame in a vertical orientation instead of horizontally. This can be useful for wide DataFrames.
df.show(vertical=True)
truncate: Controls whether to truncate long strings in the display. Setting truncate=False will display full string values without truncation.
df.show(truncate=False)
n: Specifies the number of rows to display. For example, df.show(n=10) will display the first 10 rows of the DataFrame df.
df.show(n)