AWS Glue - Serverless Data Integration Service - S3 csv to Parquet Transformation - Part1

This video shows how we we can convert csv file to parquet file using Glue.
Glue Documentation: aws.amazon.com/glue/

[@quocat4775]

Hello, At 15:18s in the video, I only want to export 1 file, what should I do? I tried using `repartition()` but it didn't work. Thank you.

[@anything2cloud]

We can use coalesce(1) or repartition(1) to merge files. Refer: ua-cam.com/video/ibUV3A9fX34/v-deo.html

[@gilang6128]

Why output there are 3 output file?

[@anything2cloud]

Since the data processing happens in multiple nodes and in parallel. Therefore we could see multiple files.