Suppose, I have data in different CSV files and they all have the same schema. How can I consolidate all the data into a single CSV file?
We can easily merge all the files in a single CSV by following the given steps:
- Read the entire directory where all your files have been located using a Read CSV processor.
- Insert and connect the Coalesce processor and set the number of partitions as 1 and then click Ok.
- Insert and connect the Save CSV node and add your desired path where you wanted to save the consolidated file and click Ok.
- Now, execute the workflow. This will create a consolidated file and save it to the specified path.