Fire Insights allows you to quickly do complex data preparation and ETL on Big Data.
Fire Insights has a number of features for enabling it including:
Reading data from multiple sources
Cleaning data
Joins, GroupBy, Cube, SQL etc. to transform data
CaseWhen and FlagOutlier
Writing results to various sinks
Fire Insights also gives you detailed control over your Spark jobs with Repartition, Coalesce, Cache etc.
The tutorial is available at : https://docs.sparkflows.io/en/latest/tutorials/data-engineeringII/retail-data-preparation.html