In Sparkflows, we can use the ‘Windows Aggregation’ processor to perform state wise data analysis. Data can be partitioned by State and various computations can be performed such as avg, max, min, range, std dev, and so on.
To use the ‘Windows Aggregation’ Processor:
Select a column to partition the dataset as ‘Partition column’.
Select a column to order the dataset as ‘Order Column Name’.
Select a column to perform aggregation on as ‘Input Columns’.
Select windows function to be applied on the ‘Input Column’ as ‘Functions’. It would add a new column to the outgoing dataset.
Hey Chris,
In Sparkflows, we can use the ‘Windows Aggregation’ processor to perform state wise data analysis. Data can be partitioned by State and various computations can be performed such as avg, max, min, range, std dev, and so on.
To use the ‘Windows Aggregation’ Processor:
Select a column to partition the dataset as ‘Partition column’.
Select a column to order the dataset as ‘Order Column Name’.
Select a column to perform aggregation on as ‘Input Columns’.
Select windows function to be applied on the ‘Input Column’ as ‘Functions’. It would add a new column to the outgoing dataset.