Hey Chris,In Sparkflows, we can use the ‘Multi Windows Analytics’ processor to compute minimum and maximum values. First it would create a partition by department and location. Then it would compute minimum and maximum salary values within each partition.
To use the ‘Multi Windows Analytics’ Processor:
- Select column of interest in ‘Analytics Column’. In this case it would be Salary column.
- Select ‘first_value’ or ‘last_value’ in ‘Windows Function’. ‘first_value’ for minimum and ‘last_value’ for maximum
- Enter the columns used for partitioning the dataset in ‘PartitionBy’. In this case it would be ‘department’,’location’.
- Enter the columns used for sorting the dataset in ‘Order By’. In this case it would be ‘department’,’location’.
- Enter ‘Output column’ to list the output in the outgoing DataFrame.
For more information read the Sparkflows Documentation here:
Hey Chris, In Sparkflows, we can use the ‘Multi Windows Analytics’ processor to compute minimum and maximum values. First it would create a partition by department and location. Then it would compute minimum and maximum salary values within each partition.
To use the ‘Multi Windows Analytics’ Processor:
- Select column of interest in ‘Analytics Column’. In this case it would be Salary column.
- Select ‘first_value’ or ‘last_value’ in ‘Windows Function’. ‘first_value’ for minimum and ‘last_value’ for maximum
- Enter the columns used for partitioning the dataset in ‘PartitionBy’. In this case it would be ‘department’,’location’.
- Enter the columns used for sorting the dataset in ‘Order By’. In this case it would be ‘department’,’location’.
- Enter ‘Output column’ to list the output in the outgoing DataFrame.
For more information read the Sparkflows Documentation here:
https://docs.sparkflows.io/en/latest/user-guide/data-preparation/others.html?highlight=multi%20window%20analytics#multi-windows-analytics