In Sparkflows, we can use the “Field Splitter” processor to split the dataset into multiple columns. Output would contain columnar data which can be loaded into the database or can be used for further processing.
To use the “Field Splitter” Processor:
Select a ‘Input Column’ that contains joined data.
Specify the ‘Output Columns’ name. Data present in the ‘Input Column’ would be splitted into multiple columns and would be listed under ‘Output Columns’ in the outgoing dataset.
Specify the ‘Separator’ which is used to combine the multiple columns. Data would be splitted at the occurrence of ‘Separator’.
For more information read the Sparkflows Documentation here:
Hey Nagisa,
In Sparkflows, we can use the “Field Splitter” processor to split the dataset into multiple columns. Output would contain columnar data which can be loaded into the database or can be used for further processing.
To use the “Field Splitter” Processor:
Select a ‘Input Column’ that contains joined data.
Specify the ‘Output Columns’ name. Data present in the ‘Input Column’ would be splitted into multiple columns and would be listed under ‘Output Columns’ in the outgoing dataset.
Specify the ‘Separator’ which is used to combine the multiple columns. Data would be splitted at the occurrence of ‘Separator’.
For more information read the Sparkflows Documentation here:
https://docs.sparkflows.io/en/latest/user-guide/data-preparation/parse.html?highlight=field%20splitter#field-splitter