Self-Service Data Science AI Platform

Forum

Ignite Discussions : Ask Questions, Find Answers, Share Expertise about Sparkflows

To test this feature, visit your live site.

2 3 4 5 6			Recent Activity

I have an employee dataset consisting of salary, dept and location information. ChrisBurkard Data Preparation	1	0	Jun 12, 2023

I want to apply filters on a dataset based on multiple conditions. Nagisa Data Preparation	1	0	Jun 12, 2023

I want to select rows at specific positions in the incoming dataset. Nagisa Data Preparation	1	0	Jun 09, 2023

How to select employees who have salaries in a given range? ChrisBurkard Data Preparation	1	0	Jun 09, 2023

Data processing warrants that name should not be less than a minimum value and should not be more than certain length. Nagisa Data Preparation	1	0	Jun 09, 2023

How to read from snowflake in sparkflows? ChrisBurkard Data Preparation	1	0	Jun 08, 2023

Does sparkflows supports reading data from different Relational Databases like Mysql, SQLServer, Postgress, etc.? ChrisBurkard Data Preparation	1	0	Jun 08, 2023

From my dataset, I want to select only a set of employees who have joined within a given date range. ChrisBurkard Data Preparation	1	0	Jun 08, 2023

I have a dataset with multiple columns. However, I need to use only a few of them for my processing. ChrisBurkard Data Preparation	1	0	Jun 08, 2023

I already have a sql statement written to process a dataset. ChrisBurkard Data Preparation	1	0	Jun 08, 2023

I want to execute a process for each value of state in the data. ChrisBurkard Data Preparation	1	0	Jun 07, 2023

How to execute a particular path when in True condition and another path in false. ChrisBurkard Data Preparation	1	0	Jun 07, 2023

In the amount field thousands are separated by spaces. ChrisBurkard Data Preparation	1	0	Jun 07, 2023

Can the xls file be read in Sparkflows? ChrisBurkard Data Preparation	1	0	Jun 07, 2023

How to use Great Expectation nodes for data quality checks in sparkflows? ChrisBurkard Data Preparation	1	0	Jun 06, 2023

How to handle rows having null values for certain columns? ChrisBurkard Data Preparation	1	0	Jun 06, 2023

How to handle duplicate data present in the incoming DataFrame? Data Preparation	1	0	Jun 06, 2023

How to Concatenate Multiple Columns? Nicole Data Preparation	1	0	Jun 06, 2023

How to perform multiple transformations in a single step? Ella Brown Data Preparation	1	0	Jun 06, 2023

How to read and parse the complex json structure in sparkflows? ChrisBurkard Data Preparation	1	0	Jun 05, 2023

How many parameters can I pass from Analytical App to workflow? Is there a limit on the number of parameters? ChrisBurkard Analytical Apps	1	0	Jun 05, 2023

How to generate a Unique ID for each row in a DataFrame? Data Preparation	1	0	Jun 05, 2023

Can one step in Analytical App use a Spark java workflow and another step in the same app use PySpark python workflow? ChrisBurkard Analytical Apps	1	0	Jun 05, 2023

How to add Current Date as a column to the DataFrame? Nicole Data Preparation	1	0	Jun 05, 2023

How to add filename as a column to the DataFrame while reading a file? Data Preparation	1	0	Jun 05, 2023

How to transpose an incoming dataset? Nicole Data Preparation	1	0	Jun 05, 2023

Is the history of my App execution and results saved by Sparkflows? ChrisBurkard Analytical Apps	1	0	Jun 05, 2023

Can I run PySpark workflows as a step in the Analytical App? ChrisBurkard Analytical Apps	1	0	Jun 02, 2023

Which processor can I use to encode category columns? ChrisBurkard Machine Learning	1	0	Jun 02, 2023

How can I create a histogram graph for different categories without using too many nodes? ChrisBurkard Reports & Dashboards	1	0	Jun 02, 2023

2 3 4 5 6

Forum

I have an employee dataset consisting of salary, dept and location information.

I want to apply filters on a dataset based on multiple conditions.

I want to select rows at specific positions in the incoming dataset.

How to select employees who have salaries in a given range?

Data processing warrants that name should not be less than a minimum value and should not be more than certain length.

How to read from snowflake in sparkflows?

Does sparkflows supports reading data from different Relational Databases like Mysql, SQLServer, Postgress, etc.?

From my dataset, I want to select only a set of employees who have joined within a given date range.

I have a dataset with multiple columns. However, I need to use only a few of them for my processing.

I already have a sql statement written to process a dataset.

I want to execute a process for each value of state in the data.

How to execute a particular path when in True condition and another path in false.

In the amount field thousands are separated by spaces.

Can the xls file be read in Sparkflows?

How to use Great Expectation nodes for data quality checks in sparkflows?

How to handle rows having null values for certain columns?

How to handle duplicate data present in the incoming DataFrame?

How to Concatenate Multiple Columns?

How to perform multiple transformations in a single step?

How to read and parse the complex json structure in sparkflows?

How many parameters can I pass from Analytical App to workflow? Is there a limit on the number of parameters?

How to generate a Unique ID for each row in a DataFrame?

Can one step in Analytical App use a Spark java workflow and another step in the same app use PySpark python workflow?

How to add Current Date as a column to the DataFrame?

How to add filename as a column to the DataFrame while reading a file?

How to transpose an incoming dataset?

Is the history of my App execution and results saved by Sparkflows?

Can I run PySpark workflows as a step in the Analytical App?

Which processor can I use to encode category columns?

How can I create a histogram graph for different categories without using too many nodes?