/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

2 votes189 views2 answers
Django regexvalidator example
Python Django
0 vote139 views1 answer
Datetime to unix timestamp milliseconds python
Python
3 votes140 views2 answers
How to fill a list in python
Python
4 votes135 views1 answer
Data model
Python
1 vote146 views1 answer
Python create n*n matrix
Python
0 vote137 views2 answers
Error: Could not locate a Flask application. You did not provide the "FLASK_APP" environment variable, and a "wsgi.py" or "app.py" module was not found in the current directory.
Python
1 vote138 views1 answer
Python logistic function
Python
0 vote140 views1 answer
Return a new RDD containing only the elements that satisfy a predicate.
Python
0 vote147 views1 answer
Progressbar time in python
Python
0 vote150 views2 answers
Lambda function dataframe
Python