/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote93 views1 answer
Create bbox R sp
Python
0 vote139 views1 answer
Access host database django docker
Python
26 votes134 views6 answers
Sort list of dictionaries python
Python
13 votes164 views4 answers
How to count number of unique values in a column python
Python
1 vote153 views2 answers
Python numpy delete element from array
Python
13 votes135 views3 answers
Duplicate in list python
Python
0 vote138 views1 answer
Verbose python
Python
3 votes189 views2 answers
Initialise a 2d array python
Python
0 vote138 views1 answer
Replace word in column pandas lambda
Python
0 vote145 views1 answer
Labelencoder update
Python