Pyspark pivot max aggregation

from pyspark.sql.functions import *
from pyspark.sql import Window
var win = Window.partitionBy("date") 
data.withColumn("max_vol",max("volume").over(win)).groupBy("date","max_vol") .pivot("recipe") .agg(avg("percent")).show()

Source: stackoverflow.com

Similar codes

0 vote89 views1 answer
Perceptron multicouche scratch python
Python
13 votes97 views4 answers
How to call a python script from another python script
Python
0 vote92 views1 answer
How to check if a list is a subset of another list
Python
-1 vote91 views1 answer
Receipt ocr python
Python
127 votes102 views6 answers
Pandas rename column name
Python
1 vote140 views1 answer
Add background image in django uploaded file
Python
0 vote121 views1 answer
Python open all files of type csv
Python
0 vote108 views1 answer
Mean bias error
Python
0 vote97 views1 answer
Rolingmean python
Python
0 vote104 views1 answer
How to use drf permission class with class method actions
Python