Pyspark pivot max aggregation

from pyspark.sql.functions import *
from pyspark.sql import Window
var win = Window.partitionBy("date") 
data.withColumn("max_vol",max("volume").over(win)).groupBy("date","max_vol") .pivot("recipe") .agg(avg("percent")).show()

Source: stackoverflow.com

Similar codes

0 vote114 views1 answer
Extra import on django
Python
0 vote151 views1 answer
Vscode how to extend output size in jupyter notebook
Python
1 vote82 views1 answer
Python add word to list
Python
2 votes127 views1 answer
How to reomve certain row from dataframe pandas
Python
2 votes139 views2 answers
How to find anyone's ip address
Python
2 votes126 views1 answer
Python custom errors
Python
9 votes118 views6 answers
How to declare variables in python
Python
4 votes131 views2 answers
List to json python
Python
0 vote119 views1 answer
How to have requirement file in python for libs
Python
31 votes119 views2 answers
Matplotlib 3.0.3 wheel file
Python