/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

21 votes146 views10 answers
How to print in python
Python
0 vote107 views1 answer
Displaying cv2.imshow on specific window position
Python
0 vote169 views2 answers
Pdf to excel conversion using python
Python
9 votes150 views1 answer
Comment out a block in python
Python
0 vote157 views1 answer
Tkinter bg button
Python
0 vote215 views1 answer
QuizListView login required django
Python Django
1 vote158 views1 answer
Python get object attribute by string
Python
5 votes149 views2 answers
How to make a calcukatir un python
Python
0 vote172 views1 answer
Boston data set to pandas df
Python
0 vote159 views1 answer
Py variable space padding
Python