/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

0 vote125 views1 answer
Windows how to store filepath as variabley python
Python
0 vote169 views1 answer
Nth catalan number
Python
1 vote99 views1 answer
How to print out all functions of an object in python
Python
0 vote93 views1 answer
Minimum Number of Operations to Move All Balls to Each Box in python used in function method
Python
0 vote100 views1 answer
Emacs shift region left python
Python
5 votes95 views1 answer
Write multiple df to excel pandas
Python
1 vote92 views1 answer
Sort python dictionary by date
Python
0 vote97 views1 answer
Statistique in python
Python
30 votes115 views6 answers
Django static files
Python
0 vote104 views1 answer
Validating credit card numbers
Python