/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

15 votes189 views3 answers
Ffmpeg python
Python
1 vote228 views3 answers
Jsonresponse django
Python Django
1 vote196 views1 answer
Numpy take out elements equal to zero
Python
1 vote186 views2 answers
Subtract from dataframe column
Python
0 vote175 views1 answer
Primary key auto increment python django
Python
2 votes215 views2 answers
Write object to file python
Python
0 vote337 views1 answer
Pandas each row?
Python
-2 votes203 views3 answers
How to insert a banner in html
Python
45 votes191 views3 answers
Python change filename
Python
0 vote192 views2 answers
Javascript python
Python