/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

1 vote216 views1 answer
Django template tags capitalize
Python Django
2 votes178 views3 answers
0 1 1 2 3 5 in python
Python
0 vote154 views2 answers
AttributeError: module 'keras.utils' has no attribute 'to_categorical'
Python
4 votes181 views1 answer
Python: change column name
Python
2 votes169 views1 answer
Selenium change window size
Python
1 vote178 views1 answer
Np.rand.randint
Python
0 vote161 views1 answer
How to get the access of python on cmd
Python
12 votes171 views2 answers
Python sort array of dictionary by value
Python
0 vote163 views1 answer
Alberi binari di ricerca python
Python
1 vote203 views1 answer
Check string equal with regular expression python
Python