/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

0 vote141 views1 answer
Flask admin forgeign keys show literal
Python
2 votes162 views1 answer
Import validation error in django
Python
4 votes156 views2 answers
Add y axis label matplotlib
Python
8 votes151 views2 answers
Python kivy
Python
0 vote158 views2 answers
Get hex code of character python
Python
2 votes175 views1 answer
How to make convert numpy array to string in python
Python
22 votes157 views4 answers
Python is float
Python
0 vote164 views1 answer
Arithmetic encoding python
Python
2 votes162 views2 answers
Panda - subset based on column value
Python
0 vote147 views1 answer
Python default parameters depend on other paramters
Python