/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

37 votes97 views3 answers
How to send emails in python
Python
0 vote94 views2 answers
Line to curve dynamo revit
Python
1 vote135 views1 answer
Python count variable and put the count in a column of data frame
Python
1 vote106 views1 answer
Random forrest plotting feature importance function
Python
19 votes104 views5 answers
List to dictionary
Python
1 vote100 views2 answers
How to append a tuple to a list
Python
1 vote105 views1 answer
Python 3 tkinter treeview example
Python
91 votes95 views6 answers
Conda create environment python 3
Python
0 vote137 views2 answers
Django create view filter options
Python Django
1 vote108 views2 answers
[Errno 13] Permission denied
Python