/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

0 vote186 views1 answer
Create contract from interface in brownie
Python
0 vote209 views1 answer
Unable to load celery application the module was not found
Python
63 votes175 views3 answers
How to calculate sum of a list in python
Python
4 votes141 views2 answers
How to remove all elements from dictionary python
Python
1 vote201 views1 answer
Prevent list index out of range python
Python
1 vote183 views1 answer
__call__() python
Python
1 vote207 views1 answer
Proper tree in data structure
Python
-1 vote190 views1 answer
How split text in python by space or newline with regex
Python
0 vote169 views1 answer
Change float column to percentage python
Python
1 vote210 views1 answer
Python how much memory does a variable need
Python