/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

22 votes119 views6 answers
Python strings
Python
0 vote132 views1 answer
Python von konsoleeinlesen
Python
0 vote168 views1 answer
Print the multiple data types in a single program in list data structures
Python
79 votes121 views3 answers
Reverse element in a list in python 3
Python
71 votes127 views6 answers
Python ide online
Python
4 votes121 views1 answer
Loca value and drop pandas dataframe
Python
0 vote126 views1 answer
Print torch model python
Python
0 vote120 views2 answers
How to remove zero after decimal float python
Python
0 vote118 views1 answer
Access dynamicall to name attribute python
Python
3 votes124 views3 answers
Python iterar claves
Python