Check null all column pyspark

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Check null all column pyspark

data_indexed.select([count(when(col(c).isNull(),c)).alias(c) for c in data_indexed.columns]).toPandas().T

Similar codes

2 votes151 views1 answer
Flask for loops
Python
0 vote147 views1 answer
Label with list comprehension python
Python
0 vote176 views1 answer
C Pythagorean triples
Python
1 vote140 views1 answer
How to minimize command console python
Python
0 vote146 views1 answer
Banner grabber api
Python
0 vote103 views1 answer
Neo4j python
Python
8 votes150 views3 answers
Pandas replace string with another string
Python
0 vote173 views1 answer
Pandas index append value
Python
22 votes158 views6 answers
How to take list input in python
Python
0 vote166 views1 answer
Read list stored as a string with pandas read csv
Python