/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

0 vote162 views1 answer
Star rating form in flask
Python Flask
0 vote115 views1 answer
Text color python tkinter
Python
2 votes129 views1 answer
How to print hostname in python
Python
9 votes132 views4 answers
Capitalize first letter of each word python
Python
0 vote132 views1 answer
Knn example
Python
0 vote89 views1 answer
Geopy set proxy
Python
0 vote122 views2 answers
C to python converter
Python
33 votes123 views4 answers
Split word python
Python
0 vote132 views1 answer
File "pandas/_libs/index.pyx", line 465, in pandas._libs.index.DatetimeEngine.get_loc KeyError: Timestamp('2019-01-02 07:09:00')
Python
45 votes127 views6 answers
'type' object is not subscriptable
Python