/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

18 votes319 views3 answers
Django-admin startproject
Python Django
-1 vote232 views1 answer
How to delete django superuser
Python
0 vote216 views2 answers
Python list all youtube channel videos
Python
13 votes212 views3 answers
Window in python
Python
24 votes193 views2 answers
How to get the year and month in python
Python
1 vote201 views1 answer
ImportError: cannot import name 'TFAutoModel' from 'transformers'
Python
0 vote197 views1 answer
Filtrar en python/how to filter in python
Python
6 votes215 views2 answers
Python - show repeted values in a column
Python
0 vote211 views1 answer
Beautifulsoup remove empty tags
Python
0 vote223 views1 answer
Compute the 2d histogram of x and y.
Python