/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

0 vote187 views1 answer
Blender python set object location
Python
0 vote226 views1 answer
Django allauth Reverse for 'password_reset_confirm' not found. 'password_reset_confirm' is not a valid view function or pattern name.
Python Django
99 votes200 views6 answers
Python get path of current file
Python
1 vote201 views1 answer
How to say hello with name in python
Python
0 vote193 views1 answer
Python read binary trj file
Python
1 vote190 views7 answers
Java to python
Python
0 vote185 views1 answer
From flask_paginate import get_page_parameter
Python
0 vote194 views1 answer
Share x axis matplotlib
Python
0 vote227 views1 answer
Randint without repitition
Python
0 vote253 views1 answer
Discord bot python meme command
Python