Outliers removal

Outliers removal pandas

df = pd.DataFrame(np.random.randn(100, 3))

from scipy import stats
df[(np.abs(stats.zscore(df)) < 3).all(axis=1)]

Source: stackoverflow.com

Outlier removal

q1 = df['column'].quantile(0.25)
q3 = df['column'].quantile(0.75)
iqr = q3 - q1

df.loc[df['column'] > (q3 + 1.5 * iqr) | df['column'] < (q1 - 1.5 * iqr), 'column'] = df['column'].mean()

Outliers removal

#Removing outliers first then skewness
from scipy.stats import zscore
z=abs(zscore(df))
print(z.shape)
df=df[(z<3).all(axis=1)]
df.shape

Similar codes

7 votes247 views2 answers
From distutils.util import strtobool ModuleNotFoundError: No module named 'distutils.util'
Python
0 vote203 views1 answer
If object has property python
Python
7 votes183 views1 answer
How to set the screen brightness using python
Python
0 vote345 views1 answer
How to search dictionaryfor lowest value
Python
22 votes190 views3 answers
Python check if attribute exists in dictionary
Python
0 vote194 views1 answer
Sklearn euclidean distance
Python
0 vote287 views2 answers
Loop through file python
Python
0 vote331 views3 answers
Berlin
Python
0 vote243 views1 answer
Using django model translation with django rest
Python Django
8 votes241 views2 answers
What does class meta do in django
Python Django