Outliers removal

Outliers removal pandas

df = pd.DataFrame(np.random.randn(100, 3))

from scipy import stats
df[(np.abs(stats.zscore(df)) < 3).all(axis=1)]

Source: stackoverflow.com

Outlier removal

q1 = df['column'].quantile(0.25)
q3 = df['column'].quantile(0.75)
iqr = q3 - q1

df.loc[df['column'] > (q3 + 1.5 * iqr) | df['column'] < (q1 - 1.5 * iqr), 'column'] = df['column'].mean()

Outliers removal

#Removing outliers first then skewness
from scipy.stats import zscore
z=abs(zscore(df))
print(z.shape)
df=df[(z<3).all(axis=1)]
df.shape

Similar codes

6 votes154 views1 answer
Django model form
Python Django
1 vote176 views1 answer
Getting multiple selected value django
Python Django
0 vote134 views1 answer
Deine dict with same values
Python
20 votes136 views5 answers
Python replace regex
Python
-1 vote135 views1 answer
Return an RDD with the keys of each tuple.
Python
1 vote168 views1 answer
Hot to pay music in pygame
Python
9 votes138 views2 answers
Pygame render text
Python
0 vote145 views1 answer
ImportError: No module named colored
Python
0 vote145 views1 answer
Python ignore unicodedecodeerror
Python
0 vote163 views1 answer
How to return an html file in flask
Python Flask