Outliers removal

Outliers removal pandas

df = pd.DataFrame(np.random.randn(100, 3))

from scipy import stats
df[(np.abs(stats.zscore(df)) < 3).all(axis=1)]

Source: stackoverflow.com

Outlier removal

q1 = df['column'].quantile(0.25)
q3 = df['column'].quantile(0.75)
iqr = q3 - q1

df.loc[df['column'] > (q3 + 1.5 * iqr) | df['column'] < (q1 - 1.5 * iqr), 'column'] = df['column'].mean()

Outliers removal

#Removing outliers first then skewness
from scipy.stats import zscore
z=abs(zscore(df))
print(z.shape)
df=df[(z<3).all(axis=1)]
df.shape

Similar codes

0 vote206 views3 answers
Pysftp get-r
Python
0 vote190 views1 answer
Nested For loop in Python
Python
0 vote260 views1 answer
Python if index not out of range
Python
0 vote225 views1 answer
Mechanize python #5
Python
25 votes415 views2 answers
Django create app command
Python Django
12 votes301 views6 answers
Python progress bar
Python
2 votes195 views2 answers
Get list of unique values in pandas column
Python
0 vote179 views1 answer
How to block empty space python login
Python
60 votes204 views4 answers
Python choose random sample from list
Python
1 vote195 views1 answer
List shape python
Python