Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

3 votes135 views1 answer
Smtplib login
Python
2 votes152 views1 answer
Title() in python
Python
2 votes199 views1 answer
Flask if statement
Python Flask
-2 votes163 views2 answers
Where to import reverse_lazy in django
Python
3 votes160 views3 answers
Generate n different random numbers python
Python
0 vote160 views1 answer
Gunicorn django static files
Python
0 vote168 views1 answer
Record audio with processing python
Python
1 vote199 views1 answer
Django datetimefield default
Python Django
2 votes193 views1 answer
No module named social_django
Python Django
2 votes151 views1 answer
Flask import jsonify
Python