Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote167 views4 answers
Regression model build
Python
-1 vote216 views1 answer
Django model UUID field
Python Django
8 votes196 views1 answer
Iterative binary search python
Python
0 vote200 views1 answer
Python split files into even sets of folders
Python
43 votes166 views6 answers
Python run shell command
Python
1 vote181 views1 answer
Python code to receive gmail
Python
0 vote180 views1 answer
Df filter out rows that appear more than x times
Python
21 votes177 views5 answers
How to open a website using python
Python
0 vote229 views1 answer
How to form .cleaned data in class based views in django
Python Django
0 vote176 views1 answer
Python String with Alphanumeric characters
Python