Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

2 votes92 views2 answers
Python check string for negative number
Python
2 votes120 views1 answer
How to redirect in flask to the same page
Python
0 vote107 views1 answer
Find_element_by_xpath pythin
Python
1 vote99 views1 answer
Python web parser
Python
2 votes98 views1 answer
Create Pandas Data Frame in Python
Python
2 votes133 views1 answer
Python gui drag and drop
Python
0 vote100 views2 answers
Bokeh bar chart
Python
0 vote101 views1 answer
Lag function in pandas
Python
4 votes163 views6 answers
Eval function in python
Python
-2 votes91 views2 answers
Extract directory python
Python