Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

15 votes141 views2 answers
How to run a python script
Python
32 votes133 views1 answer
How to add a column to a pandas df
Python
0 vote135 views1 answer
Pandas convert hex string to int
Python
0 vote147 views1 answer
Sklearn labelbinarizer in pipeline
Python
0 vote148 views1 answer
Pandas bins pd.cut()
Python
3 votes139 views1 answer
Normalize values between 0 and 1 python
Python
0 vote146 views1 answer
Int to hex python without 0x
Python
1 vote129 views1 answer
Find table with class beautifulsoup
Python
23 votes138 views4 answers
Django runserver
Python
1 vote149 views1 answer
True positive true negative manually
Python