Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

6 votes137 views2 answers
Pad zeros to a string python
Python
0 vote129 views1 answer
Web3.py failing not installing
Python
2 votes122 views1 answer
Make new dataframe from slice
Python
0 vote163 views1 answer
Calculate quartil python
Python
0 vote118 views3 answers
How to catch ctrl c in python
Python
0 vote129 views1 answer
Open spreadsheet by key
Python
0 vote148 views1 answer
Django active link
Python Django
1 vote115 views1 answer
Django class based views ListView
Python
0 vote119 views2 answers
Blog in django
Python
91 votes130 views6 answers
Sort df by column
Python