Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote150 views1 answer
Elongated muskrat
Python
0 vote174 views1 answer
Pandas combine two data frames with same index and same columns
Python
10 votes135 views4 answers
Semicolons in python
Python
14 votes142 views2 answers
How to read a website in python
Python
0 vote144 views1 answer
A string varible in python
Python
1 vote160 views1 answer
Python hide details
Python
11 votes142 views3 answers
Practicing python
Python
0 vote155 views1 answer
Monthly precipitation in python
Python
0 vote163 views1 answer
Python list key string
Python
22 votes136 views3 answers
Python check if attribute exists in dictionary
Python