Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote179 views1 answer
Djanog admin cookbook change text
Python
-1 vote201 views1 answer
Return an RDD with the keys of each tuple.
Python
6 votes187 views1 answer
Cors error in flask
Python
0 vote196 views1 answer
Tkinter gui grid and frame
Python
5 votes198 views1 answer
Show full pd dataframe
Python
6 votes234 views3 answers
Message: 'chromedriver' executable needs to be in PATH. Please see https://sites.google.com/a/chromium.org/chromedriver/home
Python
0 vote170 views1 answer
Pytesseract restrict char
Python
0 vote205 views1 answer
Check if string contains alphabets python
Python
7 votes211 views1 answer
Python primality test
Python
2 votes186 views5 answers
How to kill
Python