Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

1 vote141 views1 answer
Selenium get parent element python
Python
0 vote134 views2 answers
Dataframe change specicf values in column
Python
0 vote138 views1 answer
Concatenar columnas en una del mismo dataset
Python
2 votes138 views2 answers
Python primera letra mayuscula
Python
2 votes150 views1 answer
Python can't subtract offset-naive and offset-aware datetimes
Python
16 votes132 views3 answers
Python get all file names in a dir
Python
7 votes139 views3 answers
Determine if number is prime python
Python
1 vote129 views1 answer
Pangram function
Python
0 vote139 views1 answer
Degree symbol in python
Python
0 vote127 views1 answer
Lcd of 18 and 21
Python