/Python/Convert all date columns using pd.datetime

Convert all date columns using pd.datetime

def lookup(s):
    """
    This is an extremely fast approach to datetime parsing.
    For large data, the same dates are often repeated. Rather than
    re-parse these, we store all unique dates, parse them, and
    use a lookup to convert all dates.
    """
    dates = {date:pd.to_datetime(date) for date in s.unique()}
    return s.apply(lambda v: dates[v])

to_datetime: 5799 ms
dateutil:    5162 ms
strptime:    1651 ms
manual:       242 ms
lookup:        32 ms

Source: stackoverflow.com

Similar codes

2 votes161 views1 answer
Resampling data python
Python
12 votes147 views2 answers
Filtering a list
Python
1 vote142 views1 answer
Py 2 exe
Python
0 vote161 views1 answer
Python youtube downloader github
Python
-1 vote138 views6 answers
Pandas show column with regular expression
Python
0 vote141 views1 answer
Unity python
Python
0 vote151 views1 answer
Python convert dict to xml
Python
0 vote153 views1 answer
Head first python by paul barry pdf
Python
1 vote174 views1 answer
Use incognito in selenium
Python
1 vote151 views1 answer
Pandas forward fill after upsampling
Python