/Python/Convert all date columns using pd.datetime

Convert all date columns using pd.datetime

def lookup(s):
    """
    This is an extremely fast approach to datetime parsing.
    For large data, the same dates are often repeated. Rather than
    re-parse these, we store all unique dates, parse them, and
    use a lookup to convert all dates.
    """
    dates = {date:pd.to_datetime(date) for date in s.unique()}
    return s.apply(lambda v: dates[v])

to_datetime: 5799 ms
dateutil:    5162 ms
strptime:    1651 ms
manual:       242 ms
lookup:        32 ms

Source: stackoverflow.com

Similar codes

0 vote172 views1 answer
Replace outliers with nan python
Python
95 votes239 views6 answers
Check if string contains python
Python
1 vote208 views1 answer
Assert len(lex) < self.bucket_specs[-1][1]
Python
15 votes183 views4 answers
Q django
Python
97 votes213 views6 answers
How to read a csv file in python
Python
4 votes198 views2 answers
Force two decimal places python
Python
74 votes196 views4 answers
Reverse function python
Python
0 vote182 views1 answer
Pycharm flask invalid or missing encoding declaration
Python
1 vote206 views1 answer
Python convert datetime.timedelta into seconds
Python
0 vote183 views1 answer
Start loop at 1 python
Python