/Python/Convert all date columns using pd.datetime

Convert all date columns using pd.datetime

def lookup(s):
    """
    This is an extremely fast approach to datetime parsing.
    For large data, the same dates are often repeated. Rather than
    re-parse these, we store all unique dates, parse them, and
    use a lookup to convert all dates.
    """
    dates = {date:pd.to_datetime(date) for date in s.unique()}
    return s.apply(lambda v: dates[v])

to_datetime: 5799 ms
dateutil:    5162 ms
strptime:    1651 ms
manual:       242 ms
lookup:        32 ms

Source: stackoverflow.com

Similar codes

0 vote118 views1 answer
Random point seeds within a cyircle python
Python
0 vote118 views1 answer
Instantiate a dictionary python
Python
0 vote109 views1 answer
_getfullpathname: path should be string, bytes or os.PathLike, not list
Python
1 vote160 views1 answer
How to run the server in django
Python Django
0 vote119 views2 answers
Pygame surface
Python
1 vote119 views1 answer
Plt equal axis
Python
1 vote115 views1 answer
Pandas join series
Python
3 votes242 views1 answer
Python how to check in a list
Python
0 vote139 views1 answer
The current Numpy installation fails to pass a sanity check due to a bug in the windows runtime.
Python
2 votes131 views3 answers
Pandas decimal places
Python