/Python/Convert all date columns using pd.datetime

Convert all date columns using pd.datetime

def lookup(s):
    """
    This is an extremely fast approach to datetime parsing.
    For large data, the same dates are often repeated. Rather than
    re-parse these, we store all unique dates, parse them, and
    use a lookup to convert all dates.
    """
    dates = {date:pd.to_datetime(date) for date in s.unique()}
    return s.apply(lambda v: dates[v])

to_datetime: 5799 ms
dateutil:    5162 ms
strptime:    1651 ms
manual:       242 ms
lookup:        32 ms

Source: stackoverflow.com

Similar codes

2 votes121 views2 answers
Python trim leading whitespace
Python
6 votes149 views3 answers
Argparse type
Python
0 vote129 views1 answer
Inverse box-cox transformation python
Python
13 votes146 views2 answers
How to install python libraries
Python
1 vote140 views1 answer
Alarm when code finishes
Python
0 vote131 views1 answer
Series astype
Python
7 votes130 views5 answers
Convert categorical variable to numeric python
Python
1 vote129 views1 answer
How to parse dicts in reqparse in flask
Python
0 vote145 views1 answer
Export a Pandas dataframe as a table image
Python
0 vote127 views1 answer
éliminer le background image python
Python