/Python/How to have framer read json timestamps

How to have framer read json timestamps

scala> val regex =  "([0-9\\-TZ\\.:]+) (\\{.*)"
regex: String = ([0-9\-TZ\.:]+) (\{.*)

scala> val dff = df.withColumn("tstamp", regexp_extract('json_content, regex, 1)).withColumn("json", regexp_extract('json_content, regex, 2)).drop("json_content")
dff: org.apache.spark.sql.DataFrame = [country: string, city: string ... 2 more fields]

scala> dff.show(false)
+-------+-------+------------------------+----------------------------------+
|country|city   |tstamp                  |json                              |
+-------+-------+------------------------+----------------------------------+
|america|chicago|2019-06-28T00:00:00.000Z|{ "a": 123, "b": "456", "c": 789 }|
|india  |mumbai |2019-06-28T00:00:00.000Z|{ "a": 123, "b": "456", "c": 789 }|
+-------+-------+------------------------+----------------------------------+

Source: stackoverflow.com

Similar codes

-1 vote129 views1 answer
AttributeError: Can't get attribute on <module '__main__' from manage.py
Python
62 votes95 views5 answers
How to pick a random number in a list python
Python
0 vote110 views1 answer
Date format flouytter
Python
0 vote98 views1 answer
Try for loop python
Python
0 vote108 views1 answer
Unction which takes in a list of integers and returns a dictionary of the five number summary..
Python
0 vote96 views3 answers
How to join two dataframes by 2 columns so they have only the common rows?
Python
9 votes114 views1 answer
Sleep in python 3
Python
8 votes124 views4 answers
Print pandas version
Python
1 vote94 views1 answer
Xor string python
Python
8 votes106 views4 answers
How to calculate the age from date of birth in python
Python