/Python/How to have framer read json timestamps

How to have framer read json timestamps

scala> val regex =  "([0-9\\-TZ\\.:]+) (\\{.*)"
regex: String = ([0-9\-TZ\.:]+) (\{.*)

scala> val dff = df.withColumn("tstamp", regexp_extract('json_content, regex, 1)).withColumn("json", regexp_extract('json_content, regex, 2)).drop("json_content")
dff: org.apache.spark.sql.DataFrame = [country: string, city: string ... 2 more fields]

scala> dff.show(false)
+-------+-------+------------------------+----------------------------------+
|country|city   |tstamp                  |json                              |
+-------+-------+------------------------+----------------------------------+
|america|chicago|2019-06-28T00:00:00.000Z|{ "a": 123, "b": "456", "c": 789 }|
|india  |mumbai |2019-06-28T00:00:00.000Z|{ "a": 123, "b": "456", "c": 789 }|
+-------+-------+------------------------+----------------------------------+

Source: stackoverflow.com

Similar codes

1 vote156 views1 answer
Python enum
Python
0 vote150 views1 answer
Bar labeling in matplotlib
Python
3 votes157 views2 answers
Pandas normalize columns
Python
2 votes245 views1 answer
How to return total elements in database django
Python Django
0 vote149 views1 answer
Create a dict from variables and give name
Python
0 vote143 views1 answer
Python beautifulsoup write to file
Python
0 vote144 views1 answer
Napalm cli
Python
2 votes201 views1 answer
Django.core.exceptions.ImproperlyConfigured
Python Django
1 vote170 views1 answer
How to count the occurrence of a word in string python
Python
0 vote158 views1 answer
Distance of a point from a line python
Python