/Python/How to have framer read json timestamps

How to have framer read json timestamps

scala> val regex =  "([0-9\\-TZ\\.:]+) (\\{.*)"
regex: String = ([0-9\-TZ\.:]+) (\{.*)

scala> val dff = df.withColumn("tstamp", regexp_extract('json_content, regex, 1)).withColumn("json", regexp_extract('json_content, regex, 2)).drop("json_content")
dff: org.apache.spark.sql.DataFrame = [country: string, city: string ... 2 more fields]

scala> dff.show(false)
+-------+-------+------------------------+----------------------------------+
|country|city   |tstamp                  |json                              |
+-------+-------+------------------------+----------------------------------+
|america|chicago|2019-06-28T00:00:00.000Z|{ "a": 123, "b": "456", "c": 789 }|
|india  |mumbai |2019-06-28T00:00:00.000Z|{ "a": 123, "b": "456", "c": 789 }|
+-------+-------+------------------------+----------------------------------+

Source: stackoverflow.com

Similar codes

0 vote180 views1 answer
True false array to black and white
Python
0 vote157 views2 answers
Using list comprehension to filter out age group pandas
Python
0 vote202 views2 answers
How to get a specific field in django
Python Django
0 vote170 views1 answer
Run a python script from another python script on a raspberry pi
Python
0 vote156 views1 answer
Inherit init method
Python
3 votes189 views1 answer
Pythone csv
Python
-1 vote194 views2 answers
Python datetime minus datetime
Python
0 vote169 views1 answer
Combine all lines with same value of a column unix
Python
0 vote161 views1 answer
Name='resnet50_input', description="created by layer 'resnet50_input'") at layer "resnet50
Python
0 vote184 views1 answer
Webview_flutter
Python