/Python/How to have framer read json timestamps

How to have framer read json timestamps

scala> val regex =  "([0-9\\-TZ\\.:]+) (\\{.*)"
regex: String = ([0-9\-TZ\.:]+) (\{.*)

scala> val dff = df.withColumn("tstamp", regexp_extract('json_content, regex, 1)).withColumn("json", regexp_extract('json_content, regex, 2)).drop("json_content")
dff: org.apache.spark.sql.DataFrame = [country: string, city: string ... 2 more fields]

scala> dff.show(false)
+-------+-------+------------------------+----------------------------------+
|country|city   |tstamp                  |json                              |
+-------+-------+------------------------+----------------------------------+
|america|chicago|2019-06-28T00:00:00.000Z|{ "a": 123, "b": "456", "c": 789 }|
|india  |mumbai |2019-06-28T00:00:00.000Z|{ "a": 123, "b": "456", "c": 789 }|
+-------+-------+------------------------+----------------------------------+

Source: stackoverflow.com

Similar codes

0 vote74 views1 answer
Tensorflow.keras.utils.to_categorical
Python
0 vote68 views1 answer
Uninstalling/removing a package is very easy with pip:
Python
1 vote72 views1 answer
Best Python Free Tutorial
Python
0 vote66 views2 answers
Method get first last name python
Python
0 vote75 views2 answers
Cors python functions framework local
Python
9 votes73 views1 answer
Ardent
Python
0 vote68 views1 answer
Is enumerate python lazy
Python
0 vote72 views1 answer
Relation api profile does not exist django
Python
-1 vote206 views1 answer
Combination of 1 2 3 4 5 python
Python
0 vote79 views1 answer
Select values for row matching condition
Python