/Python/How to have framer read json timestamps

How to have framer read json timestamps

scala> val regex =  "([0-9\\-TZ\\.:]+) (\\{.*)"
regex: String = ([0-9\-TZ\.:]+) (\{.*)

scala> val dff = df.withColumn("tstamp", regexp_extract('json_content, regex, 1)).withColumn("json", regexp_extract('json_content, regex, 2)).drop("json_content")
dff: org.apache.spark.sql.DataFrame = [country: string, city: string ... 2 more fields]

scala> dff.show(false)
+-------+-------+------------------------+----------------------------------+
|country|city   |tstamp                  |json                              |
+-------+-------+------------------------+----------------------------------+
|america|chicago|2019-06-28T00:00:00.000Z|{ "a": 123, "b": "456", "c": 789 }|
|india  |mumbai |2019-06-28T00:00:00.000Z|{ "a": 123, "b": "456", "c": 789 }|
+-------+-------+------------------------+----------------------------------+

Source: stackoverflow.com

Similar codes

0 vote206 views1 answer
HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read timed out
Python
0 vote200 views1 answer
How to add existiong database in dango
Python
0 vote205 views1 answer
Pandas create column if equals
Python
14 votes363 views3 answers
ModuleNotFoundError: No module named 'pandas_profiling'
Python
5 votes215 views3 answers
Python import graphviz
Python
0 vote190 views1 answer
Selecting letters in a row
Python
0 vote198 views1 answer
Pyspark groupby sum
Python
4 votes218 views2 answers
Split filename and extension python
Python
0 vote216 views2 answers
A problem of predicting whether a student succeed or not based of his GPA and GRE. for logistic regression
Python
18 votes204 views4 answers
Edit path variable using python
Python