Create dataframe pyspark

from datetime import datetime, date
import pandas as pd
from pyspark.sql import Row

df = spark.createDataFrame([
    Row(a=1, b=2., c='string1', d=date(2000, 1, 1), e=datetime(2000, 1, 1, 12, 0)),
    Row(a=2, b=3., c='string2', d=date(2000, 2, 1), e=datetime(2000, 1, 2, 12, 0)),
    Row(a=4, b=5., c='string3', d=date(2000, 3, 1), e=datetime(2000, 1, 3, 12, 0))
])
df

Source: spark.apache.org

Similar codes

2 votes97 views4 answers
How to add column to np array
Python
0 vote100 views2 answers
Logging the terminal output to a file
Python
3 votes175 views4 answers
Python sort multiple keys
Python
5 votes117 views2 answers
Forgot django admin password
Python Django
0 vote94 views1 answer
How to get azure keyvalaut values into python function app
Python
3 votes94 views1 answer
Delete a key value pair from a dictionary in python
Python
0 vote100 views1 answer
Comparison python
Python
7 votes97 views5 answers
Pandas split train test
Python
0 vote108 views1 answer
Python tensorflow is not defined
Python
0 vote94 views1 answer
Numpy expand_dims
Python