Create dataframe pyspark

from datetime import datetime, date
import pandas as pd
from pyspark.sql import Row

df = spark.createDataFrame([
    Row(a=1, b=2., c='string1', d=date(2000, 1, 1), e=datetime(2000, 1, 1, 12, 0)),
    Row(a=2, b=3., c='string2', d=date(2000, 2, 1), e=datetime(2000, 1, 2, 12, 0)),
    Row(a=4, b=5., c='string3', d=date(2000, 3, 1), e=datetime(2000, 1, 3, 12, 0))
])
df

Source: spark.apache.org

Similar codes

0 vote151 views1 answer
Show only lower diagonal in sns pairplot
Python
0 vote166 views1 answer
Pathlib path of current file
Python
-2 votes153 views1 answer
Python same values in two lists
Python
1 vote212 views1 answer
Python use cases
Python
3 votes155 views1 answer
Python how to find the highest number in a dictionary
Python
0 vote165 views1 answer
Check if there is a certain number difference with python
Python
0 vote138 views1 answer
Support vector machine svm using python numerical example
Python
10 votes153 views3 answers
Matplotlib axis labels
Python
1 vote147 views1 answer
Check if the user is logged in django decorator
Python
2 votes153 views1 answer
CMake Error at 3rdparty/GLFW/CMakeLists.txt:236 (message): The RandR headers were not found
Python