Making spark session

from pyspark.sql import SparkSession

spark = SparkSession \
    .builder \
    .appName("Python Spark SQL basic example") \
    .config("spark.some.config.option", "some-value") \
    .getOrCreate()

To create a SparkSession

# To create a SparkSession

spark = SparkSession.builder.master(
  "local").appName("Word Count").config(
  "spark.some.config.option", "some-value").getOrCreate()

Source: spark.apache.org

Similar codes

0 vote164 views1 answer
Pandas define how you want to aggregate each column
Python
0 vote173 views1 answer
Inject dynamic value into string python
Python
0 vote180 views1 answer
Treat NaN as a category
Python
0 vote244 views1 answer
Django test postgres extensions intarray
Python Django
0 vote219 views1 answer
Python get majority of list
Python
0 vote149 views1 answer
Django capture the file upload
Python
0 vote157 views1 answer
Kivymd simple button
Python
0 vote179 views1 answer
Fomat json load python
Python
0 vote154 views1 answer
Python print without optional argument
Python
9 votes169 views6 answers
Df to np array
Python