/Python/Gets an existing SparkSession or, if there is no existing one, creates a new

Gets an existing SparkSession or, if there is no existing one, creates a new

# Gets an existing SparkSession or, if there is no one, creates a new

s1 = SparkSession.builder.config("k1", "v1").getOrCreate()
s1.conf.get("k1") == s1.sparkContext.getConf().get("k1") == "v1"
# True

s2 = SparkSession.builder.config("k2", "v2").getOrCreate()
s1.conf.get("k1") == s2.conf.get("k1")
# True
s1.conf.get("k2") == s2.conf.get("k2")
# True

Source: spark.apache.org

Similar codes

0 vote234 views5 answers
Python lists
Python
1 vote192 views2 answers
How to sum only the even values in python
Python
-2 votes170 views4 answers
Codeforces
Python
0 vote176 views1 answer
Rectangle function numpy
Python
3 votes184 views6 answers
How to import nltk
Python
1 vote175 views1 answer
Get_or_create in django
Python
-1 vote188 views2 answers
Get_string python
Python
45 votes198 views6 answers
How to replace nan values with 0 in pandas
Python
37 votes171 views6 answers
How to install pip ubuntu python2
Python
0 vote172 views1 answer
Which type of programming does python support?
Python