/Python/Build the union of a list of RDDs

Build the union of a list of RDDs

# Build the union of a list of RDDs

path = os.path.join(tempdir, "union-text.txt")
with open(path, "w") as testFile:
  _ = testFile.write("Hello")
textFile = sc.textFile(path)
textFile.collect()
# ['Hello']
parallelized = sc.parallelize(["World!"])
sorted(sc.union([textFile, parallelized]).collect())
# ['Hello', 'World!']

Source: spark.apache.org

Similar codes

1 vote218 views1 answer
Python - Comment chiffrer une boucle
Python
1 vote136 views1 answer
Multiple pdf to csv python
Python
0 vote126 views1 answer
Reddit python 3 time a python program
Python
0 vote130 views1 answer
Python series to list of string
Python
0 vote122 views1 answer
How to check if a key is present in python dictionary
Python
2 votes132 views5 answers
Download python 3.6 64 bit for windows 7
Python
3 votes128 views2 answers
Run python notepad++
Python
3 votes124 views2 answers
Python subprocess exception handling
Python
0 vote136 views1 answer
TypeError: the 'int' object is not callable error
Python
0 vote96 views1 answer
Mechanize python #9
Python