/Python/Build the union of a list of RDDs

Build the union of a list of RDDs

# Build the union of a list of RDDs

path = os.path.join(tempdir, "union-text.txt")
with open(path, "w") as testFile:
  _ = testFile.write("Hello")
textFile = sc.textFile(path)
textFile.collect()
# ['Hello']
parallelized = sc.parallelize(["World!"])
sorted(sc.union([textFile, parallelized]).collect())
# ['Hello', 'World!']

Source: spark.apache.org

Similar codes

0 vote260 views1 answer
Round list of floats python
Python
0 vote188 views1 answer
Python priority queue stack overflow
Python
14 votes269 views2 answers
How to change values in dataframe python
Python
0 vote202 views1 answer
Wx.SingleInstanceCheckerindexmodules
Python
1 vote160 views1 answer
Pygame blit image
Python
8 votes197 views2 answers
Windows 10 python path
Python
1 vote218 views1 answer
Fill pixels with zeros python opencv
Python
7 votes212 views1 answer
Python title case
Python
44 votes202 views3 answers
Bytes to string python
Python
0 vote213 views1 answer
Find the highest id in model django
Python