/Python/Build the union of a list of RDDs

Build the union of a list of RDDs

# Build the union of a list of RDDs

path = os.path.join(tempdir, "union-text.txt")
with open(path, "w") as testFile:
  _ = testFile.write("Hello")
textFile = sc.textFile(path)
textFile.collect()
# ['Hello']
parallelized = sc.parallelize(["World!"])
sorted(sc.union([textFile, parallelized]).collect())
# ['Hello', 'World!']

Source: spark.apache.org

Similar codes

0 vote153 views1 answer
Get the last element from the list
Python
32 votes137 views10 answers
Google translate
Python
0 vote136 views1 answer
Scipy check normal distribution
Python
1 vote140 views2 answers
Right angle triangle in python
Python
6 votes146 views2 answers
Flask get ip address of request
Python
0 vote133 views1 answer
Combining sparse class
Python
12 votes139 views4 answers
Get index of all element in list python
Python
79 votes140 views7 answers
Pip
Python
-1 vote126 views3 answers
Jama api python
Python
0 vote139 views1 answer
Pyodbc cursor create list of dictionaries
Python