/Python/Build the union of a list of RDDs

Build the union of a list of RDDs

# Build the union of a list of RDDs

path = os.path.join(tempdir, "union-text.txt")
with open(path, "w") as testFile:
  _ = testFile.write("Hello")
textFile = sc.textFile(path)
textFile.collect()
# ['Hello']
parallelized = sc.parallelize(["World!"])
sorted(sc.union([textFile, parallelized]).collect())
# ['Hello', 'World!']

Source: spark.apache.org

Similar codes

0 vote298 views1 answer
How to access pandas column
Python
0 vote265 views1 answer
Cannot cast type smallint to boolean django
Python Django
21 votes266 views2 answers
List comprehension if-else
Python
82 votes201 views6 answers
How to convert python to exe
Python
0 vote241 views1 answer
How to wait for loading icon to disappear from the page using selenium python
Python
0 vote191 views1 answer
Google sheet api python
Python
-1 vote222 views1 answer
Binascii.Error: Incorrect padding in python django
Python Django
0 vote234 views2 answers
Django run management command from code
Python Django
69 votes182 views6 answers
Python shuffle array
Python
0 vote198 views1 answer
Pylint no name in module opencv
Python