/Python/Build the union of a list of RDDs

Build the union of a list of RDDs

# Build the union of a list of RDDs

path = os.path.join(tempdir, "union-text.txt")
with open(path, "w") as testFile:
  _ = testFile.write("Hello")
textFile = sc.textFile(path)
textFile.collect()
# ['Hello']
parallelized = sc.parallelize(["World!"])
sorted(sc.union([textFile, parallelized]).collect())
# ['Hello', 'World!']

Source: spark.apache.org

Similar codes

0 vote218 views2 answers
3d graph python
Python
33 votes170 views6 answers
Chocolatey install
Python
19 votes183 views1 answer
Error tokenizing data. c error
Python
2 votes176 views1 answer
Check if message is in dm discord.py
Python
0 vote160 views1 answer
Get first not null value from column dataframe
Python
5 votes162 views3 answers
How to print a message in python
Python
0 vote173 views1 answer
Local to ISO 8601:
Python
0 vote170 views1 answer
Tkinter centre a button on 1920x1080
Python
40 votes165 views6 answers
Pandas sort columns by name
Python
0 vote179 views1 answer
How to use idl in python
Python