/Python/Build the union of a list of RDDs

Build the union of a list of RDDs

# Build the union of a list of RDDs

path = os.path.join(tempdir, "union-text.txt")
with open(path, "w") as testFile:
  _ = testFile.write("Hello")
textFile = sc.textFile(path)
textFile.collect()
# ['Hello']
parallelized = sc.parallelize(["World!"])
sorted(sc.union([textFile, parallelized]).collect())
# ['Hello', 'World!']

Source: spark.apache.org

Similar codes

7 votes156 views2 answers
Python prime check
Python
0 vote207 views1 answer
Django.com
Python Django
0 vote139 views1 answer
Cv2 opencv-python imshow while loop
Python
0 vote151 views1 answer
Discard method in python
Python
65 votes158 views5 answers
Python version check in cmd
Python
0 vote148 views1 answer
Specific mail.search python UNSEEN SINCE T
Python
0 vote154 views1 answer
How to get count by using group by in python
Python
2 votes144 views3 answers
WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
Python
0 vote152 views1 answer
Ex: python
Python
0 vote146 views1 answer
While loop odd numbers python
Python