/Python/Group the values for each key in the RDD into a single sequence.

Group the values for each key in the RDD into a single sequence.

rdd = sc.parallelize([("a", 1), ("b", 1), ("a", 1)])
sorted(rdd.groupByKey().mapValues(len).collect())
# [('a', 2), ('b', 1)]
sorted(rdd.groupByKey().mapValues(list).collect())
# [('a', [1, 1]), ('b', [1])]

Source: spark.apache.org

Similar codes

2 votes157 views1 answer
Python string remove whitespace and newlines
Python
0 vote166 views1 answer
A function for reviewing a list's order of magnitude in python
Python
0 vote148 views2 answers
Python list to string with spaces
Python
5 votes147 views4 answers
Python open mat file
Python
2 votes153 views1 answer
Python list of all tkinter events
Python
0 vote148 views2 answers
Identity matrix with numpy
Python
0 vote177 views1 answer
Assign elements of list to variables python
Python
51 votes147 views6 answers
Python logging to file
Python
0 vote141 views1 answer
Import csv import re data = [] with open('customerData.csv') as csvfile: reader = csv.DictReader(csvfile) for row in reader: data.append(row) print(data[0]) print(data[1]["Name"]) print(data[2]["Spent Past 30 Days"])
Python
0 vote146 views2 answers
Looping over folder to extract zip winrar python
Python