/Python/Python remove duplicates from list of dict

Python remove duplicates from list of dict

Python remove repeated elements from list

# ----- Create a list with no repeating elements ------ #

mylist = [67, 7, 89, 7, 2, 7]
newlist = []

  for i in mylist: 
    if i not in newlist: 
        newlist.append(i)

Python dict remove duplicates where name are not the same

import itertools
mylist = [{'x':2020 , 'y':20},{'x':2020 , 'y':30},{'x':2021 , 'y':10},{'x':2021 , 'y':5}]
mylist1=[]
for key, group in itertools.groupby(mylist,lambda x:x["x"]):
    max_y=0
    for thing in group:
        max_y=max(max_y,thing["y"])
    mylist1.append({"x":key,"y":max_y})
print(mylist1)

Source: stackoverflow.com

Python remove duplicates from list of dict

# set the dict to a tuple for hashability, then use {} for set literal and retrn each item to dict. 
[dict(t) for t in {tuple(d.items()) for d in l}]
# using two maps()
list(map(lambda t: dict(t), set(list(map(lambda d: tuple(d.items()), l)))))

-1

Source: stackoverflow.com

Similar codes

1 vote206 views1 answer
Pandas change every row to df
Python
0 vote190 views1 answer
How to check if digit in int python
Python
15 votes190 views2 answers
Python re compile
Python
0 vote210 views1 answer
"detail": "Method \"POST\" not allowed." django
Python
0 vote188 views1 answer
Nearest neighbors imputation
Python
0 vote207 views1 answer
I've a date column messed up with different date formats how to fix it in power bi
Python
0 vote209 views1 answer
Parse_dates
Python
0 vote141 views1 answer
Django include all columns admin show
Python
2 votes207 views2 answers
Conda create jupyter kernel
Python
0 vote189 views1 answer
Pandas sequential numbering within group
Python