/Python/Python remove duplicates from list of dict

Python remove duplicates from list of dict

Python remove repeated elements from list

# ----- Create a list with no repeating elements ------ #

mylist = [67, 7, 89, 7, 2, 7]
newlist = []

  for i in mylist: 
    if i not in newlist: 
        newlist.append(i)

Python dict remove duplicates where name are not the same

import itertools
mylist = [{'x':2020 , 'y':20},{'x':2020 , 'y':30},{'x':2021 , 'y':10},{'x':2021 , 'y':5}]
mylist1=[]
for key, group in itertools.groupby(mylist,lambda x:x["x"]):
    max_y=0
    for thing in group:
        max_y=max(max_y,thing["y"])
    mylist1.append({"x":key,"y":max_y})
print(mylist1)

Source: stackoverflow.com

Python remove duplicates from list of dict

# set the dict to a tuple for hashability, then use {} for set literal and retrn each item to dict. 
[dict(t) for t in {tuple(d.items()) for d in l}]
# using two maps()
list(map(lambda t: dict(t), set(list(map(lambda d: tuple(d.items()), l)))))

-1

Source: stackoverflow.com

Similar codes

2 votes119 views1 answer
How to make convert numpy array to string in python
Python
0 vote120 views1 answer
Crank nicholson scheme python
Python
0 vote121 views1 answer
ParserWarning: Falling back to the 'python' engine because the 'c' engine does not support regex separators (separators > 1 char and different from '\s+' are interpreted as regex); you can avoid this warning by specifying engine='python'.
Python
5 votes101 views2 answers
Python get min max value from a dictionary
Python
0 vote127 views1 answer
Onetoone vs foreign key django
Python Django
0 vote102 views1 answer
Django rest framework default_authentication_classes
Python
-3 votes100 views6 answers
Python 3.0 release date
Python
0 vote132 views2 answers
Django template date format yyyy-mm-dd
Python Django
1 vote100 views1 answer
Python pandas dataframe column date to string
Python
0 vote97 views1 answer
Train_test_split from sklearn.selection
Python