Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

1 vote197 views1 answer
Display cv2 image in jupyter notebook
Python
1 vote204 views1 answer
Python count variable and put the count in a column of data frame
Python
0 vote193 views1 answer
Numpy savetext in one line
Python
0 vote264 views1 answer
Tkiner lable
Python
66 votes183 views6 answers
How to open csv file in python
Python
19 votes239 views3 answers
Pil image to numpy
Python
0 vote205 views1 answer
Django builtin signals
Python
35 votes192 views5 answers
Drop column with nan values
Python
23 votes170 views10 answers
Pycharm
Python
0 vote192 views1 answer
How fast is iglob
Python