Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

0 vote138 views1 answer
Python documentacion comentarios
Python
9 votes120 views4 answers
Display full dataframe pandas
Python
4 votes136 views3 answers
ModuleNotFoundError: No module named 'xgboost'
Python
0 vote160 views2 answers
Get lastest files from directory python
Python
0 vote116 views1 answer
Fastest clicker python
Python
0 vote149 views1 answer
Mail.send_message flask not working, SSL ==> 465
Python Flask
0 vote154 views1 answer
Django get latest object
Python Django
0 vote130 views1 answer
Suppress pandas future warnings
Python
0 vote148 views1 answer
Get os environment python
Python
2 votes78 views1 answer
Python array index
Python