Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

3 votes111 views1 answer
Python set return type
Python
22 votes104 views7 answers
Remove special characters from string python
Python
0 vote134 views1 answer
Read a number Print Fibonacci sequence up to the given number Python
Python
9 votes120 views6 answers
Module in python
Python
15 votes134 views3 answers
Python get input from console
Python
0 vote128 views1 answer
Set page title name and favicon in streamlit
Python
2 votes143 views1 answer
Pandas remame a no name column
Python
0 vote137 views1 answer
Python string: .replace()
Python
0 vote117 views1 answer
Convert list to dataset python
Python
0 vote165 views1 answer
Django generate openapi schema command line
Python Django