Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

0 vote232 views1 answer
Testdata['time'].dt.tz_localize(None)
Python
0 vote172 views2 answers
Create a list of pandas index
Python
0 vote254 views1 answer
Compress tarfile python
Python
0 vote155 views1 answer
PHP echo multiple lines example Using concatenation assignment operator
Python
0 vote159 views1 answer
Dalsports
Python
23 votes189 views3 answers
If any number python
Python
0 vote140 views2 answers
Convert pandas dataframe to spark dataframe
Python
1 vote156 views2 answers
Rank function in pandas
Python
1 vote127 views1 answer
Remove minutes and seconds from datetime python
Python
11 votes202 views5 answers
Change default python version mac
Python