Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

1 vote300 views1 answer
Add help text in Django model forms
Python Django
16 votes258 views2 answers
Auto clicker in python
Python
1 vote193 views1 answer
Python install pandas for linux
Python
6 votes300 views1 answer
Button in flask
Python Flask
0 vote320 views1 answer
How to send Email verification codes to user in Firebase using Python
Python
-2 votes235 views1 answer
How to get data from django session
Python Django
1 vote194 views2 answers
Python detect internet connection
Python
0 vote231 views1 answer
Django charfield force lowercase
Python
1 vote445 views1 answer
Check datatype python
Python
10 votes204 views1 answer
Pandas select columns where value is true
Python