Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

1 vote201 views1 answer
Two elements at a time in list comprehension
Python
0 vote198 views1 answer
How to crash a pc using python
Python
6 votes178 views2 answers
Imshow grayscale
Python
1 vote197 views2 answers
Index to datetime pandas
Python
1 vote213 views2 answers
Python numpy delete element from array
Python
50 votes233 views4 answers
How to read files in python with
Python
0 vote193 views1 answer
Long to_bytes python how to use it
Python
0 vote231 views2 answers
Call javascript function flask
Python Flask
3 votes189 views1 answer
Python open each file in directory
Python
0 vote237 views1 answer
Created by and updated by in django
Python Django