Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

0 vote103 views2 answers
MultiValueDictKeyError django
Python
-1 vote110 views1 answer
Multiple assignment python
Python
0 vote110 views1 answer
Install python 3.6 ubuntu 16.04
Python
10 votes107 views5 answers
Progress bar in cmd python
Python
0 vote116 views1 answer
Pandas row printed horizontally
Python
18 votes121 views5 answers
Plot histogram python
Python
0 vote142 views2 answers
Flask abort
Python Flask
0 vote102 views1 answer
Python cv2 unblur
Python
2 votes110 views2 answers
Invert y axis python
Python
1 vote95 views1 answer
Get attribute in selenium python
Python