Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

7 votes140 views5 answers
.format python 3
Python
0 vote153 views1 answer
Random 2 n program in python
Python
2 votes175 views1 answer
Python class get attribute by name
Python
51 votes200 views6 answers
Reverse array
Python
0 vote145 views1 answer
Cvtcoloer opencv
Python
32 votes146 views1 answer
How to add a column to a pandas df
Python
0 vote201 views1 answer
Delay print in python
Python
0 vote156 views2 answers
Logout url
Python
25 votes369 views2 answers
Create new django app
Python Django
5 votes166 views2 answers
Tables in jinja template
Python