Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

2 votes106 views1 answer
Pip install on different version of python
Python
38 votes99 views3 answers
Matplotlib window size
Python
0 vote112 views1 answer
Check if a date is reached django
Python
0 vote115 views1 answer
Python keyboard key codes
Python
0 vote109 views1 answer
Lineplot in plt
Python
9 votes82 views20 answers
Tkinter python
Python
0 vote111 views1 answer
Subplots whitespace
Python
0 vote112 views1 answer
Django sign up
Python
1 vote105 views1 answer
How to find magnitude of complex number in python
Python
0 vote129 views1 answer
Pandas isin another dataframe column
Python