Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

0 vote218 views1 answer
Tab in python
Python
3 votes174 views2 answers
How to change role permissions in discord.py
Python
0 vote172 views1 answer
Python - caéculate the average based on the level of a second column in a df
Python
7 votes218 views5 answers
Python get parent directory
Python
2 votes200 views3 answers
Scatter plot actual vs predicted python
Python
94 votes167 views5 answers
How to rename columns using panda object
Python
3 votes187 views1 answer
No module named 'django.core.urlresolvers'
Python
0 vote202 views1 answer
Inicair venv python
Python
19 votes200 views6 answers
How to import turtle in python
Python
0 vote173 views1 answer
Use mongo replica set python
Python