Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

2 votes176 views1 answer
Count the number of rows in a database table in Django
Python Django
0 vote149 views1 answer
How to retrieve previous messages with discord.py
Python
3 votes137 views1 answer
N random numbers python
Python
3 votes138 views2 answers
Draw bounding box on image python opencv
Python
1 vote124 views1 answer
ValueError: cannot mask with array containing NA / NaN values
Python
0 vote95 views1 answer
Python site-packages pyspark
Python
0 vote151 views2 answers
Quotation marks n string
Python
0 vote126 views1 answer
Discord.py how get user input
Python
3 votes144 views1 answer
Python Copy Lists
Python
0 vote137 views1 answer
Uninstalling/removing a package is very easy with pip:
Python