Python(十):文本相似度计算

test1 = 'In many applications it is useful to record not only the fingerprints of a document,but also the position of the fingerprints in the document. For example, we needpositional information to show the matching substrings in a user interface. Anefficient implementation of winnowing also needs to retain the position of the mostrecently selected fingerprint. Figure2(f) shows the set of [fingerprint, position] pairsfor this example (the first position is numbered 0). To avoid the notationalcomplexity of indexing all hashes with their position in the global seguence ofhashes of k-grams of a document, we suppress most explicit references to theposition of k-grams in documents in our presentation.'

test2 = '''An efficient implementation of winnowing needs to keep the pos of most recentlyselected fingerprint, too. To avoid the complexity of indexing hashes with positionin global sequence of hashes of k-grams in a document. It is very useful in manyapplications to not only record the fingerprints of documents, but also to recordthe fingerprints. For example, if we need positions to show the matching substringsin a user's interface.'''