Options

Fuzzy Match of Strings

Member Posts: 6 Contributor II
edited December 2018 in Help

I'm trying to work through a problem in Rapidminer. I'm trying to find approximate matches of strings of one dataset in another dataset.  Is there a way we can perform a fuzzy match on a string in rapidminer? Any help will be appreciated!

• Options
Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,517 RM Data Scientist

Hi,

there is an operator to calculate the Levenshtein Distance in operator toolbox.

Best,

Martin

- Sr. Director Data Solutions, Altair RapidMiner -
Dortmund, Germany
• Options
Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 Community Manager

hi @prachi138 - yes I'd recommend trying the Levenshtein Distance operator as a good starting point. If you can post some examples of what you're doing, that can help us give you more guidance.

FYI I'm moving this to the Studio help forum.

SG

• Options
Member Posts: 6 Contributor II

Hi,

Thank you for your prompt reply! I'm trying to use the Levenstein distance in Rapidminer. However, I see that the second port requires a document input. On using Data to document, I have the IOObject Collection generated which is not accepted as input. Can you let me know which exact operator I should be using for 'Process documents' operator? Thank you once again!

• Options
Moderator, RapidMiner Certified Analyst, Member Posts: 291 Unicorn

Which operator you are talking about?

'Generate Levenstein Distance' operator has only one input port, which is an example set. Then you need to 1st and 2nd string attributes to compare, and the operator will calculate distance for all examples, making it a separate attribute in the output dataset:

• Options
Member Posts: 6 Contributor II

Is it possible to perform a many to many comparison across datasets for the fuzzy matching operator? Basically have 5 columns of 5 different data sources and see where it matches? Currently, I’m comparing 2 attributes of 2 different data sources at once. Looking forward to your inputs.

• Options
Member Posts: 5 Contributor II
Hi Prachi, I have a similar case were I try to compare different documents with each other to extract entities. May I see your final result (screenshot)?