How to compare which similarity measurement gives better results?

Best Answer

• Options

  Telcontar120 Moderator, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,635 Unicorn

  December 2018 Solution Accepted

  I don't think there is a simple answer to this question.  Each of these distance metrics measures distance in a slightly different way.  You can read about the exact calculations on wikipedia or other sites. You need to select which one corresponds most closely to the way that you are thinking about similarity between your texts.  In a supervised learning problem you can make this parameter subject to optimization and determine the "best" answer based on overall model performance, but if you are simply computing similarity for its own sake, then there is no way for RapidMiner to tell you which one is the "best" for that comparison.
  
  

  Brian T.
  Lindon Ventures 
  Data Science Consulting from Certified RapidMiner Experts

  5