The Altair Community is migrating to a new platform to provide a better experience for you. The RapidMiner Community will merge with the Altair Community at the same time. In preparation for the migration, both communities are on read-only mode from July 15th - July 24th, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here.

"Truncated words when using WVTool (Text tool)"

drstevekramerdrstevekramer Member Posts: 7 Contributor II
edited May 2019 in Help
I have been using the default WVToolConfiguration (with no stemmer requested explicitly). Unfortunately, when I create a WVTWordList from a number of input documents using createWordList(WVTInputList input, WVTConfiguration config, java.util.List initialWords, boolean addWords), quite a few of the words end up being truncated when I iterate through the WVTWordList. For example, "time" -> "tim" and "country" -> "countr".

Is there a reason that this is happening with the sample, standard configuration? I did not explicitly set any stemmer or tokenizer options.

Thanks in advance for your help.

Sign In or Register to comment.