Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.

"Truncated words when using WVTool (Text tool)"

drstevekramerdrstevekramer Member Posts: 7 Contributor II
edited May 2019 in Help
I have been using the default WVToolConfiguration (with no stemmer requested explicitly). Unfortunately, when I create a WVTWordList from a number of input documents using createWordList(WVTInputList input, WVTConfiguration config, java.util.List initialWords, boolean addWords), quite a few of the words end up being truncated when I iterate through the WVTWordList. For example, "time" -> "tim" and "country" -> "countr".

Is there a reason that this is happening with the sample, standard configuration? I did not explicitly set any stemmer or tokenizer options.

Thanks in advance for your help.

Cheers,
Steve
Sign In or Register to comment.