"Filter minimum occurence of token?"

erocoarerocoar Member Posts: 6 Contributor II
edited June 2019 in Help

I am still in the process of setting up my text mining / analyzing process :) Since you can filter your words by minimum characters, maximum characters etc. I had the question of whether you can also filter your document; removing all words/tokens that occur >x times?

Thanks in advance!!  :D


  • Options
    MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,520 RM Data Scientist
    Hi erocoar,

    sure. In Process documents is a pruning option. This can be set to absolute.

    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • Options
    cc4699cc4699 Member Posts: 6 Contributor I

    Prune method on the "Process Documents" is only filtering the number of document occurrences. How can I filter by "Total Occurrences" ?



Sign In or Register to comment.