"Filter minimum occurence of token?"

erocoarerocoar Member Posts: 6 Contributor II
edited June 2019 in Help
Hey,

I am still in the process of setting up my text mining / analyzing process :) Since you can filter your words by minimum characters, maximum characters etc. I had the question of whether you can also filter your document; removing all words/tokens that occur >x times?

Thanks in advance!!  :D
Tagged:

Answers

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,483 RM Data Scientist
    Hi erocoar,

    sure. In Process documents is a pruning option. This can be set to absolute.

    ~Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • cc4699cc4699 Member Posts: 6 Contributor I

    Prune method on the "Process Documents" is only filtering the number of document occurrences. How can I filter by "Total Occurrences" ?

     

    Thanks

Sign In or Register to comment.