"Dictionary based analysis"

mlctumlctu Member Posts: 1 Contributor I
edited May 2019 in Help
Hi!

Is there a way to use RapidMiner to perform dictionary-based analysis of document collections?

In particular I'm interested in term frequency and other statistics to be applied to term occurrences in the documents, where the terms of interest are provided by the user, already classified in one or more user-defined category lists (dictionaries).

Thanks for your help!
Giulio

Answers

  • landland RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 2,531 Unicorn
    Hi,
    yes this is easily possible with the Text Processing Extension. You can simply use the Dictionary based filtering to remove all uninteresting words.

    Another way around would be to first count all words and then postprocess this word list using the "WordList to Data" operator.

    Greetings,
      Sebastian
Sign In or Register to comment.