Options

"Text Mining - Basic Question"

ssk1974ssk1974 Member Posts: 11 Contributor II
edited June 2019 in Help
Hi,

I have 42 text files, each text file is a chapter from a novel. I am trying to visualize frequently occurring words in each chapter. How to approach this?

Also what other interesting problems I can solve with that dataset.

Thank you for the time and help.
Tagged:

Answers

  • Options
    MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,507 RM Data Scientist
    Hello ssk,

    you would simply read the files using a Read Document operator and then process it. In the end it's about the tokenize operator which counts the number of words.

    My friend and colleagure Marius pointed me to this tutorial for text mining: http://vancouverdata.blogspot.de/2010/11/text-analytics-with-rapidminer-loading.html this should really help you.

    If you have further questions, just post them here :)

    Best,

    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • Options
    ssk1974ssk1974 Member Posts: 11 Contributor II
    Hi Martin,

    Thank you for the help.

    I have another question, I want to create a word cloud and show the frequently used word in it. How can I do that. The list of words from my 4 set of documents has 10,000 words in it.

    Thank you for the time and help.
  • Options
    MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,507 RM Data Scientist
    you mean some word cloud where the size of the word represents the frequency?

    If so,  I am not aware of any built in functionality. I guess it can be done using some javascript api.
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • Options
    MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,507 RM Data Scientist
    I did a quick google search

    I think it's easy to use this https://github.com/jasondavies/d3-cloud on rm sever.. Is this what you ment?
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • Options
    ssk1974ssk1974 Member Posts: 11 Contributor II
    Thanks Martin, I needed to upload a file and tagcrowd.com, let me do that.
  • Options
    MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,507 RM Data Scientist
    I've never used this webpage. Can't you just save your words as a tsv and upload it? Or should it be done automatically?
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
Sign In or Register to comment.