Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.

"Text Mining - Basic Question"

ssk1974ssk1974 Member Posts: 11 Contributor II
edited June 2019 in Help
Hi,

I have 42 text files, each text file is a chapter from a novel. I am trying to visualize frequently occurring words in each chapter. How to approach this?

Also what other interesting problems I can solve with that dataset.

Thank you for the time and help.
Tagged:

Answers

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,529 RM Data Scientist
    Hello ssk,

    you would simply read the files using a Read Document operator and then process it. In the end it's about the tokenize operator which counts the number of words.

    My friend and colleagure Marius pointed me to this tutorial for text mining: http://vancouverdata.blogspot.de/2010/11/text-analytics-with-rapidminer-loading.html this should really help you.

    If you have further questions, just post them here :)

    Best,

    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • ssk1974ssk1974 Member Posts: 11 Contributor II
    Hi Martin,

    Thank you for the help.

    I have another question, I want to create a word cloud and show the frequently used word in it. How can I do that. The list of words from my 4 set of documents has 10,000 words in it.

    Thank you for the time and help.
  • MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,529 RM Data Scientist
    you mean some word cloud where the size of the word represents the frequency?

    If so,  I am not aware of any built in functionality. I guess it can be done using some javascript api.
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,529 RM Data Scientist
    I did a quick google search

    I think it's easy to use this https://github.com/jasondavies/d3-cloud on rm sever.. Is this what you ment?
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • ssk1974ssk1974 Member Posts: 11 Contributor II
    Thanks Martin, I needed to upload a file and tagcrowd.com, let me do that.
  • MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,529 RM Data Scientist
    I've never used this webpage. Can't you just save your words as a tsv and upload it? Or should it be done automatically?
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
Sign In or Register to comment.