Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.
Text Mining - Document Similarity/Clustering
sangeet171188
Member Posts: 8 Contributor II
I have a 100K text records, each have a problem description. now want to achieve :
1) Take a count of "Similar" looking problem description. (How to achieve this)
2) Main roadblocker is that it takes a lifetime to run process.
Steps :
Data import-->select attributes-->Process document to Data(tokenize.stopwords,n grams)-->K means/DBSCAN
How can I optimize this to run faster.
I can make Process documen to Data to run faster, but the Clustering takes away more than a day to run.
I am using community verison 7.5. Please suggest how can I decrease run time. And will enterprise version solve the problem ?
Tagged:
0
Answers
Please don't duplicate your posts. This is a copy of http://community.rapidminer.com/t5/RapidMiner-Studio-Forum/Text-Mining-Document-Similarity-Clustering/m-p/39572.
This thread will be closed/deleted.