RapidMiner

count syllables based on a predefined dictionary

SOLVED
Highlighted
Contributor II

count syllables based on a predefined dictionary

Hi community,

I want to count the syllables within in document. Therefore, I have a predefined dictionary (in excel) which contains 85000 words and its corresponding syllable values. 

Now I want to tokenize the document and and count the sylables within the document. As result I would to retrieve the number of syllables in the text. What operators do I need ?

I hope you can help me with that topic.

 

Best regards and thanks in advance,

 

Markus 

3 REPLIES
Elite III

Re: count syllables based on a predefined dictionary

Sure, this is actually pretty straightforward.  First tokenize the document using "Process Document" and then output the wordlist using the "Wordlist to Data" operator, which will give you an exampleset of the wordlist with the counts.  Then you should be able to join your syllable count in using "Join" (you'll join on the words/tokens) and use "Generate Attributes" to compute the product of the word count and the syllable count per word, and then use "Aggregate" to get the sum of that product.  And you should have total syllables in the document!

 

 

Brian T., Lindon Ventures - www.lindonventures.com
Analytics Consulting by Certified RapidMiner Analysts
Community Manager

Re: count syllables based on a predefined dictionary

Thanks, @Telcontar120, for that nice solution.  @markus_dressel - would you be willing to share your excel "syllable" sheet with the community?  It may be a resource that others find useful.

 

Scott

Contributor II

Re: count syllables based on a predefined dictionary