count syllables based on a predefined dictionary

markus_dresselmarkus_dressel Member Posts: 5 Contributor I
edited November 30 in Help

Hi community,

I want to count the syllables within in document. Therefore, I have a predefined dictionary (in excel) which contains 85000 words and its corresponding syllable values. 

Now I want to tokenize the document and and count the sylables within the document. As result I would to retrieve the number of syllables in the text. What operators do I need ?

I hope you can help me with that topic.

 

Best regards and thanks in advance,

 

Markus 

Tagged:

Best Answer

  • Telcontar120Telcontar120 Posts: 869   Unicorn
    Solution Accepted

    Sure, this is actually pretty straightforward.  First tokenize the document using "Process Document" and then output the wordlist using the "Wordlist to Data" operator, which will give you an exampleset of the wordlist with the counts.  Then you should be able to join your syllable count in using "Join" (you'll join on the words/tokens) and use "Generate Attributes" to compute the product of the word count and the syllable count per word, and then use "Aggregate" to get the sum of that product.  And you should have total syllables in the document!

     

     

    Brian T.
    Lindon Ventures 
    Data Science Consulting from Certified RapidMiner Experts

Answers

  • sgenzersgenzer Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager Posts: 1,867  Community Manager

    Thanks, @Telcontar120, for that nice solution.  @markus_dressel - would you be willing to share your excel "syllable" sheet with the community?  It may be a resource that others find useful.

     

    Scott

  • markus_dresselmarkus_dressel Member Posts: 5 Contributor I

    That was exactly the solution I was looking for. It worked perfectly. Thank you so much @Telcontar120

     

    @sgenzer I use the Business dictionary provided by Lougrhan&McDonald. 

    The list and a comprehensive explanation can be found here:

     

    Thank you so much for the help,

     

    Best regards,

     

    Markus 

    sgenzerThomas_Ott
Sign In or Register to comment.