Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.

n-Grams with a length of 3-6

KathiKathi Member Posts: 11 Learner II
in Help
Hi everyone, 

I am currently using the n-Grams operator. If I set the length to 6, all n-Grams will be displayed with a word count of 1-6. I just want to see the n-Grams with a length of 3-6 words. Is that possible?

Thanks!

Best Answer

  • lionelderkrikorlionelderkrikor RapidMiner Certified Analyst, Member Posts: 1,195 Unicorn
    Solution Accepted
    Hi @Kathi

    Nice challenge ! 

    Yes, it is possible. You have to duplicate your text processing using : 

    for the first : max length = 6
    for the second : max length = 2

    then Transpose the 2 resulting example sets

    then use a Set Minus operator to keep only the attribute with  3< max length <6

    finally (re)Transpose the final example set.

    The process is in attached file.

    Regards,

    Lionel

Answers

  • kaymankayman Member Posts: 662 Unicorn
    Use filter tokens by content, select match and use a regex like ^.*?_.*?_.*
    This will filter on all n-grams having at least 2 underscores, so matching 3 words or more
  • KathiKathi Member Posts: 11 Learner II
    Hi,

    I first tried the set-minus-process, it's working and looks fantastic! Thank you both!

    Regards,
    Kathi

Sign In or Register to comment.