Options

Remove the attribute tokenize?

WengkiWengki Member Posts: 2 Newbie
edited March 2022 in Help
How i can remove attribute after tokenize without filter stopwords?

Answers

  • Options
    WengkiWengki Member Posts: 2 Newbie
    Only "a" i want remove from attribute
  • Options
    kaymankayman Member Posts: 662 Unicorn
    You could set the minimum length for your token at for instance 2, this would drop all single letter attributes.
    You can achieve this with the 'filter tokens (by length)' operator
  • Options
    Telcontar120Telcontar120 Moderator, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,635 Unicorn
    You can also try Filter Tokens by Content or Filter Stopwords (Dictionary), which allows you to provide a file of specific words you want to eliminate.
    Brian T.
    Lindon Ventures 
    Data Science Consulting from Certified RapidMiner Experts
Sign In or Register to comment.