problem with Arabic diacritics

Wisdom logo Registration now open for RapidMiner Wisdom Americas | New Orleans | October 10-12, 2018   Learn More
Learner II yusuf_nazari
Learner II

problem with Arabic diacritics


there is a problem with "Arabic diacritics".

Rapidminer do not recogniz it as i know.

for example no result for a text like this :

أنا أدرُسُ في فَرع اللُّغة العَربيَّة

but if you emit the diacritics reach the result.

also Rapidminer not recognise أن إن as a two diffrent words.


please help me solve this problems.


Community Manager Community Manager
Community Manager

Re: problem with Arabic diacritics

hello @yusuf_nazari - I do not speak Arabic so unfortunately I can provide little help. However I do know that very often this is an encoding issue (UTF-8 vs ISO-8859-1, etc...). I would strongly suggest that you "play around" with your system encoding to see if this will improve things.



Scott Genzer
Senior Community Manager
RapidMiner, Inc.