problem with Arabic diacritics

yusuf_nazariyusuf_nazari Member Posts: 2 Contributor I
edited December 2018 in Help

Hi

there is a problem with "Arabic diacritics".

Rapidminer do not recogniz it as i know.

for example no result for a text like this :

أنا أدرُسُ في فَرع اللُّغة العَربيَّة

but if you emit the diacritics reach the result.

also Rapidminer not recognise أن إن as a two diffrent words.

 

please help me solve this problems.

thanks

Answers

  • sgenzersgenzer Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 Community Manager

    hello @yusuf_nazari - I do not speak Arabic so unfortunately I can provide little help. However I do know that very often this is an encoding issue (UTF-8 vs ISO-8859-1, etc...). I would strongly suggest that you "play around" with your system encoding to see if this will improve things.


    Scott

     

Sign In or Register to comment.