Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.
UTF-16 vs System Coding in document processing?
huaiyanggongzi
Member Posts: 39 
Contributor II
I used the operator of "processing data from files" to perform some text mining tasks. There have 1800 short files, which are generally emails. I found that when I use "system coding", it works just fine. However, when I choose "UTF-16" coding, the warning message of "memory usage" will occur. How different is as "system coding" against "UTF-16 coding"? Are there any guidelines for choosing different coding schemes for document processing?
0
