Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.
Too many files open in system (WordNet)
Hello,
I'm using the WordNet extension and dictionary for sentiment analysis. When I start the proces I receive an I/O error:
"Too many files open in system". See screenshot. Does anybody knows how to solve this?
I'm working with RapidMiner 8.1, WordNet 3.0 files and MacOS High Sierrra.
Thank you!
Hugo
0
Answers
It's been a while since I used that extension but if I remember correctly, that error is probably related to not having enough memory. There was a workaround to this that @hhomburg devised that used the Remember and Recall operators.
Hi,
the problem is not that caused by memory limitations. The problem is that you open the file every time the inner process is executed. There's a limit in the operating system for the maximum amount of opened files and you run into that.
The solution is as Thomas described: Not opening it more than once. You can open that on the outer process, so that it is just once opened, Remember it then (but before the Process Documents is started) and recall in the Process Documents loop without removing from store. If you find that ugly, you can install the Jackhammer Extension and but a Cache operator around the Open Wordnet operator. Should then be executed only once, too.
Greetings,
Sebastian
thanks
Elaine