The Altair Community is migrating to a new platform to provide a better experience for you. The RapidMiner Community will merge with the Altair Community at the same time. In preparation for the migration, both communities are on read-only mode from July 15th - July 24th, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here.
Options

Out of Memory....

smackdown33smackdown33 Member Posts: 19 Maven
edited November 2018 in Help
Hi, newbie to Rapidminer here and suffering from out of memory issues.

I have an .arff file with 1300 rows of 7200 attributes but everytime i try to load the file to start a process im faced with an out of memory issue.

My current setup is,

Rapidminer 64
Windows XP 64
Intel I7 Quad Core
6Gb ram

So I thought it would easily be able to handle this.

If this issue has already been resolved somewhere else, please point me in the right direction otherwise a little bit of help at this stage would go a long way and i would be much appreciative.

Thanks in advance

Answers

  • Options
    haddockhaddock Member Posts: 849 Maven
    Hi there,

    If I load such an arff into RM on XP 64, but with 12 GB, my memory manager ( Process Lasso - top stuff ) shows 30% memory used. That's with nothing else running. If I load RM, but not the arff, that goes down to 12%. So I'm equally puzzled as to why your 6 GB isn't enough.
  • Options
    landland RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 2,531 Unicorn
    Hi,
    the problem is not the data but the FeatureSelection he wants to perform. But we have another topic on that, where I already posted an answer...

    Greetings,
      Sebastian
Sign In or Register to comment.