Options

Computantional Grid Integration

radoneradone RapidMiner Certified Expert, Member Posts: 74 Guru
edited June 2019 in Help
In my opinion a very interesting improvement to RM would be an possibility to integrate it with a computational grid platform (e.g. also open-source gridgain, http://www.gridgain.com/). Thus experimenting with 10-fold cross-validation can be 10 times faster.

Answers

  • Options
    fischerfischer Member Posts: 439 Maven
    Hi Radone,

    that is true. Currently, we have multi core support in the enterprise edition (http://rapid-i.com/content/view/113/136/lang,en/). This will speed up the cross validation as long as you own enough cores. :-)

    The grid support is a tricky thing, both from the programming point of view and from the user's point of view. You face lots of issues like serialization, deciding what tasks gain from distributing, etc. We will consider it in the future, but currently we are going with local parellelization.



    Best,
    Simon
Sign In or Register to comment.