Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.

Run RapidMiner across cluster ??

RhmanigRhmanig Member Posts: 9 Contributor II
Hi everyone,

I have Rapidminer installed on a node of a cluster and need to distribute the process across nodes. Does RapidMiner support this? Is there anyway to do this on RapidMiner?

I know it has multi threading feature but that is not what I am after, at least not yet.

Or
if I need to write script to distribute jobs across nodes, can someone please help me to write one.

Thanks

Answers

  • Marco_BoeckMarco_Boeck Administrator, Moderator, Employee, Member, University Professor Posts: 1,996 RM Engineering
    Hi,

    a single process cannot be distributed unless you are using RapidMiner Radoop or RapidMiner Streams which utilize frameworks designed for working in a clustered environment.

    If you want to distribute multiple long running processes to different machines you'd have to do it manually by scheduling them on different RapidMiner Server instances. A Server will only execute process on its own machine so multiple servers are a necessity then.

    Regards,
    Marco
Sign In or Register to comment.