RapidMiner

Highlighted
Contributor II vipul_kumar
Contributor II

Start RapidMiner Server with multiple threads

Hello all

 

I have recently updated to Rapid Miner Server version 8.0 . I wanted to have more understanding on the multi threading aspect of RM Server. I have a process designed and saved in RM Server and have exposed API's. A lot of requests will be fired to this API and I want them to be processed parallely using multiple threads , not sequentially.

What is the mechanism used by Rapid Miner to handle multi threading or parallel processing. 

1 REPLY
RM Staff
RM Staff

Re: Start RapidMiner Server with multiple threads

Hi Kumal,

 

First have a look at these explanations of the new server structure:

 

https://community.rapidminer.com/t5/Community-Blog/RapidMiner-Server-8-0-will-be-out-soon-What-s-in-...

https://community.rapidminer.com/t5/Community-Blog/Get-ready-for-RapidMiner-Server-8-0/ba-p/42597

 

Then I will add in something: Parallelization is not new to Server 8.0. IF you have a Professional Licence there are a lot of operators that inherently work in parallel, and it was already possible in Server 7.x to run rapidminer processes at the same time. That said, the configuration that you need depends on which kind of parallelization you want.

 

Do you have computationally intensive processes with a lot of parameter optimization and feature selection? Then you probably need only one job agent with one job container.

 

Do you have multiple light processes (both on processor time and memory)? Then you probably can do better with one job agent and multiple job containers.

 

In my opinion it is not necessary to have more than one job agent per computer, unless you need redundancy. 

 

The configurations of RM Server 8.0 are a new and interesting topic!

 

 

Twitter Feed