Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.

[SOLVED] poor(?) CPU utilization

fritmorefritmore Member Posts: 90 Contributor II
edited November 2018 in Help
hi
on a HPC server a RM process takes only a limited fixed amount of CPU time instead of utilizing all available CPU as if RM hunger for resources was capped?
Why is that?
ty

Answers

  • fritmorefritmore Member Posts: 90 Contributor II
    Dear boys and girls

    that was not a metaphysical or rhetorical question.

    Please dont be shy and shoot, answer, discuss.....

    I think it is a weird RM behaviour and it is a problem.

    ty
    fritmore wrote:

    hi
    on a HPC server a RM process takes only a limited fixed amount of CPU time instead of utilizing all available CPU as if RM hunger for resources was capped?
    Why is that?
    ty
  • MariusHelfMariusHelf RapidMiner Certified Expert, Member Posts: 1,869 Unicorn
    Hi,

    until now, the parallelization of RapidMiner has only limited capacity. We plan a major rework for the next major release (i.e. RapidMiner 6). Until then, you gain more if you start more than one instance of RapidMiner to handle several problems in parallel.

    Best,
    Marius
  • fritmorefritmore Member Posts: 90 Contributor II
    Hi Marius

    this happens regardless whether  any parallelization features are on or off.
    The CPU utilization is simply capped for any type of operator or parallel settings for RM.

    Sure one can run multiple jobs but this is not a solution.

    f
    Marius wrote:

    Hi,

    until now, the parallelization of RapidMiner has only limited capacity. We plan a major rework for the next major release (i.e. RapidMiner 6). Until then, you gain more if you start more than one instance of RapidMiner to handle several problems in parallel.

    Best,
    Marius
  • MariusHelfMariusHelf RapidMiner Certified Expert, Member Posts: 1,869 Unicorn
    Yes, you are completely right, and as I said above we are planning true parallelization of all RapidMiner processes for the next major release. Until then we all have to live with the limited parallelization support of the current version.

    Best,
    Marius
  • fritmorefritmore Member Posts: 90 Contributor II
    ok thx
Sign In or Register to comment.