real-time data

turicumturicum Member Posts: 15  Maven
edited November 2018 in Help
Hi everybody,

is it possible to use rapidminer to process a real-time data-stream, possibly by wrapping it into an application and importing the models as XML?

Thanks!

Cheers,
Alex

Answers

  • turicumturicum Member Posts: 15  Maven
    I reply my own question.. from the tutorial of rm v.4.6 it seems - in principle - possible. Is that true?

    Thanks!

    Alex
  • landland RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 2,525   Unicorn
    Hi Alex,
    this can be done in principle. Although I would not build on any java program when you have hard real time constraints (think of Garbage Collection or stuff like that), you could use RapidMiner in an online fashion. Especially if it is only to apply some pretrained models, this should be doable if you have sufficient computational power to cope with the mass of data coming in. Regardless of your computer, you have to be aware, that applying such a complex computation like model application adds always some delay in the processing of your data...

    In fact we are using RapidMiner in this fashion ourself: We provide an Webservice classifying arbitrary customer data that must be able to cope with several hundred thousand classifications per day on a mid size server and it works quite well.

    Greetings,
      Sebastian
  • turicumturicum Member Posts: 15  Maven
    Hi Sebastian,

    thank you for your reply. CPU power and latency are two of the main issues in real-time processing and it's good to know that RM is already being used in production for this kind of applications.

    Cheers,
    Alex
Sign In or Register to comment.