RapidMiner

Rapidminer with Spark

Contributor

Rapidminer with Spark

I realize RapidMiner can be implemented with Spark in the Hadoop environment on a cluster but my question is can RadipMiner be implemented with Spark on a Standalone? If so, can you direct me to some information to help me with the implementation?

2 REPLIES
Highlighted
Moderator

Re: Rapidminer with Spark

Hi,

 

RapidMiner Radoop always requires Hadoop (or more specifically Hive, HDFS and YARN) underneath so it cannot work with pure Spark.

 

Best, Zoltan

______________________
Zoltan Prekopcsak, VP Engineering
Community Manager

Re: Rapidminer with Spark

I don't if that's been done yet but it might be feasible.

 

You could, in theory write your spark code and then have it kick off in RapidMiner using an Execute Program operator. You could pass commands, environment variables, and even some sort of throughput file into the operator that could in theory feed your pure spark program. 

 

Regards,
Thomas - Community Manager
LinkedIn: Thomas Ott