Options
Rapidminer with Spark
d_walden18863
Member Posts: 1 Contributor I
I realize RapidMiner can be implemented with Spark in the Hadoop environment on a cluster but my question is can RadipMiner be implemented with Spark on a Standalone? If so, can you direct me to some information to help me with the implementation?
Tagged:
0
Answers
Hi,
RapidMiner Radoop always requires Hadoop (or more specifically Hive, HDFS and YARN) underneath so it cannot work with pure Spark.
Best, Zoltan
I don't if that's been done yet but it might be feasible.
You could, in theory write your spark code and then have it kick off in RapidMiner using an Execute Program operator. You could pass commands, environment variables, and even some sort of throughput file into the operator that could in theory feed your pure spark program.