FPGrowth in spark and docker

video icon RapidMiner now offering a full suite of online training videos - free! Check it out
Contributor II HelloLola
Contributor II

FPGrowth in spark and docker

Hello Smiley Happy


I created a spark cluster on my pc via docker image, and I want to apply the FPGrowth on my data.


Can you give information about how to apply this algorithme from Rapidminer on my spark cluster, without using cloudera?


Thank you in advance.

RM Staff RM Staff
RM Staff

Re: FPGrowth in spark and docker



Spark is only supported when it is running on YARN. Radoop requires a Hadoop cluster that has YARN, HDFS and Hive on it.


But you can start such a cluster via docker similarly, you just need to find a Hadoop docker image that has Hive.