Mahout clustering test failing on connectivity full test

mikedkellymikedkelly Member Posts: 5 Contributor II
edited November 2018 in Help

I am running RapidMiner Studio 7.2 and connecting to a stock Cloudera QuickStart 5.7 VM with 4 CPUs and 24GB of RAM. When I run the connectivity full test, it fails on the Mahout clustering job. It looks like the error involves a java heap allocation, but I am not sure which one I should change. I have attached the test logs and added the map reduce log into the zip file. Does anyone have any idea what is going on?

 

Thanks!

Best Answer

  • ztothztoth Member Posts: 5 Contributor II
    Solution Accepted

    Hi,

    the Mahout jobs usually need more memory for the Map tasks as the Quickstart VM's default configuration. Try to set 

    mapreduce.map.java.opts=-Xmx256m

    as an Advanced Hadoop parameter.

Answers

  • mikedkellymikedkelly Member Posts: 5 Contributor II

    Thanks! That also fixed the Pig script test, which was also failing. I am completing the entire test now.

     

Sign In or Register to comment.