RapidMiner

RapidMiner

Performance regression - ANN issue

Contributor

Performance regression - ANN issue

Hi,

 

I built a simple regression model (5 independent variables) and computed the predicted values to estimate performance indicators (mean squared error, absolute error and R2). Afterwards, I used rapidminer to built a neural net (with cross validation to optimize the parameters). The issue is with the performance results when applying the best neural net to all dataset in order to compare with the regression. I got a average squared error of 10.1379 with the regression and 11.749 +/- 15.630 with the neural net, but the squared correlation of the regression is only 0.732 and the rapidminer output for the neural net is 0.814. This doesn't make sense to me, could anyone help? Am I comparing different things?

 

Thanks in advance,

 

Vitor Sousa 

1 REPLY
Community Manager

Re: Performance regression - ANN issue

Did you use a Cross Validation for the LR model? I ask because of the way Cross Validation works (i.e. makes 10 different models and averages them) and it sounds like the LR was just straight on the data. 

Regards,
T-Bone
Twitter: @neuralmarket