The Altair Community is migrating to a new platform to provide a better experience for you. The RapidMiner Community will merge with the Altair Community at the same time. In preparation for the migration, both communities are on read-only mode from July 15th - July 24th, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here.
Options

Problem with Nested Averages

figfig Member Posts: 4 Contributor I
edited November 2018 in Help
Hi,

I am trying to do repeated cross validation (e.g. 10x10 = 10 CV runs with 10 folds each run) and use the average of all the runs as my performance measure.  The problem is that the averages don't seem to be computed correctly.

I've attached the XML for a toy example, using 2x2 cross validation.  If you run it and look at the log you'll see that the average of the four individual values is 0.291 (as correctly reported in the mikro average) but the makro average has a different (incorrect) value and it is this value that is reported as the overall performance.

Any help on how to work around this issue would be highly appreciated.

Thanks,
A



[attachment deleted by admin]
Sign In or Register to comment.