"More than one performance evaluator in a cross validation"

Username

Hi,

is ist possible to use more than one operator for calculating performance values during cross validation? I want to use the ClassificationPerformance operator and a custom operator at the the same time to calculate several performance values.

Thanks

TobiasMalbrecht

Hi,

generally, this should be possible. Compare e.g. the following simple process:

<operator name="Root" class="Process" expanded="yes">
    <operator name="NominalExampleSetGenerator" class="NominalExampleSetGenerator">
    </operator>
    <operator name="XValidation" class="XValidation" expanded="yes">
        <operator name="DecisionTree" class="DecisionTree">
        </operator>
        <operator name="OperatorChain" class="OperatorChain" expanded="yes">
            <operator name="ModelApplier" class="ModelApplier">
                <list key="application_parameters">
                </list>
            </operator>
            <operator name="ClassificationPerformance" class="ClassificationPerformance">
                <parameter key="accuracy"	value="true"/>
                <list key="class_weights">
                </list>
                <parameter key="keep_example_set"	value="true"/>
            </operator>
            <operator name="ClassificationPerformance (2)" class="ClassificationPerformance">
                <list key="class_weights">
                </list>
                <parameter key="classification_error"	value="true"/>
            </operator>
        </operator>
    </operator>
</operator>

Regards,
Tobias