"Just upgraded to version 8. Error with Regularized Discriminant Analysis"

hughesfleming68hughesfleming68 Member Posts: 323 Unicorn

I am getting a Matrix is singular error with RDA in my process. Naive Bayes and other operators work fine. This is something new. This is a fresh install of 8.01 running on Windows 10 Pro. QDA fails but LDA works.

 

Best wishes to everyone at Rapidminer

 

Alex

0
0 votes

Released · Last Updated

8.1.0

Comments

  • sgenzersgenzer Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 Community Manager

    Hmm that sounds odd.  Moving this to bug reporting.  Can you please reply with your XML process and your data set?


    Scott

     

  • jczogallajczogalla Employee, Member Posts: 144 RM Engineering

    Hi Alex,

     

    first of all, happy new year! Could you share your RapidMiner log file also? This might help us to find out what went wrong.

     

    Jan

  • bhamornikbhamornik Member Posts: 7 RM Product Management
  • hughesfleming68hughesfleming68 Member Posts: 323 Unicorn

    Sorry for the delay,

     

    The error with RDA and QDA  occurs with windowing and sliding window validation. LDA works fine. The error does not show up in normal cross validation. Disabling the second set of operators connected to the muliply operater allows the process to finish. The error did not show up in 7.11 where I originally created the process.

     

    Kind regards,

     

    Alex

     

    <?xml version="1.0" encoding="UTF-8"?><process version="8.0.001">
    <context>
    <input/>
    <output/>
    <macros/>
    </context>
    <operator activated="true" class="process" compatibility="8.0.001" expanded="true" name="Process">
    <process expanded="true">
    <operator activated="true" class="generate_data" compatibility="8.0.001" expanded="true" height="68" name="Generate Data" width="90" x="112" y="289"/>
    <operator activated="true" class="set_role" compatibility="8.0.001" expanded="true" height="82" name="Set Role" width="90" x="246" y="289">
    <parameter key="attribute_name" value="label"/>
    <parameter key="target_role" value="label"/>
    <list key="set_additional_roles"/>
    </operator>
    <operator activated="true" class="series:classify_by_trend" compatibility="7.4.000" expanded="true" height="82" name="Classify by Trend" width="90" x="380" y="289"/>
    <operator activated="true" class="multiply" compatibility="8.0.001" expanded="true" height="103" name="Multiply" width="90" x="514" y="289"/>
    <operator activated="true" class="series:windowing" compatibility="7.4.000" expanded="true" height="82" name="Windowing" width="90" x="715" y="289">
    <parameter key="window_size" value="1"/>
    <parameter key="create_label" value="true"/>
    <parameter key="label_attribute" value="label"/>
    </operator>
    <operator activated="true" class="series:sliding_window_validation" compatibility="7.4.000" expanded="true" height="124" name="Validation" width="90" x="849" y="289">
    <parameter key="training_window_width" value="10"/>
    <parameter key="training_window_step_size" value="1"/>
    <parameter key="test_window_width" value="1"/>
    <process expanded="true">
    <operator activated="true" class="linear_discriminant_analysis" compatibility="8.0.001" expanded="true" height="82" name="LDA" width="90" x="294" y="34"/>
    <connect from_port="training" to_op="LDA" to_port="training set"/>
    <connect from_op="LDA" from_port="model" to_port="model"/>
    <portSpacing port="source_training" spacing="0"/>
    <portSpacing port="sink_model" spacing="0"/>
    <portSpacing port="sink_through 1" spacing="0"/>
    </process>
    <process expanded="true">
    <operator activated="true" class="apply_model" compatibility="8.0.001" expanded="true" height="82" name="Apply Model" width="90" x="179" y="85">
    <list key="application_parameters"/>
    </operator>
    <operator activated="true" class="performance_classification" compatibility="8.0.001" expanded="true" height="82" name="Performance" width="90" x="380" y="85">
    <list key="class_weights"/>
    </operator>
    <connect from_port="model" to_op="Apply Model" to_port="model"/>
    <connect from_port="test set" to_op="Apply Model" to_port="unlabelled data"/>
    <connect from_op="Apply Model" from_port="labelled data" to_op="Performance" to_port="labelled data"/>
    <connect from_op="Performance" from_port="performance" to_port="averagable 1"/>
    <portSpacing port="source_model" spacing="0"/>
    <portSpacing port="source_test set" spacing="0"/>
    <portSpacing port="source_through 1" spacing="0"/>
    <portSpacing port="sink_averagable 1" spacing="0"/>
    <portSpacing port="sink_averagable 2" spacing="0"/>
    </process>
    </operator>
    <operator activated="true" class="series:windowing" compatibility="7.4.000" expanded="true" height="82" name="Windowing (2)" width="90" x="715" y="442">
    <parameter key="window_size" value="1"/>
    <parameter key="create_label" value="true"/>
    <parameter key="label_attribute" value="label"/>
    </operator>
    <operator activated="true" class="series:sliding_window_validation" compatibility="7.4.000" expanded="true" height="124" name="Validation (2)" width="90" x="849" y="442">
    <parameter key="training_window_width" value="10"/>
    <parameter key="training_window_step_size" value="1"/>
    <parameter key="test_window_width" value="1"/>
    <process expanded="true">
    <operator activated="true" class="quadratic_discriminant_analysis" compatibility="8.0.001" expanded="true" height="82" name="QDA" width="90" x="294" y="34"/>
    <connect from_port="training" to_op="QDA" to_port="training set"/>
    <connect from_op="QDA" from_port="model" to_port="model"/>
    <portSpacing port="source_training" spacing="0"/>
    <portSpacing port="sink_model" spacing="0"/>
    <portSpacing port="sink_through 1" spacing="0"/>
    </process>
    <process expanded="true">
    <operator activated="true" class="apply_model" compatibility="8.0.001" expanded="true" height="82" name="Apply Model (2)" width="90" x="179" y="85">
    <list key="application_parameters"/>
    </operator>
    <operator activated="true" class="performance_classification" compatibility="8.0.001" expanded="true" height="82" name="Performance (2)" width="90" x="380" y="85">
    <list key="class_weights"/>
    </operator>
    <connect from_port="model" to_op="Apply Model (2)" to_port="model"/>
    <connect from_port="test set" to_op="Apply Model (2)" to_port="unlabelled data"/>
    <connect from_op="Apply Model (2)" from_port="labelled data" to_op="Performance (2)" to_port="labelled data"/>
    <connect from_op="Performance (2)" from_port="performance" to_port="averagable 1"/>
    <portSpacing port="source_model" spacing="0"/>
    <portSpacing port="source_test set" spacing="0"/>
    <portSpacing port="source_through 1" spacing="0"/>
    <portSpacing port="sink_averagable 1" spacing="0"/>
    <portSpacing port="sink_averagable 2" spacing="0"/>
    </process>
    </operator>
    <connect from_op="Generate Data" from_port="output" to_op="Set Role" to_port="example set input"/>
    <connect from_op="Set Role" from_port="example set output" to_op="Classify by Trend" to_port="example set input"/>
    <connect from_op="Classify by Trend" from_port="example set output" to_op="Multiply" to_port="input"/>
    <connect from_op="Multiply" from_port="output 1" to_op="Windowing" to_port="example set input"/>
    <connect from_op="Multiply" from_port="output 2" to_op="Windowing (2)" to_port="example set input"/>
    <connect from_op="Windowing" from_port="example set output" to_op="Validation" to_port="training"/>
    <connect from_op="Validation" from_port="training" to_port="result 1"/>
    <connect from_op="Windowing (2)" from_port="example set output" to_op="Validation (2)" to_port="training"/>
    <connect from_op="Validation (2)" from_port="training" to_port="result 2"/>
    <portSpacing port="source_input 1" spacing="0"/>
    <portSpacing port="sink_result 1" spacing="0"/>
    <portSpacing port="sink_result 2" spacing="0"/>
    <portSpacing port="sink_result 3" spacing="0"/>
    </process>
    </operator>
    </process>
  • bhamornikbhamornik Member Posts: 7 RM Product Management

    Thank you. now the dev team starts to investigate this!

  • bhamornikbhamornik Member Posts: 7 RM Product Management

    The fix is coming with RapidMiner 8.1.

  • hughesfleming68hughesfleming68 Member Posts: 323 Unicorn

    Thanks, I can confirm that it is working properly in 8.1 beta. Fantastic!!!!

     

    Kindest regards,

     

    Alex

Sign In or Register to comment.