Limited instalation and errors with Direct Marketing template

mlubicz

One of my students has the following problem:

- RM 9.2. was installed on WIN10 64

- once he tried to run Direct Marketing template an error occured as illustrated with the screen enclosed

- logging off and on made no results, however he also realized that the instalation is reduced: you can see on the screenshot that not all read operators are available, also AutoModel is not available

- he reinstalled RM twice with no improvement: not all operators are available, DirectMarketing doesn't work (the CrossValidation operator is RED and HelpMeSolvetheProblem results with the second message enclosed.

Could anyone give some advice?

varunm1

Hello @mlubicz

It worked on my 9.2.001. I see from the screenshots that the cross-validation operator is not active. Can you ask him to try the below code? Also, can you ask him to check (Search) if there is a cross-validation operator in the operator's window. Cross validation is a default operator and there is no extension as far as I know.

<?xml version="1.0" encoding="UTF-8"?><process version="9.2.001">
  <context>
    <input/>
    <output/>
    <macros>
      <macro>
        <key>label</key>
        <value>Response</value>
      </macro>
      <macro>
        <key>label_positive_class</key>
        <value>yes</value>
      </macro>
    </macros>
  </context>
  <operator activated="true" class="process" compatibility="9.2.001" expanded="true" name="Process" origin="GENERATED_SAMPLE">
    <parameter key="logverbosity" value="init"/>
    <parameter key="random_seed" value="2001"/>
    <parameter key="send_mail" value="never"/>
    <parameter key="notification_email" value=""/>
    <parameter key="process_duration_for_mail" value="30"/>
    <parameter key="encoding" value="SYSTEM"/>
    <process expanded="true">
      <operator activated="true" class="retrieve" compatibility="9.2.001" expanded="true" height="68" name="Load Past Data" origin="GENERATED_SAMPLE" width="90" x="45" y="187">
        <parameter key="repository_entry" value="//Samples/Templates/Direct Marketing/Past Campaign Data"/>
      </operator>
      <operator activated="true" class="select_attributes" compatibility="9.2.001" expanded="true" height="82" name="Remove ID-like Column" origin="GENERATED_SAMPLE" width="90" x="179" y="187">
        <parameter key="attribute_filter_type" value="single"/>
        <parameter key="attribute" value="Name"/>
        <parameter key="attributes" value=""/>
        <parameter key="use_except_expression" value="false"/>
        <parameter key="value_type" value="attribute_value"/>
        <parameter key="use_value_type_exception" value="false"/>
        <parameter key="except_value_type" value="time"/>
        <parameter key="block_type" value="attribute_block"/>
        <parameter key="use_block_type_exception" value="false"/>
        <parameter key="except_block_type" value="value_matrix_row_start"/>
        <parameter key="invert_selection" value="true"/>
        <parameter key="include_special_attributes" value="false"/>
      </operator>
      <operator activated="true" class="multiply" compatibility="9.2.001" expanded="true" height="103" name="Multiply Data" origin="GENERATED_SAMPLE" width="90" x="313" y="187"/>
      <operator activated="true" class="retrieve" compatibility="9.2.001" expanded="true" height="68" name="Load New Data" origin="GENERATED_SAMPLE" width="90" x="246" y="442">
        <parameter key="repository_entry" value="//Samples/Templates/Direct Marketing/New Campaign Data"/>
      </operator>
      <operator activated="true" class="weight_by_information_gain" compatibility="9.2.001" expanded="true" height="82" name="Calculate Weights" origin="GENERATED_SAMPLE" width="90" x="581" y="187">
        <parameter key="normalize_weights" value="true"/>
        <parameter key="sort_weights" value="true"/>
        <parameter key="sort_direction" value="descending"/>
      </operator>
      <operator activated="true" class="weights_to_data" compatibility="9.2.001" expanded="true" height="68" name="Weights to Data" origin="GENERATED_SAMPLE" width="90" x="715" y="187"/>
      <operator activated="true" class="concurrency:cross_validation" compatibility="8.2.000" expanded="true" height="145" name="Cross Validation" origin="GENERATED_SAMPLE" width="90" x="45" y="391">
        <parameter key="split_on_batch_attribute" value="false"/>
        <parameter key="leave_one_out" value="false"/>
        <parameter key="number_of_folds" value="10"/>
        <parameter key="sampling_type" value="stratified sampling"/>
        <parameter key="use_local_random_seed" value="false"/>
        <parameter key="local_random_seed" value="1992"/>
        <parameter key="enable_parallel_execution" value="true"/>
        <process expanded="true">
          <operator activated="true" class="naive_bayes" compatibility="9.2.001" expanded="true" height="82" name="Naive Bayes" origin="GENERATED_SAMPLE" width="90" x="45" y="34">
            <parameter key="laplace_correction" value="true"/>
          </operator>
          <connect from_port="training set" to_op="Naive Bayes" to_port="training set"/>
          <connect from_op="Naive Bayes" from_port="model" to_port="model"/>
          <portSpacing port="source_training set" spacing="0"/>
          <portSpacing port="sink_model" spacing="0"/>
          <portSpacing port="sink_through 1" spacing="0"/>
        </process>
        <process expanded="true">
          <operator activated="true" class="apply_model" compatibility="9.2.001" expanded="true" height="82" name="Apply Model (2)" origin="GENERATED_SAMPLE" width="90" x="45" y="34">
            <list key="application_parameters"/>
            <parameter key="create_view" value="false"/>
          </operator>
          <operator activated="true" class="performance_binominal_classification" compatibility="9.2.001" expanded="true" height="82" name="Performance (2)" origin="GENERATED_SAMPLE" width="90" x="179" y="34">
            <parameter key="main_criterion" value="first"/>
            <parameter key="accuracy" value="false"/>
            <parameter key="classification_error" value="false"/>
            <parameter key="kappa" value="false"/>
            <parameter key="AUC (optimistic)" value="false"/>
            <parameter key="AUC" value="false"/>
            <parameter key="AUC (pessimistic)" value="false"/>
            <parameter key="precision" value="true"/>
            <parameter key="recall" value="false"/>
            <parameter key="lift" value="false"/>
            <parameter key="fallout" value="false"/>
            <parameter key="f_measure" value="false"/>
            <parameter key="false_positive" value="false"/>
            <parameter key="false_negative" value="false"/>
            <parameter key="true_positive" value="false"/>
            <parameter key="true_negative" value="false"/>
            <parameter key="sensitivity" value="false"/>
            <parameter key="specificity" value="false"/>
            <parameter key="youden" value="false"/>
            <parameter key="positive_predictive_value" value="false"/>
            <parameter key="negative_predictive_value" value="false"/>
            <parameter key="psep" value="false"/>
            <parameter key="skip_undefined_labels" value="true"/>
            <parameter key="use_example_weights" value="true"/>
          </operator>
          <connect from_port="model" to_op="Apply Model (2)" to_port="model"/>
          <connect from_port="test set" to_op="Apply Model (2)" to_port="unlabelled data"/>
          <connect from_op="Apply Model (2)" from_port="labelled data" to_op="Performance (2)" to_port="labelled data"/>
          <connect from_op="Performance (2)" from_port="performance" to_port="performance 1"/>
          <connect from_op="Performance (2)" from_port="example set" to_port="test set results"/>
          <portSpacing port="source_model" spacing="0"/>
          <portSpacing port="source_test set" spacing="0"/>
          <portSpacing port="source_through 1" spacing="0"/>
          <portSpacing port="sink_test set results" spacing="0"/>
          <portSpacing port="sink_performance 1" spacing="0"/>
          <portSpacing port="sink_performance 2" spacing="0"/>
        </process>
      </operator>
      <operator activated="true" class="subprocess" compatibility="9.2.001" expanded="true" height="82" name="Calculate Threshold" origin="GENERATED_SAMPLE" width="90" x="581" y="442">
        <process expanded="true">
          <operator activated="true" class="find_threshold" compatibility="9.2.001" expanded="true" height="82" name="Find Threshold" origin="GENERATED_SAMPLE" width="90" x="179" y="34">
            <parameter key="define_labels" value="false"/>
            <parameter key="misclassification_costs_first" value="1.0"/>
            <parameter key="misclassification_costs_second" value="3.0"/>
            <parameter key="show_roc_plot" value="false"/>
            <parameter key="use_example_weights" value="true"/>
            <parameter key="roc_bias" value="optimistic"/>
            <description align="center" color="yellow" colored="true" width="126">Specify the costs of missing a potential respondent vs. the costs of including somebody into the campaign.</description>
          </operator>
          <connect from_port="in 1" to_op="Find Threshold" to_port="example set"/>
          <connect from_op="Find Threshold" from_port="threshold" to_port="out 1"/>
          <portSpacing port="source_in 1" spacing="0"/>
          <portSpacing port="source_in 2" spacing="0"/>
          <portSpacing port="sink_out 1" spacing="0"/>
          <portSpacing port="sink_out 2" spacing="0"/>
        </process>
      </operator>
      <operator activated="true" class="apply_model" compatibility="9.2.001" expanded="true" height="82" name="Apply Model" origin="GENERATED_SAMPLE" width="90" x="380" y="391">
        <list key="application_parameters"/>
        <parameter key="create_view" value="false"/>
      </operator>
      <operator activated="true" class="apply_threshold" compatibility="9.2.001" expanded="true" height="82" name="Apply Threshold" origin="GENERATED_SAMPLE" width="90" x="715" y="391"/>
      <connect from_op="Load Past Data" from_port="output" to_op="Remove ID-like Column" to_port="example set input"/>
      <connect from_op="Remove ID-like Column" from_port="example set output" to_op="Multiply Data" to_port="input"/>
      <connect from_op="Multiply Data" from_port="output 1" to_op="Calculate Weights" to_port="example set"/>
      <connect from_op="Multiply Data" from_port="output 2" to_op="Cross Validation" to_port="example set"/>
      <connect from_op="Load New Data" from_port="output" to_op="Apply Model" to_port="unlabelled data"/>
      <connect from_op="Calculate Weights" from_port="weights" to_op="Weights to Data" to_port="attribute weights"/>
      <connect from_op="Weights to Data" from_port="example set" to_port="result 1"/>
      <connect from_op="Cross Validation" from_port="model" to_op="Apply Model" to_port="model"/>
      <connect from_op="Cross Validation" from_port="test result set" to_op="Calculate Threshold" to_port="in 1"/>
      <connect from_op="Calculate Threshold" from_port="out 1" to_op="Apply Threshold" to_port="threshold"/>
      <connect from_op="Apply Model" from_port="labelled data" to_op="Apply Threshold" to_port="example set"/>
      <connect from_op="Apply Threshold" from_port="example set" to_port="result 2"/>
      <portSpacing port="source_input 1" spacing="0"/>
      <portSpacing port="sink_result 1" spacing="147"/>
      <portSpacing port="sink_result 2" spacing="189"/>
      <portSpacing port="sink_result 3" spacing="0"/>
      <description align="left" color="blue" colored="true" height="225" resized="true" width="475" x="20" y="105">Step 1:&lt;br&gt;Load and prepare data from past marketing campaigns, including recipient attributes (e.g. age, gender, area) and behavioral attributes (usage of products and services, web site, etc.).&lt;br&gt;</description>
      <description align="left" color="green" colored="true" height="225" resized="true" width="365" x="505" y="105">Step 2:&lt;br/&gt;Determine which factors influence the response to marketing campaigns to improve prediction.</description>
      <description align="left" color="orange" colored="true" height="320" resized="true" width="170" x="20" y="340">&lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br/&gt;&lt;br&gt;Step 3:&lt;br&gt;Train and validate customer response model.</description>
      <description align="left" color="green" colored="true" height="320" resized="true" width="325" x="200" y="340">&lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; Step 4:&lt;br&gt;Load data containing potential recipients for new campaigns. Apply customer response model to identify and target those recipients that are the most likely to respond to the marketing campaign in the desired way.</description>
      <description align="left" color="yellow" colored="false" height="70" resized="true" width="850" x="20" y="25">DIRECT MARKETING&lt;br&gt;Create a customer response model based on past responses to targeted marketing campaigns, in order to predict those customers that are likely to respond to and increase the conversion rate of new campaigns.</description>
      <description align="left" color="gray" colored="true" height="320" resized="true" width="335" x="535" y="340">&lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; &lt;br&gt; Step 5:&lt;br&gt;Typically, omitting recipients that would have responded, incurs a higher cost than sending a campaign to somebody who does not respond. Accounting for those costs, calculate and apply the optimum confidence threshold.</description>
      <description align="left" color="yellow" colored="false" height="35" resized="false" width="850" x="20" y="670">Outputs: influence factors, scored customers with likelihood of responding </description>
    </process>
  </operator>
</process>

mlubicz

Once more thank you very much Varun.
It seems that the problem was with the instalation of RM (as not all Views and Operators were available, including CrossValidation), not in the Direct Marketing code.
He reinstalled RM once more disabling extensions (for any rate), rebooting the system, checking other working programs etc.
For now it works.
Best regards
MLubicz

varunm1

Yes, if the default operator doesn't work then it is mostly an issue with the installation. Good to know it works now.