Cannot set Repository path to save ...

Fred12

hi,

I can#t set the correct repository path in store and export process parameter field... 

I want to use time macro to create a folder and save them (example set + process) in the same folder ... here is my process:

 

when I set the store path to "%{Zeit}/NameofExampleSet" it says invalid character "/"

but I can do the same in the export process operator, there it works:

%{Zeit}/Prozess

Nils_Woehler

I can confirm that it works fine in the local repository but it fails when stored in the Cloud repository.

 

But looking into the stacktrace the reason seems to be the operator from "Information Selection" extension so we (RapidMiner) cannot do anything as it is not maintained by us. You can try to contact the maintainer of the "Information Selection" extension and ask him whether he can fix the bug on his end.

Fred12

edit: I can only set one of the two, the second operator throws an error then:

Oct 7, 2016 9:45:35 AM SEVERE: Process failed: operator cannot be executed. Check the log messages...

Oct 7, 2016 9:45:35 AM SEVERE: Here: 

Oct 7, 2016 9:45:35 AM SEVERE:           Process[1] (Process)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Main Process'

Oct 7, 2016 9:45:35 AM SEVERE:              +- Process Settings[1] (Subprocess)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Nested Process'

Oct 7, 2016 9:45:35 AM SEVERE:              |     +- Set Macro[1] (Set Macro)

Oct 7, 2016 9:45:35 AM SEVERE:              |     +- Versuchsaufbau[1] (Generate Data by User Specification)

Oct 7, 2016 9:45:35 AM SEVERE:              |     +- Store[1] (Store)

Oct 7, 2016 9:45:35 AM SEVERE:        ==>   |     +- Export Process[1] (Export Process)

Oct 7, 2016 9:45:35 AM SEVERE:              +- Retrieve Master3_GefuegeNamen_polynomial (2)[0] (Retrieve)

Oct 7, 2016 9:45:35 AM SEVERE:              +- Select Subprocess[0] (Select Subprocess)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Selection 1'

Oct 7, 2016 9:45:35 AM SEVERE:              |  |  +- Preprocessing[0] (Subprocess)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Nested Process'

Oct 7, 2016 9:45:35 AM SEVERE:              |  |        +- Select Attributes[0] (Select Attributes)

Oct 7, 2016 9:45:35 AM SEVERE:              |  |        +- Sample (Stratified)[0] (Sample (Stratified))

Oct 7, 2016 9:45:35 AM SEVERE:              |  |        +- Split Data[0] (Split Data)

Oct 7, 2016 9:45:35 AM SEVERE:              |  |        +- Normalize[0] (Normalize)

Oct 7, 2016 9:45:35 AM SEVERE:              |  |        +- Apply Normalization to Test data[0] (Apply Model)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Selection 2'

Oct 7, 2016 9:45:35 AM SEVERE:              +- Multiply Training Data[0] (Multiply)

Oct 7, 2016 9:45:35 AM SEVERE:              +- Train Parameter Model[0] (Select Subprocess)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Selection 1'

Oct 7, 2016 9:45:35 AM SEVERE:              |  |  +- SVM Parameter Model[0] (Subprocess)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Nested Process'

Oct 7, 2016 9:45:35 AM SEVERE:              |  |        +- SVM_Parameter[0] (Support Vector Machine (LibSVM))

Oct 7, 2016 9:45:35 AM SEVERE:              |  |        +- Multiply[0] (Multiply)

Oct 7, 2016 9:45:35 AM SEVERE:              |  |        +- Write Model[0] (Write Model)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Selection 2'

Oct 7, 2016 9:45:35 AM SEVERE:              +- Trainingdata Models[0] (Select Subprocess)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Selection 1'

Oct 7, 2016 9:45:35 AM SEVERE:              |  |  +- Test Trainingdata[0] (Subprocess)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Nested Process'

Oct 7, 2016 9:45:35 AM SEVERE:              |  |        +- Apply  Traindata[0] (Apply Model)

Oct 7, 2016 9:45:35 AM SEVERE:              |  |        +- Train_Performance[0] (Performance (Classification))

Oct 7, 2016 9:45:35 AM SEVERE:              |  |        +- Trainlog[0] (Log)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Selection 2'

Oct 7, 2016 9:45:35 AM SEVERE:              +- Train Model[0] (Select Subprocess)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Selection 1'

Oct 7, 2016 9:45:35 AM SEVERE:              |  |  +- Optimize Parameters (Grid)[0] (Optimize Parameters (Grid))

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Optimization Process'

Oct 7, 2016 9:45:35 AM SEVERE:              |  |  |     +- Validation[0] (X-Validation)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Training'

Oct 7, 2016 9:45:35 AM SEVERE:              |  |  |     |  |  +- SVM[0] (Support Vector Machine (LibSVM))

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Testing'

Oct 7, 2016 9:45:35 AM SEVERE:              |  |  |     |     +- Apply Model[0] (Apply Model)

Oct 7, 2016 9:45:35 AM SEVERE:              |  |  |     |     +- Performance[0] (Performance (Classification))

Oct 7, 2016 9:45:35 AM SEVERE:              |  |  |     |     +- inner Log[0] (Log)

Oct 7, 2016 9:45:35 AM SEVERE:              |  |  |     +- Log[0] (Log)

Oct 7, 2016 9:45:35 AM SEVERE:              |  |  +- Set Parameters[0] (Set Parameters)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Selection 2'

Oct 7, 2016 9:45:35 AM SEVERE:              +- Collect and save Results[0] (Subprocess)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Nested Process'

Oct 7, 2016 9:45:35 AM SEVERE:              |     +- Log Xval to data[0] (Log to Data)

Oct 7, 2016 9:45:35 AM SEVERE:              |     +- Performance to Data[0] (Performance to Data)

Oct 7, 2016 9:45:35 AM SEVERE:              |     +- Log Trainperformance to data[0] (Log to Data)

Oct 7, 2016 9:45:35 AM SEVERE:              |     +- Log Testperformance to data[0] (Log to Data)

Oct 7, 2016 9:45:35 AM SEVERE:              |     +- inner Log to data[0] (Log to Data)

Oct 7, 2016 9:45:35 AM SEVERE:              |     +- Write Parameters[0] (Write Parameters)

Oct 7, 2016 9:45:35 AM SEVERE:              +- Testdata Models[0] (Select Subprocess)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Selection 1'

Oct 7, 2016 9:45:35 AM SEVERE:                 |  +- Test Testdata[0] (Subprocess)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Nested Process'

Oct 7, 2016 9:45:35 AM SEVERE:                 |        +- Apply Testdata[0] (Apply Model)

Oct 7, 2016 9:45:35 AM SEVERE:                 |        +- Test_Performance[0] (Performance (Classification))

Oct 7, 2016 9:45:35 AM SEVERE:                 |        +- Testlog[0] (Log)

Oct 7, 2016 9:45:35 AM SEVERE:            subprocess 'Selection 2'

Oct 7, 2016 9:45:35 AM SEVERE: java.lang.NullPointerException

 

EDIT: It only does not work when I set "//Cloud Repository/" as main repository...

with the local ones, it works. Is that a bug or intended? 

Fred12

is there a solution to that problem found now?

Nils_Woehler

Hi Fred,

 

this seems to be a bug in the Cloud repository implementation. Could you please post a minimal process XML which allows to reproduce it on our end?

Thanks!

Nils

 

ps: What extension is providing the "Export process" operator?

Fred12

the operator is from the "Information Selection" Extension, I originally wanted to store the Experiment "setup" with the settings for different operators, and actually store the process itself in the repository with the settings I made  when the process starts...

 

here is the process:

<?xml version="1.0" encoding="UTF-8"?><process version="7.4.000">
  <context>
    <input/>
    <output/>
    <macros/>
  </context>
  <operator activated="true" class="process" compatibility="7.4.000" expanded="true" name="Process">
    <process expanded="true">
      <operator activated="true" class="set_macros" compatibility="7.4.000" expanded="true" height="82" name="Set Macros" width="90" x="246" y="136">
        <list key="macros">
          <parameter key="zeit" value="%{t}"/>
          <parameter key="pname" value="%{process_name}"/>
          <parameter key="algo" value="2"/>
        </list>
      </operator>
      <operator activated="true" class="subprocess" compatibility="7.4.000" expanded="true" height="82" name="Process Settings" width="90" x="380" y="136">
        <process expanded="true">
          <operator activated="true" class="prules:ExportProcess" compatibility="7.0.000" expanded="true" height="82" name="Export Process" width="90" x="112" y="238">
            <parameter key="Store process in:" value="Repository"/>
            <parameter key="Repository" value="//Marc/%{zeit}/Prozess"/>
          </operator>
          <operator activated="true" class="select_subprocess" compatibility="7.4.000" expanded="true" height="82" name="Prozesssettings" width="90" x="246" y="238">
            <process expanded="true">
              <operator activated="true" class="generate_data_user_specification" compatibility="7.4.000" expanded="true" height="68" name="Versuchsaufbau SVM" width="90" x="112" y="34">
                <list key="attribute_values">
                  <parameter key="Prozessname und Datum" value="%{process_name}+&quot;_&quot;+%{t}"/>
                  <parameter key="Pfad" value="%{process_path}"/>
                  <parameter key="Selected Features" value="param(&quot;Select Attributes&quot;,&quot;attributes&quot;)"/>
                  <parameter key="Normalisierung" value="param(&quot;Normalize&quot;,&quot;method&quot;)"/>
                  <parameter key="Gridsearch Parameter" value="param(&quot;Optimize Parameters (Grid)&quot;,&quot;parameters&quot;)"/>
                  <parameter key="Datenaufteilung" value="param(&quot;Split Data&quot;,&quot;partitions&quot;)"/>
                  <parameter key="Sample Ratio" value="param(&quot;Sample&quot;,&quot;sample_ratio&quot;)"/>
                </list>
                <list key="set_additional_roles"/>
              </operator>
              <operator activated="true" class="store" compatibility="7.4.000" expanded="true" height="68" name="Store" width="90" x="246" y="34">
                <parameter key="repository_entry" value="//Marc/%{zeit}/Versuchsaufbau"/>
              </operator>
              <connect from_op="Versuchsaufbau SVM" from_port="output" to_op="Store" to_port="input"/>
              <portSpacing port="source_input 1" spacing="0"/>
              <portSpacing port="source_input 2" spacing="0"/>
              <portSpacing port="sink_output 1" spacing="0"/>
            </process>
            <process expanded="true">
              <portSpacing port="source_input 1" spacing="0"/>
              <portSpacing port="source_input 2" spacing="0"/>
              <portSpacing port="sink_output 1" spacing="0"/>
            </process>
          </operator>
          <connect from_port="in 1" to_op="Export Process" to_port="through 1"/>
          <connect from_op="Export Process" from_port="through 1" to_op="Prozesssettings" to_port="input 1"/>
          <portSpacing port="source_in 1" spacing="0"/>
          <portSpacing port="source_in 2" spacing="0"/>
          <portSpacing port="sink_out 1" spacing="0"/>
        </process>
      </operator>
      <connect from_op="Set Macros" from_port="through 1" to_op="Process Settings" to_port="in 1"/>
      <portSpacing port="source_input 1" spacing="0"/>
      <portSpacing port="sink_result 1" spacing="0"/>
    </process>
  </operator>
</process>

 

Fred12

ok thanks,

I could try

Fred12

here is the answer that I got:

 

I’ve checked it and the problem is on RapidMiner side, you can submit a bug to their system.
This problem appears when a new folder in the cloud is created, but only when you use the zeit macro . The system creates the folder, but somehow one of internal RapidMiner functions returns null instead of the new folder name.
The funny thing is that the problem appears only for the first execution. The next time everything works ok, because the folder is being created at the first time so in the following execution the system can save the process.
I’ve also checked that it only appears when the zeit macro is used so it must be related to the macro format.
What I can suggest for now is to use the zeit macro in the file name instead of folder name for example like this:
//Cloud Repository/User/Prozess_%{zeit}