[SOLVED] Extract filename

rowan_g

Hi All,

I am operating the "Read" function on several .csv and .xls files and merging them. I want to generate a new attribute "file name" and list all the filenames against each example (row).
Any ideas on how to achieve that?

Many thanks!

Cheers,

Nils_Woehler

Hi,

you could start with something like Annotation to Data and Cartesian Product.

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<process version="5.3.009">
  <context>
    <input/>
    <output/>
    <macros/>
  </context>
  <operator activated="true" class="process" compatibility="5.3.009" expanded="true" name="Process">
    <process expanded="true">
      <operator activated="true" class="read_csv" compatibility="5.3.009" expanded="true" height="60" name="Read CSV" width="90" x="112" y="75">
        <parameter key="csv_file" value="CSV FILE"/>
        <parameter key="first_row_as_names" value="false"/>
        <list key="annotations">
          <parameter key="0" value="Name"/>
        </list>
        <parameter key="encoding" value="windows-1252"/>
        <list key="data_set_meta_data_information"/>
      </operator>
      <operator activated="true" class="annotations_to_data" compatibility="5.3.009" expanded="true" height="76" name="Annotations to Data" width="90" x="246" y="75"/>
      <operator activated="true" class="cartesian_product" compatibility="5.3.009" expanded="true" height="76" name="Cartesian" width="90" x="380" y="75"/>
      <connect from_op="Read CSV" from_port="output" to_op="Annotations to Data" to_port="object"/>
      <connect from_op="Annotations to Data" from_port="annotations" to_op="Cartesian" to_port="left"/>
      <connect from_op="Annotations to Data" from_port="object through" to_op="Cartesian" to_port="right"/>
      <connect from_op="Cartesian" from_port="join" to_port="result 1"/>
      <portSpacing port="source_input 1" spacing="0"/>
      <portSpacing port="sink_result 1" spacing="90"/>
      <portSpacing port="sink_result 2" spacing="0"/>
    </process>
  </operator>
</process>

Best,
Nils

rowan_g

Excellent! Thanks Nils

rowan_g

The solution only works for one spreadsheet.

How would I implement it in a "Loop Files" operator?

Many thanks.

Cheers,

Skirzynski

The "Loop File" operator provides a macro to the file path of the current file. You can use this macro to generate a new attribute. See the process below:

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<process version="5.3.009">
  <context>
    <input/>
    <output/>
    <macros/>
  </context>
  <operator activated="true" class="process" compatibility="5.3.009" expanded="true" name="Process">
    <process expanded="true">
      <operator activated="true" class="loop_files" compatibility="5.3.009" expanded="true" height="76" name="Loop Files" width="90" x="45" y="30">
        <parameter key="directory" value="/home/marcin/temp/loop-file"/>
        <process expanded="true">
          <operator activated="true" class="read_csv" compatibility="5.3.009" expanded="true" height="60" name="Read CSV" width="90" x="112" y="30">
            <parameter key="csv_file" value="/home/marcin/forum.csv"/>
            <parameter key="first_row_as_names" value="false"/>
            <list key="annotations">
              <parameter key="0" value="Name"/>
            </list>
            <parameter key="encoding" value="windows-1252"/>
            <list key="data_set_meta_data_information">
              <parameter key="0" value="name.true.polynominal.attribute"/>
              <parameter key="1" value="freq.true.integer.attribute"/>
            </list>
          </operator>
          <operator activated="true" class="generate_attributes" compatibility="5.3.009" expanded="true" height="76" name="Generate Attributes" width="90" x="246" y="30">
            <list key="function_descriptions">
              <parameter key="source" value="macro(&quot;file_path&quot;)"/>
            </list>
          </operator>
          <connect from_port="file object" to_op="Read CSV" to_port="file"/>
          <connect from_op="Read CSV" from_port="output" to_op="Generate Attributes" to_port="example set input"/>
          <connect from_op="Generate Attributes" from_port="example set output" to_port="out 1"/>
          <portSpacing port="source_file object" spacing="0"/>
          <portSpacing port="source_in 1" spacing="0"/>
          <portSpacing port="sink_out 1" spacing="0"/>
          <portSpacing port="sink_out 2" spacing="0"/>
        </process>
      </operator>
      <operator activated="true" class="append" compatibility="5.3.009" expanded="true" height="76" name="Append" width="90" x="246" y="30"/>
      <connect from_op="Loop Files" from_port="out 1" to_op="Append" to_port="example set 1"/>
      <connect from_op="Append" from_port="merged set" to_port="result 1"/>
      <portSpacing port="source_input 1" spacing="0"/>
      <portSpacing port="sink_result 1" spacing="90"/>
      <portSpacing port="sink_result 2" spacing="0"/>
    </process>
  </operator>
</process>

rowan_g

Thanks for that. Works absolutely perfectly!