Aggregate function still being a PIECE OF CRAP!! 1 year later, I HATE THIS!

781194025781194025 Member Posts: 32 Contributor I
edited October 2019 in Help

Everything works fine. Even aggregate. 

 

BUT, it screws up their ID!! Even though its 'group by id'. WHY?!?!?

 

It should have the social media platforms attached to the proper 'name' , but instead they aggregate fine, concatenate fine, and then end up under some random name!!

 

Even though it should be 'grouping by ID'.

 

I attached 2 CSV files so you can use them to test the process!! PLEASE HELP!!!

 

<?xml version="1.0" encoding="UTF-8"?><process version="8.2.001">
<context>
<input/>
<output/>
<macros/>
</context>
<operator activated="true" class="process" compatibility="8.2.001" expanded="true" name="Process">
<process expanded="true">
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV" width="90" x="112" y="136">
<parameter key="csv_file" value="Z:\items_icodrops.com_4.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role" width="90" x="313" y="136">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (2)" width="90" x="112" y="238">
<parameter key="csv_file" value="Z:\items_icodrops.com_5.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (2)" width="90" x="313" y="238">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (3)" width="90" x="112" y="340">
<parameter key="csv_file" value="Z:\items_icodrops.com_7.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (3)" width="90" x="313" y="340">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (4)" width="90" x="112" y="442">
<parameter key="csv_file" value="Z:\items_icodrops.com_8.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (4)" width="90" x="313" y="442">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (5)" width="90" x="112" y="544">
<parameter key="csv_file" value="Z:\items_icodrops.com_9.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (5)" width="90" x="313" y="544">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (6)" width="90" x="112" y="646">
<parameter key="csv_file" value="Z:\items_icodrops.com_10.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (6)" width="90" x="313" y="646">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="187" name="Append" width="90" x="514" y="289"/>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes" width="90" x="648" y="289">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attributes" value="_cached_page_id|_template|_type"/>
<parameter key="invert_selection" value="true"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates" width="90" x="782" y="289">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="name"/>
<parameter key="include_special_attributes" value="true"/>
</operator>
<operator activated="false" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Loop Collection" width="90" x="2122" y="1207">
<parameter key="unfold" value="true"/>
<process expanded="true">
<connect from_port="single" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="loop_collection" compatibility="8.2.001" expanded="true" height="68" name="Loop Collection (2)" width="90" x="2055" y="1054">
<parameter key="set_iteration_macro" value="true"/>
<parameter key="unfold" value="true"/>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember" width="90" x="179" y="34">
<parameter key="name" value="1"/>
</operator>
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall" width="90" x="179" y="136">
<parameter key="name" value="1"/>
</operator>
<connect from_port="single" to_op="Remember" to_port="store"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
</process>
</operator>
<operator activated="false" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (3)" width="90" x="782" y="85">
<parameter key="name" value="%{SocialMedia}"/>
</operator>
<operator activated="false" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (3)" width="90" x="916" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="name"/>
<parameter key="include_special_attributes" value="true"/>
</operator>
<operator activated="true" class="multiply" compatibility="8.2.001" expanded="true" height="208" name="Multiply" width="90" x="916" y="289"/>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="Facebook Loop" width="90" x="1117" y="289">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (3)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="Facebooks"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (4)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (7)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Facebooks.contains.facebook"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (8)" width="90" x="313" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (6)" width="90" x="447" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (8)" width="90" x="581" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Facebooks.is_not_missing."/>
<parameter key="filters_entry_key" value="Facebooks.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (7)" width="90" x="782" y="238">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (9)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (9)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union" to_port="example set 1"/>
<connect from_op="Recall (9)" from_port="result" to_op="Union" to_port="example set 2"/>
<connect from_op="Union" from_port="union" to_op="Remember (9)" to_port="store"/>
<connect from_op="Remember (9)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (2)" width="90" x="179" y="34">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (2)" to_port="store"/>
<connect from_op="Remember (2)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (3)" width="90" x="983" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (9)" width="90" x="782" y="85">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Facebooks"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (17)" width="90" x="983" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (3)" to_port="through 1"/>
<connect from_op="Set Macro (3)" from_port="through 1" to_op="Rename (4)" to_port="example set input"/>
<connect from_op="Rename (4)" from_port="example set output" to_op="Filter Examples (7)" to_port="example set input"/>
<connect from_op="Filter Examples (7)" from_port="example set output" to_op="Append (8)" to_port="example set 1"/>
<connect from_op="Append (8)" from_port="merged set" to_op="Remove Duplicates (6)" to_port="example set input"/>
<connect from_op="Remove Duplicates (6)" from_port="example set output" to_op="Filter Examples (8)" to_port="example set input"/>
<connect from_op="Filter Examples (8)" from_port="example set output" to_op="Select Attributes (9)" to_port="example set input"/>
<connect from_op="Handle Exception (7)" from_port="out 1" to_op="Remember (3)" to_port="store"/>
<connect from_op="Select Attributes (9)" from_port="example set output" to_op="Remove Duplicates (17)" to_port="example set input"/>
<connect from_op="Remove Duplicates (17)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
<description align="center" color="yellow" colored="false" height="105" resized="false" width="180" x="1145" y="717">Type your comment</description>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append" width="90" x="1251" y="289">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (4)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">
<operator activated="false" breakpoints="after" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (5)" width="90" x="112" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<operator activated="true" class="branch" compatibility="8.2.001" expanded="true" height="82" name="Branch (2)" width="90" x="313" y="34">
<parameter key="condition_type" value="expression"/>
<parameter key="expression" value="%{iteration}==1"/>
<process expanded="true">
<connect from_port="condition" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (18)" width="90" x="45" y="187">
<parameter key="name" value="LoopData"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (8)" width="90" x="179" y="34"/>
<connect from_port="condition" to_op="Union (8)" to_port="example set 1"/>
<connect from_op="Recall (18)" from_port="result" to_op="Union (8)" to_port="example set 2"/>
<connect from_op="Union (8)" from_port="union" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (23)" width="90" x="581" y="34">
<parameter key="name" value="LoopData"/>
</operator>
<connect from_port="single" to_op="Branch (2)" to_port="condition"/>
<connect from_op="Branch (2)" from_port="input 1" to_op="Remember (23)" to_port="store"/>
<connect from_op="Remember (23)" from_port="stored" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (6)" width="90" x="380" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<connect from_port="in 1" to_op="Output (4)" to_port="collection"/>
<connect from_op="Output (4)" from_port="output 1" to_op="Select (6)" to_port="collection"/>
<connect from_op="Select (6)" from_port="selected" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="Telegram Loop" width="90" x="1117" y="442">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (2)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="Telegrams"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (2)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (2)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Telegrams.contains.t\.me"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (2)" width="90" x="380" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (2)" width="90" x="514" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (3)" width="90" x="715" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Telegrams.is_not_missing."/>
<parameter key="filters_entry_key" value="Telegrams.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (2)" width="90" x="782" y="238">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (5)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (2)" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (4)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union (2)" to_port="example set 1"/>
<connect from_op="Recall (5)" from_port="result" to_op="Union (2)" to_port="example set 2"/>
<connect from_op="Union (2)" from_port="union" to_op="Remember (4)" to_port="store"/>
<connect from_op="Remember (4)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (5)" width="90" x="179" y="34">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (5)" to_port="store"/>
<connect from_op="Remember (5)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (6)" width="90" x="983" y="340">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (2)" width="90" x="916" y="85">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Telegrams"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (4)" width="90" x="1050" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Telegrams"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (2)" to_port="through 1"/>
<connect from_op="Set Macro (2)" from_port="through 1" to_op="Rename (2)" to_port="example set input"/>
<connect from_op="Rename (2)" from_port="example set output" to_op="Filter Examples (2)" to_port="example set input"/>
<connect from_op="Filter Examples (2)" from_port="example set output" to_op="Append (2)" to_port="example set 1"/>
<connect from_op="Append (2)" from_port="merged set" to_op="Remove Duplicates (2)" to_port="example set input"/>
<connect from_op="Remove Duplicates (2)" from_port="example set output" to_op="Filter Examples (3)" to_port="example set input"/>
<connect from_op="Filter Examples (3)" from_port="example set output" to_op="Select Attributes (2)" to_port="example set input"/>
<connect from_op="Select Attributes (2)" from_port="example set output" to_op="Remove Duplicates (4)" to_port="example set input"/>
<connect from_op="Remove Duplicates (4)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
<description align="center" color="yellow" colored="false" height="105" resized="false" width="180" x="1145" y="717">Type your comment</description>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append (3)" width="90" x="1251" y="442">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (3)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">
<operator activated="false" breakpoints="after" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (4)" width="90" x="112" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<operator activated="true" class="branch" compatibility="8.2.001" expanded="true" height="82" name="Branch (4)" width="90" x="313" y="34">
<parameter key="condition_type" value="expression"/>
<parameter key="expression" value="%{iteration}==1"/>
<process expanded="true">
<connect from_port="condition" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (19)" width="90" x="45" y="187">
<parameter key="name" value="LoopData"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (10)" width="90" x="179" y="34"/>
<connect from_port="condition" to_op="Union (10)" to_port="example set 1"/>
<connect from_op="Recall (19)" from_port="result" to_op="Union (10)" to_port="example set 2"/>
<connect from_op="Union (10)" from_port="union" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (25)" width="90" x="581" y="34">
<parameter key="name" value="LoopData"/>
</operator>
<connect from_port="single" to_op="Branch (4)" to_port="condition"/>
<connect from_op="Branch (4)" from_port="input 1" to_op="Remember (25)" to_port="store"/>
<connect from_op="Remember (25)" from_port="stored" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (7)" width="90" x="380" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<connect from_port="in 1" to_op="Output (3)" to_port="collection"/>
<connect from_op="Output (3)" from_port="output 1" to_op="Select (7)" to_port="collection"/>
<connect from_op="Select (7)" from_port="selected" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Telegrams" width="90" x="1921" y="799">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (6)" width="90" x="45" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (3)" width="90" x="179" y="34">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Telegrams"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (5)" width="90" x="313" y="34">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Telegrams"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_op="Recall (6)" from_port="result" to_op="Select Attributes (3)" to_port="example set input"/>
<connect from_op="Select Attributes (3)" from_port="example set output" to_op="Remove Duplicates (5)" to_port="example set input"/>
<connect from_op="Remove Duplicates (5)" from_port="example set output" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="Medium Loop" width="90" x="1117" y="595">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (4)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="Mediums"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (3)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (4)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Mediums.contains.medium\.com"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (3)" width="90" x="313" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (7)" width="90" x="447" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (5)" width="90" x="581" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Mediums.is_not_missing."/>
<parameter key="filters_entry_key" value="Mediums.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (3)" width="90" x="782" y="85">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (7)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (3)" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (7)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union (3)" to_port="example set 1"/>
<connect from_op="Recall (7)" from_port="result" to_op="Union (3)" to_port="example set 2"/>
<connect from_op="Union (3)" from_port="union" to_op="Remember (7)" to_port="store"/>
<connect from_op="Remember (7)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (8)" width="90" x="112" y="136">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (8)" to_port="store"/>
<connect from_op="Remember (8)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (10)" width="90" x="983" y="85">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (10)" width="90" x="715" y="289">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Mediums"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (18)" width="90" x="916" y="289">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Mediums"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (4)" to_port="through 1"/>
<connect from_op="Set Macro (4)" from_port="through 1" to_op="Rename (3)" to_port="example set input"/>
<connect from_op="Rename (3)" from_port="example set output" to_op="Filter Examples (4)" to_port="example set input"/>
<connect from_op="Filter Examples (4)" from_port="example set output" to_op="Append (3)" to_port="example set 1"/>
<connect from_op="Append (3)" from_port="merged set" to_op="Remove Duplicates (7)" to_port="example set input"/>
<connect from_op="Remove Duplicates (7)" from_port="example set output" to_op="Filter Examples (5)" to_port="example set input"/>
<connect from_op="Filter Examples (5)" from_port="example set output" to_op="Select Attributes (10)" to_port="example set input"/>
<connect from_op="Select Attributes (10)" from_port="example set output" to_op="Remove Duplicates (18)" to_port="example set input"/>
<connect from_op="Remove Duplicates (18)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append (4)" width="90" x="1251" y="595">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (5)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">
<operator activated="false" breakpoints="after" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (8)" width="90" x="112" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<operator activated="true" class="branch" compatibility="8.2.001" expanded="true" height="82" name="Branch (5)" width="90" x="313" y="34">
<parameter key="condition_type" value="expression"/>
<parameter key="expression" value="%{iteration}==1"/>
<process expanded="true">
<connect from_port="condition" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (20)" width="90" x="45" y="187">
<parameter key="name" value="LoopData"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (11)" width="90" x="179" y="34"/>
<connect from_port="condition" to_op="Union (11)" to_port="example set 1"/>
<connect from_op="Recall (20)" from_port="result" to_op="Union (11)" to_port="example set 2"/>
<connect from_op="Union (11)" from_port="union" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (26)" width="90" x="581" y="34">
<parameter key="name" value="LoopData"/>
</operator>
<connect from_port="single" to_op="Branch (5)" to_port="condition"/>
<connect from_op="Branch (5)" from_port="input 1" to_op="Remember (26)" to_port="store"/>
<connect from_op="Remember (26)" from_port="stored" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (9)" width="90" x="380" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<connect from_port="in 1" to_op="Output (5)" to_port="collection"/>
<connect from_op="Output (5)" from_port="output 1" to_op="Select (9)" to_port="collection"/>
<connect from_op="Select (9)" from_port="selected" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Mediums" width="90" x="1921" y="901">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (8)" width="90" x="45" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (4)" width="90" x="246" y="85">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Mediums"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (8)" width="90" x="514" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Mediums"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_op="Recall (8)" from_port="result" to_op="Select Attributes (4)" to_port="example set input"/>
<connect from_op="Select Attributes (4)" from_port="example set output" to_op="Remove Duplicates (8)" to_port="example set input"/>
<connect from_op="Remove Duplicates (8)" from_port="example set output" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="LinkedIns" width="90" x="1117" y="748">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (5)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="LinkedIns"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (5)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (6)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="LinkedIns.contains.linkedin\.com"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (4)" width="90" x="313" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (9)" width="90" x="447" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (9)" width="90" x="581" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="LinkedIns.is_not_missing."/>
<parameter key="filters_entry_key" value="LinkedIns.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (4)" width="90" x="782" y="187">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (10)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (4)" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (11)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union (4)" to_port="example set 1"/>
<connect from_op="Recall (10)" from_port="result" to_op="Union (4)" to_port="example set 2"/>
<connect from_op="Union (4)" from_port="union" to_op="Remember (11)" to_port="store"/>
<connect from_op="Remember (11)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (12)" width="90" x="112" y="136">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (12)" to_port="store"/>
<connect from_op="Remember (12)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (13)" width="90" x="983" y="85">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (11)" width="90" x="648" y="340">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="LinkedIns"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (19)" width="90" x="916" y="340">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="LinkedIns"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (5)" to_port="through 1"/>
<connect from_op="Set Macro (5)" from_port="through 1" to_op="Rename (5)" to_port="example set input"/>
<connect from_op="Rename (5)" from_port="example set output" to_op="Filter Examples (6)" to_port="example set input"/>
<connect from_op="Filter Examples (6)" from_port="example set output" to_op="Append (4)" to_port="example set 1"/>
<connect from_op="Append (4)" from_port="merged set" to_op="Remove Duplicates (9)" to_port="example set input"/>
<connect from_op="Remove Duplicates (9)" from_port="example set output" to_op="Filter Examples (9)" to_port="example set input"/>
<connect from_op="Filter Examples (9)" from_port="example set output" to_op="Select Attributes (11)" to_port="example set input"/>
<connect from_op="Handle Exception (4)" from_port="out 1" to_op="Remember (13)" to_port="store"/>
<connect from_op="Select Attributes (11)" from_port="example set output" to_op="Remove Duplicates (19)" to_port="example set input"/>
<connect from_op="Remove Duplicates (19)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append (5)" width="90" x="1251" y="748">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (6)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">
<operator activated="false" breakpoints="after" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (10)" width="90" x="112" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<operator activated="true" class="branch" compatibility="8.2.001" expanded="true" height="82" name="Branch (6)" width="90" x="313" y="34">
<parameter key="condition_type" value="expression"/>
<parameter key="expression" value="%{iteration}==1"/>
<process expanded="true">
<connect from_port="condition" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (21)" width="90" x="45" y="187">
<parameter key="name" value="LoopData"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (12)" width="90" x="179" y="34"/>
<connect from_port="condition" to_op="Union (12)" to_port="example set 1"/>
<connect from_op="Recall (21)" from_port="result" to_op="Union (12)" to_port="example set 2"/>
<connect from_op="Union (12)" from_port="union" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (27)" width="90" x="581" y="34">
<parameter key="name" value="LoopData"/>
</operator>
<connect from_port="single" to_op="Branch (6)" to_port="condition"/>
<connect from_op="Branch (6)" from_port="input 1" to_op="Remember (27)" to_port="store"/>
<connect from_op="Remember (27)" from_port="stored" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (11)" width="90" x="380" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<connect from_port="in 1" to_op="Output (6)" to_port="collection"/>
<connect from_op="Output (6)" from_port="output 1" to_op="Select (11)" to_port="collection"/>
<connect from_op="Select (11)" from_port="selected" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="LinkedIns (2)" width="90" x="1921" y="1003">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (11)" width="90" x="45" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (5)" width="90" x="246" y="85">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="LinkedIns"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (10)" width="90" x="514" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="LinkedIns"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_op="Recall (11)" from_port="result" to_op="Select Attributes (5)" to_port="example set input"/>
<connect from_op="Select Attributes (5)" from_port="example set output" to_op="Remove Duplicates (10)" to_port="example set input"/>
<connect from_op="Remove Duplicates (10)" from_port="example set output" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="Twitters (2)" width="90" x="1117" y="901">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (6)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="Twitters"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (6)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (10)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Twitters.contains.twitter\.com"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (5)" width="90" x="313" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (11)" width="90" x="447" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (11)" width="90" x="581" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Twitters.is_not_missing."/>
<parameter key="filters_entry_key" value="Twitters.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (5)" width="90" x="782" y="85">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (12)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (5)" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (14)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union (5)" to_port="example set 1"/>
<connect from_op="Recall (12)" from_port="result" to_op="Union (5)" to_port="example set 2"/>
<connect from_op="Union (5)" from_port="union" to_op="Remember (14)" to_port="store"/>
<connect from_op="Remember (14)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (15)" width="90" x="112" y="136">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (15)" to_port="store"/>
<connect from_op="Remember (15)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (16)" width="90" x="983" y="85">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (12)" width="90" x="581" y="289">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Twitters"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (20)" width="90" x="849" y="289">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Twitters"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (6)" to_port="through 1"/>
<connect from_op="Set Macro (6)" from_port="through 1" to_op="Rename (6)" to_port="example set input"/>
<connect from_op="Rename (6)" from_port="example set output" to_op="Filter Examples (10)" to_port="example set input"/>
<connect from_op="Filter Examples (10)" from_port="example set output" to_op="Append (5)" to_port="example set 1"/>
<connect from_op="Append (5)" from_port="merged set" to_op="Remove Duplicates (11)" to_port="example set input"/>
<connect from_op="Remove Duplicates (11)" from_port="example set output" to_op="Filter Examples (11)" to_port="example set input"/>
<connect from_op="Filter Examples (11)" from_port="example set output" to_op="Select Attributes (12)" to_port="example set input"/>
<connect from_op="Handle Exception (5)" from_port="out 1" to_op="Remember (16)" to_port="store"/>
<connect from_op="Select Attributes (12)" from_port="example set output" to_op="Remove Duplicates (20)" to_port="example set input"/>
<connect from_op="Remove Duplicates (20)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append (6)" width="90" x="1251" y="901">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (7)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">
Tagged:

Answers

  • landland RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 2,531 Unicorn
    Hi,
    I understand your frustration and would really like to understand your problem to help you and avoid it myself. However the process requires nearly a dozen files to be executed. That would require me to completely change the process to be able to execute it.
    Could you please post a simplified, best self-contained process illustrating the problem? Usually not having any files at all by using Generate Data, Generate Data by User Specification or even a combination of Create Document/Write Document/Read CSV would make this much more easy for anybody wanting to help you.

    Greetings,
    Sebastian
  • Knut-RMKnut-RM Administrator, Employee, Member, University Professor Posts: 111 Administrator

    Try 9.0 beta (http://static.rapidminer.com/rnd/html/rapidminer-9.0-preview.html). I just talked to eng and it seems this one might be the fix you have been waiting for.

    Cheers, K.

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,503 RM Data Scientist

    Hi,

    it's most likely this bug which is fixed in the latest beta and in 9.0: https://community.rapidminer.com/t5/RapidMiner-Studio-Forum/Possible-bug-with-Aggregate-operator/m-p/52215

    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • earmijoearmijo Member Posts: 270 Unicorn

    I would never consider helping anybody who titles his/her question the way you did. Manners. Manners. 

     

    The fact that you have 3 answers below just shows how nice the people at RM and in this forum are. 

Sign In or Register to comment.