"Apply Threshold" operator isn't reading data from my "confidence" attributes

torstors Member Posts: 3 Learner I
edited March 2020 in Help
I have two attributes: "Data" with binomial values "Y" and "N",  and "Predicted" with real values between 0 and 1. I want to apply a threshold to the "Predicted" attribute to convert it into binomial values, then test its accuracy against the "Data" attribute. 

to use the operator "Apply Threshold", I had to make two real confidence attributes, "confidence(Y)" and "confidence(N)" (values set to "Predicted" and 1 - "Predicted") with roles by the same names, and a binomial "pred" attribute with role "prediction" (values initially copied from "Data").

however, when I run the process, it replaces each value of "pred" to "N", regardless of whether "confidence(positive)" was greater than the threshold. that suggests to me that "Apply Threshold" is failing to read the "confidence(positive)" attribute, but I don't know why or how to fix it. 


<?xml version="1.0" encoding="UTF-8"?><process version="9.6.000">
  <context>
    <input/>
    <output/>
    <macros/>
  </context>
  <operator activated="true" class="process" compatibility="9.6.000" expanded="true" name="Process">
    <parameter key="logverbosity" value="init"/>
    <parameter key="random_seed" value="2001"/>
    <parameter key="send_mail" value="never"/>
    <parameter key="notification_email" value=""/>
    <parameter key="process_duration_for_mail" value="30"/>
    <parameter key="encoding" value="SYSTEM"/>
    <process expanded="true">
      <operator activated="true" class="create_threshold" compatibility="9.6.000" expanded="true" height="68" name="Create Threshold" width="90" x="581" y="340">
        <parameter key="threshold" value="0.5"/>
        <parameter key="first_class" value="N"/>
        <parameter key="second_class" value="Y"/>
      </operator>
      <operator activated="true" class="utility:create_exampleset" compatibility="9.6.000" expanded="true" height="68" name="Create ExampleSet" width="90" x="45" y="238">
        <parameter key="generator_type" value="comma separated text"/>
        <parameter key="number_of_examples" value="100"/>
        <parameter key="use_stepsize" value="false"/>
        <list key="function_descriptions"/>
        <parameter key="add_id_attribute" value="false"/>
        <list key="numeric_series_configuration"/>
        <list key="date_series_configuration"/>
        <list key="date_series_configuration (interval)"/>
        <parameter key="date_format" value="yyyy-MM-dd HH:mm:ss"/>
        <parameter key="time_zone" value="SYSTEM"/>
        <parameter key="input_csv_text" value="Data,Predicted (Model)&#10;Y,0.225135637&#10;N,0.015354609&#10;N,0.0001&#10;Y,0.417204888&#10;N,0.0001&#10;Y,0.825845697&#10;Y,0.566671094&#10;N,0.361344126&#10;Y,0.138533613&#10;N,0.0001&#10;N,0.0001&#10;N,0.10015621&#10;N,0.519371562&#10;Y,0.687709876&#10;Y,0.488898237&#10;Y,0.471409091&#10;N,0.118468641&#10;Y,0.373571663&#10;N,0.0001&#10;N,0.078786849&#10;N,0.067795272&#10;Y,0.421387476&#10;Y,0.83791151&#10;N,0.0001&#10;Y,0.457122298&#10;N,0.405682588&#10;Y,0.580764825&#10;Y,0.218196512&#10;Y,0.655224335&#10;Y,0.855784984&#10;Y,0.50579238&#10;Y,0.084138364&#10;N,0.0001&#10;Y,0.821532224&#10;Y,0.678781002&#10;Y,0.926816559&#10;N,0.50659274&#10;N,0.164581177&#10;Y,0.328660268&#10;Y,0.288377542&#10;N,0.059794767&#10;Y,0.62206104&#10;N,0.064220637&#10;Y,0.791833862&#10;Y,0.207360705&#10;Y,0.34374656&#10;Y,0.225577433&#10;Y,0.75455163&#10;Y,0.506957704&#10;N,0.0001&#10;N,0.058930078&#10;Y,0.749783305&#10;N,0.03936428&#10;Y,0.850028134&#10;N,0.172089154&#10;N,0.066416753&#10;Y,0.567490629&#10;N,0.057332485&#10;Y,0.761940543&#10;N,0.125667186&#10;Y,0.678991758&#10;N,0.228706155&#10;Y,0.68499118&#10;N,0.09513121&#10;Y,0.351269244&#10;Y,0.570312751&#10;N,0.0001&#10;Y,0.138407109&#10;N,0.439762099&#10;N,0.200565587&#10;N,0.0001&#10;N,0.133003815&#10;Y,0.404646644&#10;Y,0.550891144&#10;Y,0.415110029&#10;Y,0.42737024&#10;Y,0.175065829&#10;N,0.38808125&#10;Y,0.570520642&#10;Y,0.6173936&#10;N,0.0001&#10;N,0.223786655&#10;Y,0.245724872&#10;N,0.147310984&#10;Y,0.656746637&#10;N,0.136984071&#10;Y,0.694440361&#10;N,0.403283901&#10;Y,0.253220092&#10;Y,0.587039158&#10;N,0.096477247&#10;Y,0.77295129&#10;N,0.081595909&#10;Y,0.138402045&#10;Y,0.372460544&#10;N,0.036575703&#10;Y,0.278538797&#10;Y,0.729871568&#10;Y,0.544152042&#10;Y,0.8140683&#10;N,0.108877327&#10;N,0.0001&#10;N,0.0001&#10;N,0.140347197&#10;N,0.0001&#10;N,0.111951146&#10;N,0.273102486&#10;Y,0.746288955&#10;Y,0.280770148&#10;Y,0.441145204&#10;Y,0.194084087&#10;Y,0.300068795&#10;Y,0.881620015&#10;Y,0.44164248&#10;N,0.0001&#10;N,0.227901755&#10;N,0.2157731&#10;Y,0.652973156&#10;N,0.361191701&#10;N,0.0001&#10;Y,0.544357267&#10;N,0.216806743&#10;Y,0.663144573&#10;N,0.390221372&#10;N,0.0001&#10;N,0.017205352&#10;N,0.046550353&#10;Y,0.497414924&#10;Y,0.375995967&#10;N,0.211114841&#10;N,0.0001&#10;Y,0.338798002&#10;Y,0.758031735&#10;N,0.364765878&#10;N,0.172331655&#10;Y,0.490027205&#10;N,0.384078322&#10;Y,0.149516671&#10;N,0.008708927&#10;Y,0.224359365&#10;Y,0.674530153&#10;Y,0.473461694&#10;Y,0.232653724&#10;N,0.171596763&#10;Y,0.661383153&#10;Y,0.476280739&#10;N,0.188372312&#10;Y,0.660643742&#10;Y,0.560021217&#10;Y,0.498866655&#10;N,0.417782676&#10;N,0.0001&#10;Y,0.396102307&#10;Y,0.392494&#10;N,0.067356851&#10;Y,0.506465866&#10;Y,0.741886036&#10;Y,0.493834563&#10;Y,0.622761886&#10;Y,0.778629673&#10;N,0.376177326&#10;N,0.0001&#10;Y,0.094023964&#10;Y,0.411875357&#10;N,0.0001&#10;Y,0.656660618&#10;Y,0.358468475&#10;N,0.150609275&#10;N,0.0001&#10;Y,0.614080059&#10;N,0.0001&#10;N,0.0001&#10;N,0.0001&#10;N,0.0001&#10;N,0.107406666&#10;Y,0.236991851&#10;Y,0.569899753&#10;Y,0.465197292&#10;N,0.293648623&#10;N,0.314567095&#10;N,0.0879467&#10;Y,0.454703781&#10;Y,0.444991643&#10;N,0.050408819&#10;Y,0.437551851&#10;N,0.130305697&#10;Y,0.336272424&#10;Y,0.592396667&#10;Y,0.138354142&#10;N,0.0001&#10;Y,0.834161136&#10;N,0.023170873&#10;Y,0.323113794&#10;N,0.211781092&#10;N,0.444532586&#10;Y,0.443579097&#10;N,0.0001&#10;N,0.139058433&#10;N,0.0001&#10;N,0.0001&#10;Y,0.38499674&#10;N,0.0001&#10;N,0.0001&#10;Y,0.123681638&#10;Y,0.472032978&#10;N,0.525912484&#10;N,0.0001&#10;Y,0.396940427&#10;N,0.26437863&#10;Y,0.016477121&#10;N,0.0001&#10;N,0.082716598&#10;N,0.0001&#10;Y,0.783494732&#10;N,0.109288479&#10;N,0.157626045&#10;N,0.236647676&#10;Y,0.740077106&#10;N,0.0001&#10;N,0.0001&#10;N,0.206587293&#10;N,0.0001&#10;N,0.0001&#10;Y,0.577468692&#10;Y,0.421772481&#10;Y,0.762127968&#10;N,0.0001&#10;Y,0.530366393&#10;N,0.24857274&#10;N,0.435365668&#10;N,0.0001&#10;Y,0.506477522&#10;Y,0.191485506&#10;Y,0.804013908&#10;N,0.0001&#10;N,0.096306717&#10;Y,0.767580687&#10;Y,0.425041496&#10;Y,0.652461621&#10;Y,0.589906399&#10;N,0.0001&#10;Y,0.643446801&#10;N,0.259075579&#10;N,0.0001&#10;Y,0.673050019&#10;Y,0.082421867&#10;N,0.099447465&#10;Y,0.579345273&#10;N,0.0001&#10;N,0.057514014&#10;Y,0.461871654&#10;Y,0.689637808&#10;N,0.0001&#10;Y,0.406664727&#10;N,0.0001&#10;N,0.569201064&#10;N,0.228117263&#10;Y,0.458958547&#10;N,0.282189415&#10;Y,0.715746041&#10;Y,0.369831765&#10;Y,0.311177796&#10;N,0.0001&#10;Y,0.437475655&#10;N,0.0001&#10;N,0.0001&#10;Y,0.906274537&#10;N,0.0001&#10;N,0.133111991&#10;Y,0.669950473&#10;Y,0.519887446&#10;N,0.0001&#10;N,0.0001&#10;N,0.117140248&#10;Y,0.712497054&#10;Y,0.893230805&#10;Y,0.494572867&#10;Y,0.299682746&#10;N,0.0001&#10;N,0.0001&#10;Y,0.499195639&#10;Y,0.615206839&#10;N,0.0001&#10;Y,0.136910848&#10;N,0.014205447&#10;Y,0.529345336&#10;N,0.0001&#10;Y,0.251291365&#10;N,0.0001&#10;Y,0.55477882&#10;N,0.0001&#10;Y,0.426870088&#10;N,0.0001&#10;Y,0.731543209&#10;N,0.0001&#10;Y,0.374157588&#10;Y,0.528718106&#10;N,0.0001&#10;Y,0.56013638&#10;N,0.072086761&#10;Y,0.14616557&#10;Y,0.620443499&#10;N,0.16173902&#10;Y,0.863615019&#10;Y,0.575539093&#10;N,0.0001&#10;Y,0.369297454&#10;Y,0.306617238&#10;Y,0.487022496&#10;N,0.103230158&#10;Y,0.421359953&#10;N,0.0001&#10;Y,0.466354069&#10;N,0.0001&#10;Y,0.343187848&#10;Y,0.289559068&#10;N,0.2598892&#10;N,0.139309321&#10;N,0.0001&#10;N,0.0001&#10;Y,0.756972227&#10;Y,0.120890758&#10;N,0.197729503&#10;N,0.003897131&#10;Y,0.416436328&#10;N,0.012402934&#10;N,0.0001&#10;Y,0.715699273&#10;Y,0.675610616&#10;Y,0.76506855&#10;N,0.0001&#10;Y,0.740078389&#10;Y,0.841420838&#10;Y,0.946896945&#10;N,0.321274399&#10;N,0.0001&#10;N,0.27794159&#10;Y,0.627639721&#10;N,0.0001&#10;N,0.249467153&#10;N,0.547360596&#10;Y,0.247236577&#10;N,0.133425249&#10;N,0.370176607&#10;N,0.0001&#10;Y,0.328332491&#10;N,0.256813811&#10;N,0.0001&#10;Y,0.290020592&#10;N,0.0001&#10;N,0.167306727&#10;Y,0.461690135&#10;N,0.0001&#10;N,0.013979646&#10;Y,0.38813855&#10;N,0.0001&#10;N,0.310334236&#10;N,0.079071151&#10;Y,0.303275331&#10;N,0.213885215&#10;Y,0.393860182&#10;Y,0.756254078&#10;N,0.431842777&#10;N,0.0001&#10;Y,0.654117607&#10;N,0.0001&#10;Y,0.672115813&#10;N,0.0001&#10;N,0.0001&#10;Y,0.545970153&#10;Y,0.21624029&#10;Y,0.483109475&#10;Y,0.650828347&#10;Y,0.569211719&#10;N,0.0001&#10;N,0.049746375&#10;Y,0.355987251&#10;N,0.0001&#10;Y,0.299716127&#10;Y,0.433379057&#10;N,0.237669631&#10;Y,0.537777033&#10;Y,0.414516654&#10;Y,0.800943762&#10;N,0.296561107&#10;Y,0.307934951&#10;Y,0.64754962&#10;N,0.103993581&#10;N,0.019950852&#10;Y,0.564411487&#10;N,0.226002456&#10;N,0.134567234&#10;N,0.116892748&#10;N,0.087493619&#10;N,0.0001&#10;N,0.0001&#10;Y,0.481522363&#10;Y,0.197206406&#10;N,0.0001&#10;N,0.0001&#10;Y,0.357638592&#10;N,0.339037244&#10;N,0.003120399&#10;Y,0.947301575&#10;N,0.0001&#10;Y,0.784902692&#10;N,0.044356782&#10;N,0.0001&#10;N,0.0001&#10;N,0.0001&#10;N,0.374658095&#10;N,0.012133725&#10;N,0.2948613&#10;N,0.251805187&#10;Y,0.645569376&#10;N,0.0001&#10;N,0.0001&#10;Y,0.751735992&#10;Y,0.853200073&#10;N,0.0001&#10;Y,0.610057866&#10;Y,0.205791168&#10;Y,0.410984321&#10;N,0.0001&#10;Y,0.240038325&#10;N,0.038818104&#10;Y,0.232435184&#10;N,0.102906186&#10;N,0.0001&#10;Y,0.569323556&#10;N,0.037841539&#10;Y,0.414147987&#10;N,0.0001&#10;Y,0.236093926&#10;N,0.0001&#10;Y,0.236813976&#10;Y,0.514436048&#10;N,0.0001&#10;N,0.553110218&#10;N,0.209966555&#10;N,0.310611491&#10;N,0.152955599&#10;N,0.0001&#10;N,0.327167013&#10;N,0.0001&#10;Y,0.30384918&#10;Y,0.4794465&#10;Y,0.529956575&#10;N,0.0001&#10;N,0.0001&#10;Y,0.432274926&#10;Y,0.616129736&#10;N,0.0001&#10;N,0.253718861&#10;Y,0.407991737&#10;N,0.033500072&#10;N,0.0001&#10;N,0.0001&#10;N,0.122598716&#10;Y,0.462312565&#10;Y,0.636183238&#10;N,0.15793286&#10;Y,0.525098812&#10;Y,0.664147094&#10;N,0.119070125&#10;N,0.0001&#10;Y,0.392602571&#10;Y,0.614612375&#10;N,0.0001&#10;Y,0.616730864&#10;Y,0.608618551&#10;Y,0.669451092&#10;N,0.0001&#10;N,0.235920685&#10;Y,0.480602525&#10;Y,0.635614226&#10;Y,0.391854656&#10;N,0.0001&#10;Y,0.171784877&#10;N,0.204082013&#10;N,0.0001&#10;Y,0.382701189&#10;N,0.170276811&#10;N,0.46742213&#10;N,0.0001&#10;N,0.219946765&#10;Y,0.440881918&#10;Y,0.449594655&#10;N,0.0001&#10;Y,0.71216168&#10;Y,0.419952203&#10;N,0.0001&#10;N,0.139149903&#10;Y,0.455097673&#10;Y,0.882282519&#10;N,0.0001&#10;N,0.0001&#10;Y,0.505806915&#10;Y,0.902558123&#10;N,0.0001&#10;Y,0.695310694&#10;N,0.0001&#10;N,0.0001&#10;N,0.0001&#10;N,0.0001&#10;Y,0.272600363&#10;N,0.082621314&#10;Y,0.464395827&#10;Y,0.618428958&#10;N,0.534692101&#10;N,0.317367673&#10;N,0.0001&#10;Y,0.442227556&#10;N,0.312675623&#10;N,0.0001&#10;Y,0.48229638&#10;N,0.022550871&#10;N,0.332781055&#10;Y,0.261599822&#10;N,0.171541869&#10;N,0.0001&#10;Y,0.657273788&#10;N,0.349638823&#10;Y,0.728735209&#10;N,0.0001&#10;N,0.105249134&#10;Y,0.293894261&#10;N,0.072273469&#10;Y,0.354570915&#10;Y,0.410064204&#10;Y,0.44739504&#10;N,0.027614561&#10;Y,0.881784332&#10;Y,0.459467358&#10;N,0.304315326&#10;Y,0.922627318&#10;Y,0.488731015&#10;N,0.08180952&#10;N,0.0001&#10;Y,0.431488904&#10;N,0.0001&#10;Y,0.322131287&#10;N,0.0001&#10;Y,0.458514891&#10;N,0.303006734&#10;Y,0.267055728&#10;Y,0.451880527&#10;N,0.0001&#10;Y,0.476867183&#10;N,0.338357589&#10;Y,0.49317765&#10;N,0.0001&#10;N,0.137388967&#10;N,0.0001&#10;N,0.419280027&#10;N,0.0001&#10;N,0.0001&#10;Y,0.365977923&#10;Y,0.683814368&#10;N,0.104229766&#10;Y,0.266574586&#10;N,0.0001&#10;Y,0.473696875&#10;N,0.0001&#10;Y,0.845870623&#10;Y,0.485531138&#10;N,0.029826583&#10;N,0.222998412&#10;Y,0.323085626&#10;Y,0.143263659&#10;N,0.065829181&#10;N,0.509900073&#10;N,0.218699182&#10;Y,0.128101281&#10;Y,0.66981003&#10;Y,0.406257409&#10;Y,0.588944898&#10;N,0.0001&#10;N,0.0001&#10;Y,0.399266965&#10;N,0.0001&#10;Y,0.548846566&#10;Y,0.432092622&#10;N,0.035504595&#10;Y,0.10334879&#10;Y,0.354320931&#10;N,0.081648827&#10;Y,0.278592341&#10;Y,0.159863424&#10;Y,0.335276015&#10;Y,0.317995478&#10;Y,0.224255567&#10;N,0.0001&#10;N,0.280176324&#10;N,0.220114854&#10;N,0.0001&#10;Y,0.50654723&#10;N,0.186054882&#10;Y,0.736719984&#10;Y,0.420956699&#10;Y,0.150595767&#10;Y,0.622305524&#10;Y,0.551062046&#10;Y,0.677161834&#10;N,0.41150115&#10;N,0.007920189&#10;Y,0.734031477&#10;Y,0.562884889&#10;Y,0.471643698&#10;N,0.0001&#10;N,0.013878532&#10;N,0.097310849&#10;N,0.193405543&#10;Y,0.857663779&#10;N,0.293717137&#10;N,0.087031781&#10;N,0.157869878&#10;Y,0.59291082&#10;Y,0.25365872&#10;Y,0.698096232&#10;N,0.114082837&#10;N,0.357157697&#10;N,0.0001&#10;Y,0.822196311&#10;Y,0.253924476&#10;N,0.087396663&#10;N,0.21784532&#10;Y,0.416080847&#10;Y,0.295490847&#10;N,0.057390894&#10;Y,0.600339658&#10;N,0.030259019&#10;N,0.0001&#10;Y,0.707060218&#10;Y,0.397500996&#10;Y,0.504801327&#10;N,0.024271651&#10;N,0.0001&#10;N,0.0001&#10;N,0.209848201&#10;N,0.0001&#10;N,0.0001&#10;N,0.0001&#10;N,0.04784182&#10;N,0.278783048&#10;Y,0.476560849&#10;N,0.249272095&#10;N,0.046025145&#10;Y,0.786108381&#10;N,0.058610238&#10;Y,0.485684526&#10;N,0.0001&#10;N,0.0001&#10;N,0.080430574&#10;Y,0.344370136&#10;Y,0.658694756&#10;N,0.0001&#10;N,0.0001&#10;Y,0.439160045&#10;N,0.0001&#10;Y,0.522014866&#10;Y,0.859105664&#10;N,0.0001&#10;N,0.437496173&#10;N,0.0001&#10;N,0.0001&#10;N,0.526884013&#10;N,0.0001&#10;Y,0.214610903&#10;N,0.0001&#10;N,0.016401764&#10;N,0.0001&#10;N,0.0001&#10;N,0.241970477&#10;Y,0.695495837&#10;N,0.317032673&#10;Y,0.607299397&#10;Y,0.548803481&#10;Y,0.33344099&#10;Y,0.559900239&#10;N,0.208394223&#10;Y,0.374677024&#10;Y,0.691080187&#10;N,0.320086813&#10;Y,0.711199976&#10;N,0.194466238&#10;N,0.233666338&#10;Y,0.700126118&#10;Y,0.692227304&#10;N,0.0001&#10;N,0.331453804&#10;N,0.046248195&#10;N,0.013222694&#10;Y,0.306499687&#10;N,0.149594568&#10;N,0.0001&#10;N,0.053380806&#10;N,0.0001&#10;N,0.0001&#10;N,0.023008113&#10;N,0.0001&#10;N,0.0001&#10;N,0.229674723&#10;N,0.0001&#10;N,0.0001&#10;Y,0.321182671&#10;Y,0.428749642&#10;Y,0.566150251&#10;N,0.0001&#10;Y,0.511773068&#10;Y,0.596826633&#10;Y,0.823276811&#10;N,0.524878327&#10;Y,0.386924324&#10;Y,0.747610463&#10;N,0.190618533&#10;Y,0.460864335&#10;Y,0.785706276&#10;Y,0.459875204&#10;N,0.0001&#10;N,0.254958384&#10;Y,0.185463342&#10;N,0.035334286&#10;N,0.075808253&#10;Y,0.854482472&#10;Y,0.914284326&#10;Y,0.212628439&#10;Y,0.265490188&#10;N,0.0001&#10;N,0.0001&#10;N,0.0001&#10;N,0.295387804&#10;N,0.405498812&#10;N,0.0001&#10;N,0.0001&#10;N,0.0001&#10;N,0.0001&#10;Y,0.611449556&#10;N,0.526792533&#10;N,0.0001&#10;N,0.133207602&#10;N,0.0001&#10;N,0.0001&#10;Y,0.300581865&#10;Y,0.158833098&#10;N,0.005364351&#10;Y,0.62159008&#10;Y,0.453849922&#10;N,0.187174104&#10;Y,0.866807928&#10;Y,0.806227147&#10;N,0.0001&#10;Y,0.362711419&#10;Y,0.43583843&#10;N,0.0001&#10;Y,0.602603798&#10;Y,0.663746571&#10;N,0.199855035&#10;Y,0.722291116&#10;Y,0.406066934&#10;N,0.331255266&#10;N,0.104007554&#10;Y,0.765300649&#10;Y,0.209248341&#10;N,0.0001&#10;N,0.121066031&#10;N,0.03341763&#10;N,0.0001&#10;Y,0.610553932&#10;N,0.0001&#10;N,0.052303161&#10;N,0.077363827&#10;Y,0.405943411&#10;N,0.065796284&#10;N,0.162271252&#10;N,0.169449634&#10;N,0.0001&#10;Y,0.779449556&#10;Y,0.19624205&#10;N,0.294631095&#10;N,0.291751597&#10;N,0.0001&#10;N,0.0001&#10;N,0.013072464&#10;Y,0.517111032&#10;N,0.0001&#10;Y,0.365286909&#10;Y,0.46479032&#10;Y,0.230558948&#10;Y,0.417642527&#10;Y,0.449738427&#10;Y,0.264059427&#10;Y,0.695118223&#10;N,0.090090211&#10;N,0.154512044&#10;N,0.039469784&#10;N,0.0001&#10;N,0.0001&#10;Y,0.735186954&#10;Y,0.256441841&#10;Y,0.106400168&#10;N,0.165173342&#10;Y,0.53432136&#10;Y,0.642590241&#10;Y,0.493018827&#10;Y,0.70583896&#10;N,0.0001&#10;N,0.202781829&#10;Y,0.971718293&#10;N,0.0001&#10;N,0.0001&#10;Y,0.418778437&#10;N,0.0001&#10;N,0.169709239&#10;N,0.0001&#10;Y,0.769994131&#10;Y,0.5753103&#10;N,0.232768014&#10;Y,0.133646896&#10;Y,0.553130877&#10;Y,0.279022074&#10;Y,0.751445026&#10;Y,0.421113498&#10;N,0.0001&#10;Y,0.487873541&#10;N,0.03316964&#10;Y,0.451994726&#10;N,0.158025789&#10;Y,0.454016039&#10;N,0.0001&#10;N,0.0001&#10;Y,0.472813314&#10;Y,0.527048191&#10;Y,0.947359869&#10;N,0.0001&#10;Y,0.729952878&#10;N,0.0001&#10;Y,0.712574396&#10;N,0.0001&#10;N,0.250259731&#10;N,0.0001&#10;N,0.174528678&#10;N,0.0001&#10;Y,0.318162899&#10;Y,0.197255877&#10;Y,0.439948842&#10;N,0.0001&#10;Y,0.151991212&#10;Y,0.422560972&#10;Y,0.403602741&#10;Y,0.851536446&#10;N,0.0001&#10;Y,0.312774584&#10;Y,0.500420116&#10;N,0.24236253&#10;Y,0.766122181&#10;Y,0.683882082&#10;N,0.0001&#10;Y,0.33215044&#10;N,0.135521792&#10;Y,0.729956278&#10;N,0.375581592&#10;Y,0.224688697&#10;Y,0.12008483&#10;Y,0.612192195&#10;Y,0.726500396&#10;Y,0.554846858&#10;Y,0.138862007&#10;Y,0.498733144&#10;Y,0.133926581&#10;N,0.019771907&#10;N,0.0001&#10;N,0.0001&#10;Y,0.418526176&#10;N,0.0001&#10;Y,0.693800082&#10;Y,0.094795326&#10;Y,0.925085811&#10;N,0.15195066&#10;Y,0.788710019&#10;N,0.0001&#10;N,0.0001&#10;N,0.297479909&#10;Y,0.290528007&#10;Y,0.601438588&#10;N,0.0001&#10;Y,0.353469645&#10;Y,0.408118578&#10;Y,0.538191918&#10;Y,0.253631898&#10;N,0.0001&#10;Y,0.526085645&#10;N,0.0001&#10;Y,0.460109653&#10;Y,0.775072288&#10;N,0.0001&#10;Y,0.489153238&#10;N,0.0001&#10;N,0.0001&#10;N,0.034608624&#10;Y,0.411143627&#10;Y,0.403309021&#10;Y,0.690479379&#10;Y,0.58645295&#10;Y,0.703471435&#10;N,0.240645419&#10;N,0.317348965&#10;N,0.0001&#10;N,0.0001&#10;Y,0.479985015&#10;N,0.051663453&#10;N,0.151098679&#10;Y,0.400885126&#10;Y,0.669478979&#10;N,0.0001&#10;N,0.084509219&#10;N,0.104969007&#10;N,0.202747595&#10;N,0.0001&#10;Y,0.248550676&#10;Y,0.736360718&#10;Y,0.507362049&#10;Y,0.45185447&#10;N,0.170658129&#10;N,0.0001&#10;Y,0.492524913&#10;Y,0.863828983&#10;Y,0.505563511&#10;Y,0.855626349&#10;Y,0.214503677&#10;Y,0.667043014&#10;N,0.04338791&#10;N,0.268321785&#10;N,0.163068649&#10;N,0.032860214&#10;Y,0.432603468&#10;N,0.050831568&#10;Y,0.282183637&#10;Y,0.497255402&#10;Y,0.507714476&#10;N,0.048046271&#10;N,0.302599739&#10;Y,0.552843342&#10;N,0.0001&#10;N,0.0001&#10;N,0.045763161&#10;N,0.0001&#10;Y,0.35923354&#10;Y,0.275079272&#10;Y,0.490030294&#10;N,0.093214431&#10;Y,0.33982672&#10;Y,0.228286029&#10;N,0.173078966&#10;N,0.24842934&#10;N,0.0001&#10;Y,0.215257771&#10;N,0.10263881&#10;Y,0.609961692&#10;Y,0.153339016&#10;N,0.040604182&#10;N,0.0001&#10;Y,0.420378131&#10;N,0.035050649&#10;N,0.0001&#10;Y,0.956775757&#10;N,0.312246201&#10;N,0.0001&#10;Y,0.619621516&#10;N,0.062474506&#10;Y,0.83682199&#10;N,0.0001&#10;N,0.0001&#10;N,0.087984095&#10;Y,0.513109824&#10;Y,0.168519626&#10;N,0.0001&#10;N,0.0125382&#10;Y,0.623915238&#10;N,0.299362197&#10;Y,0.700795017&#10;Y,0.639515816&#10;N,0.0001&#10;Y,0.423247208&#10;Y,0.314171344&#10;N,0.0001&#10;Y,0.675042884&#10;Y,0.858816065&#10;N,0.0001&#10;N,0.262590264&#10;N,0.107755031&#10;Y,0.642963514&#10;Y,0.684925359&#10;Y,0.439486907&#10;Y,0.474113532&#10;Y,0.248236629&#10;Y,0.573986919&#10;N,0.015263223&#10;Y,0.65455098&#10;Y,0.699771428"/>
        <parameter key="column_separator" value=","/>
        <parameter key="parse_all_as_nominal" value="false"/>
        <parameter key="decimal_point_character" value="."/>
        <parameter key="trim_attribute_names" value="true"/>
      </operator>
      <operator activated="true" class="generate_attributes" compatibility="9.6.000" expanded="true" height="82" name="Generate Attributes" width="90" x="179" y="238">
        <list key="function_descriptions">
          <parameter key="pred" value="Data"/>
          <parameter key="confidence(N)" value="1-[Predicted (Model)]"/>
          <parameter key="confidence(Y)" value="[Predicted (Model)]"/>
        </list>
        <parameter key="keep_all" value="true"/>
      </operator>
      <operator activated="true" class="nominal_to_binominal" compatibility="9.6.000" expanded="true" height="103" name="Nominal to Binominal" width="90" x="313" y="238">
        <parameter key="return_preprocessing_model" value="false"/>
        <parameter key="create_view" value="false"/>
        <parameter key="attribute_filter_type" value="single"/>
        <parameter key="attribute" value="pred"/>
        <parameter key="attributes" value=""/>
        <parameter key="use_except_expression" value="false"/>
        <parameter key="value_type" value="nominal"/>
        <parameter key="use_value_type_exception" value="false"/>
        <parameter key="except_value_type" value="file_path"/>
        <parameter key="block_type" value="single_value"/>
        <parameter key="use_block_type_exception" value="false"/>
        <parameter key="except_block_type" value="single_value"/>
        <parameter key="invert_selection" value="false"/>
        <parameter key="include_special_attributes" value="false"/>
        <parameter key="transform_binominal" value="false"/>
        <parameter key="use_underscore_in_name" value="false"/>
      </operator>
      <operator activated="true" class="set_role" compatibility="9.6.000" expanded="true" height="82" name="Set Role" width="90" x="447" y="238">
        <parameter key="attribute_name" value="Data"/>
        <parameter key="target_role" value="label"/>
        <list key="set_additional_roles">
          <parameter key="pred" value="prediction"/>
          <parameter key="confidence(N)" value="confidence(N)"/>
          <parameter key="confidence(Y)" value="confidence(Y)"/>
        </list>
      </operator>
      <operator activated="true" class="select_attributes" compatibility="9.6.000" expanded="true" height="82" name="Select Attributes" width="90" x="581" y="238">
        <parameter key="attribute_filter_type" value="single"/>
        <parameter key="attribute" value="Predicted (Model)"/>
        <parameter key="attributes" value=""/>
        <parameter key="use_except_expression" value="false"/>
        <parameter key="value_type" value="attribute_value"/>
        <parameter key="use_value_type_exception" value="false"/>
        <parameter key="except_value_type" value="time"/>
        <parameter key="block_type" value="attribute_block"/>
        <parameter key="use_block_type_exception" value="false"/>
        <parameter key="except_block_type" value="value_matrix_row_start"/>
        <parameter key="invert_selection" value="true"/>
        <parameter key="include_special_attributes" value="false"/>
      </operator>
      <operator activated="true" breakpoints="before" class="apply_threshold" compatibility="9.6.000" expanded="true" height="82" name="Apply Threshold" width="90" x="715" y="238"/>
      <connect from_op="Create Threshold" from_port="output" to_op="Apply Threshold" to_port="threshold"/>
      <connect from_op="Create ExampleSet" from_port="output" to_op="Generate Attributes" to_port="example set input"/>
      <connect from_op="Generate Attributes" from_port="example set output" to_op="Nominal to Binominal" to_port="example set input"/>
      <connect from_op="Nominal to Binominal" from_port="example set output" to_op="Set Role" to_port="example set input"/>
      <connect from_op="Set Role" from_port="example set output" to_op="Select Attributes" to_port="example set input"/>
      <connect from_op="Select Attributes" from_port="example set output" to_op="Apply Threshold" to_port="example set"/>
      <connect from_op="Apply Threshold" from_port="example set" to_port="result 1"/>
      <portSpacing port="source_input 1" spacing="0"/>
      <portSpacing port="sink_result 1" spacing="0"/>
      <portSpacing port="sink_result 2" spacing="0"/>
    </process>
  </operator>
</process>
<br>

Best Answer

  • BalazsBaranyBalazsBarany Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert Posts: 955 Unicorn
    Solution Accepted
    Hi @tors,

    I looked at a different process and how it creates the confidence attributes. The role is named slightly differently, like this:
    confidence_value.

    So changing your process to assign the roles confidence_N and confidence_Y solves the problem. I was able to enter different thresholds in Create Threshold and got the expected result.

    Regards,
    Balázs

Answers

  • BalazsBaranyBalazsBarany Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert Posts: 955 Unicorn
    edited March 2020
    Hi @tors,

    if you name your attributes and roles correctly, it will work.
    The confidences have to be confidence(N) and confidence(Y) in this situation, as your prediction contains Y or N.

    It was hard to reproduce your process without the incoming data. For test data in the Community, it's easy to use Create ExampleSet with generator type = comma separated text and just enter some example data.

    Regards,
    Balázs
  • torstors Member Posts: 3 Learner I
    BalazsBarany (changing names to "confidence(Y)" etc and using a generator for reproduction). however, the same issue persists. have I still missed something?
Sign In or Register to comment.