The Altair Community is migrating to a new platform to provide a better experience for you. The RapidMiner Community will merge with the Altair Community at the same time. In preparation for the migration, both communities are on read-only mode from July 15th - July 24th, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here.


ThiruThiru Member Posts: 100 Guru
hi all,  

I m working on a classification problem  and I would like to know, any correlation between rows. 

the application here is , classification of fault status of machine. 

 if I consider rows with  Label1 -  representing fault free state of the machine,  and label 2-  representing faulty state of the machine, and if these rows are  correlated, my classification algorithm like kNN is not performing in classifying them.

so, I would like to find correlation between them and determine the value - to study the reason behind the non performance of selected algorithm.




  • Options
    David_ADavid_A Administrator, Moderator, Employee, RMResearcher, Member Posts: 297 RM Research
    Hi @Thiru ,

    taking a look at the correlation is a very good starting point.
    There are several operators that can calculate different correlation measures, for example:
    • Correlation Matrix, to give you an overview of the correlation between all attributes
    • Weight by Correlation, to get the correlation between attributes and a label
    • AutoCorrelation, if you think there might be a time dependent component in your data
    Also AutoModel is already taking care of correlations and might give you some hints where to look at.

  • Options
    ThiruThiru Member Posts: 100 Guru
    David_A ,

    thanks for your reply.  However my query was with respect to rows. 
    To explain further,  how to differentiate the values of rows of faulty state  vs rows of fault free state. 

    I suspect one of my cases, the algorithm is not working
    because of the correlation between  attribute values with respect to class 1 and
    the same attribute values but with respect to class 2 .   Is there any way to calculate these.


  • Options
    BalazsBaranyBalazsBarany Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert Posts: 955 Unicorn
    Hi Thiru,

    correlation the way we understand it is a two-dimensional concept: attribute (column) A and Attribute (column) B are said to be correlated if the values of A and B in the same rows are correlated (if A is large, B is large). 

    It would be possible to flip the axis and calculate the correlation that way but I'm not sure if you mean this. If you do, select the two examples (rows) e. g. with Filter Examples or Filter Example Range and use Transpose to turn the rows into columns.

Sign In or Register to comment.