How to solve

BazlurBazlur Member Posts: 2 Newbie
edited September 2020 in Help
Dear Community Members,

I am trying to execute a process for a dataset with CMGOS anomaly detection technique. However, every time I try to execute with different parameters, the process is failed with "Matrix is Singular" error. From the discussion, I tried with a covariance matrix before the example set is passed to the clustering process. It still fails. Do you have any idea how to solve this error?

Best Answers

  • BazlurBazlur Member Posts: 2 Newbie
    Solution Accepted
    Thanks, jacobcybulski. Yes, obviously I have to use clustering, such as k-means or x-means before CMGOS. However, even after doing that I was facing the "Matrix is Singular" error. Later on, I solved the error by adding a Normalization operator to prepreocess the data before it passes to the clustering. Accordingly, I solved the problem.

Answers

  • jacobcybulskijacobcybulski Member, University Professor Posts: 391 Unicorn
    The error you are getting is common for data with linear dependencies between attributes. Note that first you need to create a centroid-based clustering system (such as k-means)  and only then apply CMGOS. Both k-means and CMGOS are sensitive to dependencies between attributes. So investigate attribute multicollinearities first, e.g. you can build a regression model without feature selection and no removal of collinearities and check for any coefficients with low tolerance. Alternatively, you can apply PCA to convert your attributes set to orthogonal uncorrelated attributes.
    Jacob
Sign In or Register to comment.