Options

# Dimensionality Reduction with SVD

Muhammed_Fatih_
Member Posts:

**93**Maven
Dear RapidMiner Community,

I am currently conducting a simple Singular Value Decomposition (SVD) process based on a TDM (Term Document Matrix) I've generated consdering Communication data. The matrix has 9662 attribute columns (terms) and in total 72826 rows. My SVD process is running for four days and has not finished yet. Especially the SVD operator itself is still loading (see attached).

Could you tell me what a "normal" computational time for such a matrix is with regard to dimenisonality reduction with SVD? Do I really need several days to compute SVD?

Thank you in advance for your help & support !

Best regards

Muhammed

I am currently conducting a simple Singular Value Decomposition (SVD) process based on a TDM (Term Document Matrix) I've generated consdering Communication data. The matrix has 9662 attribute columns (terms) and in total 72826 rows. My SVD process is running for four days and has not finished yet. Especially the SVD operator itself is still loading (see attached).

Could you tell me what a "normal" computational time for such a matrix is with regard to dimenisonality reduction with SVD? Do I really need several days to compute SVD?

Thank you in advance for your help & support !

Best regards

Muhammed

Tagged:

1

## Answers

568Unicorn93Maventhank you for your answer. The memory-, processor behaviour looks like the following:

I have a 32 gb memory on my computer. What would you say? Do you think, that additonal memory is needed to compute the process? Or are there alternatives with regard to SVD computation in order to speed up the process?

Thank you in advance for your answer.

Muhammed

568Unicorn