How to connect Rapidminer with a database (ScienceDirect, Scopus etc.)?

RMNewbie

Hello together.

I'm a total beginner with Rapidminer and I want to use it for my Master-Thesis.
First I would like to describe to you what I want to use Rapidminer for.
Rapidminer is supposed to do a topic modelling for me. The goal is to get a word cloud with the most important topics.
I want to use multiple articles, book chapters etc. from ScienceDirect. I got over 6,000 results in my first search, so it would be impossible to download all of them one by one. Is it possible to create a connection to a database like ScienceDirect?

I hope you can help me. Maybe I'm totally wrong with my approach and Rapidminer won't work like that.

Thank you!

Hannes

MartinLiebig

Hi there,

ScienceDirect is not a database in the traditional sense. Usual databases like postgres, mysql etc are of course easily connectable.

The question at hand here is what the services offer as progammable way to interface with them. If they have a way to connect, we can see what we can do and usually there is a way to read it.

Best,

ceaperez

Hi @RMNewbie,
What I use to do in this case, is to work with Scopus and export the search results with all the details that I need for my analysis as csv. After that, you can work with RM text processing extenssion to analyze your data.

best, 

Cesar

RMNewbie

Hey Martin,

thanks for your answer, it helps me a lot.

Kind regards,

Hannes

RMNewbie

Hey Cesar,

thanks for the tip, it sounds great! I will give it a try.

Best,

Hannes