The RapidMiner community is on read-only mode until further notice. Technical support via cases will continue to work as is. For any urgent licensing related requests from Students/Faculty members, please use the Altair academic forum here.

"Data reading from DB in batch"

bvirulkarbvirulkar Member Posts: 5 Contributor II
edited June 2019 in Help
Hi Gurus,

We have functionality to write specified number of rows to database with 'Write' operator. Is there any way to define the same while reading the data from database. Also How does the data is read from database (in batch or completely)? where this data is kept and processed?

Thanks,
Bhushan
Tagged:

Answers

  • MariusHelfMariusHelf RapidMiner Certified Expert, Member Posts: 1,869 Unicorn
    Hi Bhushan,

    the Read Database operator always reads the complete data table (or the query you entered) in one big batch. SQL does not provide a simple means to "batchify" database reading. The data is then stored as a RapidMiner Example Set in memory.

    Best, Marius
Sign In or Register to comment.