"Data reading from DB in batch"

bvirulkarbvirulkar Member Posts: 5 Contributor II
edited June 2019 in Help
Hi Gurus,

We have functionality to write specified number of rows to database with 'Write' operator. Is there any way to define the same while reading the data from database. Also How does the data is read from database (in batch or completely)? where this data is kept and processed?



  • Options
    MariusHelfMariusHelf RapidMiner Certified Expert, Member Posts: 1,869 Unicorn
    Hi Bhushan,

    the Read Database operator always reads the complete data table (or the query you entered) in one big batch. SQL does not provide a simple means to "batchify" database reading. The data is then stored as a RapidMiner Example Set in memory.

    Best, Marius
Sign In or Register to comment.