Write Database for large dataset

robinrobin Member Posts: 100 Guru
edited December 2018 in Help

I am attempting to limit the number of queires supplied back from the Read Database operator. When I write the code in SQL the LIMIT operator does not seem to be valid. What should I be using? 

SELECT `id_unique`
FROM `retrieved_id`
WHERE `id_count` IS NOT NULL
LIMIT 1000

Rapid Miner is giving me the full database back instead of the first 1k rows. 


Best Answer

  • Options
    BalazsBaranyBalazsBarany Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert Posts: 955 Unicorn
    Solution Accepted



    which database system are you using? 


    For me it works with PostgreSQL and MySQL, just tested with different limits (1000, 1300, 1500 etc.)


    The query is interpreted by your database server. RapidMiner just sends it to the database. (If "prepare statement" is checked, a bit differently, you could play with that.)


    Could you test the same query in some other tool (SQL client like SQuirrel SQL) with the same database?






  • Options
    robinrobin Member Posts: 100 Guru

    For some reason it now likes me and is working as designed. 

Sign In or Register to comment.