The Altair Community is migrating to a new platform to provide a better experience for you. The RapidMiner Community will merge with the Altair Community at the same time. In preparation for the migration, both communities are on read-only mode from July 15th - July 24th, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here.
Options

Append url parameter using loop

ecdbertecdbert Member Posts: 21 Maven
I'm sure this has been answered somewhere before.  I'm using the "Read HTML Tables' operator to scrape a table from a website.  However the data is across webpages that end with the page number, such as ?page=2.  How do I create a loop that changes the last digit with each step, using the "Loop Parameters" operator?

Best Answer

  • Options
    MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,525 RM Data Scientist
    Solution Accepted
    Hi,
    you can use the normal loop, which exposes a macro called iteration. you can then use
    ...?page=%{iteration}
    in your operator and are good to go. %{iteration} will be replaced by 1,2,3,4,5 etc.

    Only if you have more complex things to loop over you need to use for example Loop Values and loop over a predefined list of values.

    Best,
    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany

Answers

Sign In or Register to comment.