Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.

Append url parameter using loop

ecdbertecdbert Member Posts: 21 Maven
in Help
I'm sure this has been answered somewhere before.  I'm using the "Read HTML Tables' operator to scrape a table from a website.  However the data is across webpages that end with the page number, such as ?page=2.  How do I create a loop that changes the last digit with each step, using the "Loop Parameters" operator?
Tagged:

Best Answer

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,531 RM Data Scientist
    Solution Accepted
    Hi,
    you can use the normal loop, which exposes a macro called iteration. you can then use
    ...?page=%{iteration}
    in your operator and are good to go. %{iteration} will be replaced by 1,2,3,4,5 etc.

    Only if you have more complex things to loop over you need to use for example Loop Values and loop over a predefined list of values.

    Best,
    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany

Answers

Sign In or Register to comment.