Crawl Web - empty results (PHP script)
I'm a social scientist learning to use RapidMiner for data/text mining and text analysis.
I've been trying to apply "Crawl Web" for the following address http://www.scielo.br/scielo.php?script=sci_issuetoc&pid=0102-690920180001&lng=pt&nrm=iso with no crawling rules applied and depth of 1, but I keep getting empty results.
I wonder if this is caused by the target page's php script. If so, does anyone know I workaround for this issue?
Also, any hints on setting the crawling rules so I get only the links with a specific link text. For example, in the URL above, I'm mostly interested in the pages with the text "Texto em Português".
Greeting from Brazil,