Extract Information
GuruHi - I'd like to try extract only the company names from this web page https://www.digitalmarketplace.service.gov.uk/g-cloud/search?q=, i.e. the second piece of text in each block. Is Process Documents from the Web, and Extract Information, the most efficient way to do this? And I'm new to Rapidminer and XPath, and wondered if anyone could advise the right XPath query expression to extract only the company name?
Best Answers
-
Options
Telcontar120
Moderator, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,635 
Unicorn
I can't help with the XPath query (I find XPath to be very finicky) but the attached process using simple string matching should do the trick. You can also do it with RegEx if you prefer.
0 -
OptionsTelcontar120
Moderator, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,635 Unicorn
Yes, because get pages returns an exampleset rather than a document collection, you may need to add nominal to text and extract document operators as well, and put the subsequent processing inside a loop to iterate over multiple pages.
0
Answers
Fantastic! Thank you for sending the sample process. So much easier with the string approach.
If I wanted to do that for multiple pages, would I replace Get Page with Read Excel + Get Pages? Seem to then get an error when connecting to Cut Document.
Thank you. I struggled with the loop approach (will save that for when I've got more adept with Rapidminer), but I have got a working solution by using Read Excel > Get Pages > Data to Documents > Combine Documents > Cut Document.