Updated Web Mining Extension
We have updated the Web Mining extension. The new version can be found here:
This extension is one of the most frequently downloaded, and we have had lots of requests to update it. The development team replaced both “Crawl Web” and “Process Documents from Web” operators with new versions. This new extension supports binary content crawling, and it also supports crawling password protected pages via basic authentication. This will make it much more applicable to modern and more secure websites.