Options
"Logging into pages with Password Protection before crawl"
Contributor I
Hello, I've searched for about an hour and can't find this answer:
What I am trying to do is crawl my distributor's website for all the products I sell from them. The problem is, I have to be logged in to see the products as they don't display the information to the public since it would show wholesale pricing, etc.
All I need to do is pass my login credentials before running my Crawl Web, but I can' seem to figure out how to do this?
Any help or direction would be greatly appreciated!
What I am trying to do is crawl my distributor's website for all the products I sell from them. The problem is, I have to be logged in to see the products as they don't display the information to the public since it would show wholesale pricing, etc.
All I need to do is pass my login credentials before running my Crawl Web, but I can' seem to figure out how to do this?
Any help or direction would be greatly appreciated!
Tagged:
0
