View Full Version : Bulk WHOIS lookup

09-20-2010, 06:06 PM
I'm looking to be able to look up multiple URLs (100-1000) at a time and get bulk WHOIS data (Admin, email, Phone) outputted into a CSV file.

Ideally, I can input a list of URLs and it pops out as a CSV.

I don't really know how much this would cost to build.

09-21-2010, 05:23 PM
I can do this for you, but there are going to be several issues with the system...

First, many WHOIS servers are programming to not allow bulk lookups (meaning if you ask them for info too often, they'll block your IP address for 30 minutes or something similar) so it's really not possible to "bulk" query, you'd need to set up something to randomly query the system on variable intervals. Running 1000s might take an hour to do.

Second, a lot of domains have private registration, so you'd get "domains by proxy" etc, instead of actual contact info.

If you're still interested and can accept the limitations above, let me know and I can provide you with an estimate.

09-28-2010, 09:18 PM
There are ways around the blocking of the IP issue..... you can always use proxies, but proxies are generally unreliable & can't be counted on..... also generally slower.

05-27-2011, 03:36 PM
Closing thread.