Hello and welcome to our community! Is this your first visit?
Register
Enjoy an ad free experience by logging in. Not a member yet? Register.
Results 1 to 4 of 4
  1. #1
    New to the CF scene
    Join Date
    Sep 2010
    Posts
    2
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Bulk WHOIS lookup

    I'm looking to be able to look up multiple URLs (100-1000) at a time and get bulk WHOIS data (Admin, email, Phone) outputted into a CSV file.

    Ideally, I can input a list of URLs and it pops out as a CSV.

    I don't really know how much this would cost to build.

  • #2
    Mega-ultimate member
    Join Date
    Jun 2002
    Location
    Winona, MN - The land of 10,000 lakes
    Posts
    1,855
    Thanks
    1
    Thanked 45 Times in 42 Posts
    I can do this for you, but there are going to be several issues with the system...

    First, many WHOIS servers are programming to not allow bulk lookups (meaning if you ask them for info too often, they'll block your IP address for 30 minutes or something similar) so it's really not possible to "bulk" query, you'd need to set up something to randomly query the system on variable intervals. Running 1000s might take an hour to do.

    Second, a lot of domains have private registration, so you'd get "domains by proxy" etc, instead of actual contact info.

    If you're still interested and can accept the limitations above, let me know and I can provide you with an estimate.

  • #3
    Regular Coder
    Join Date
    Apr 2004
    Posts
    682
    Thanks
    24
    Thanked 1 Time in 1 Post
    There are ways around the blocking of the IP issue..... you can always use proxies, but proxies are generally unreliable & can't be counted on..... also generally slower.

  • #4
    Mega-ultimate member
    Join Date
    Jun 2002
    Location
    Winona, MN - The land of 10,000 lakes
    Posts
    1,855
    Thanks
    1
    Thanked 45 Times in 42 Posts
    Closing thread.


  •  

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts
    •