Go Back   CodingForums.com > Web Projects and Services Marketplace > Web Projects > Medium projects (new script, new features, etc)

Notices

Before you post, read our: Rules & Posting Guidelines

Reply
 
Thread Tools Rate Thread
Enjoy an ad free experience by logging in. Not a member yet? Register.
Old 06-24-2009, 02:39 PM   PM User | #1
directresponse
New to the CF scene

 
Join Date: Jun 2009
Posts: 1
Thanks: 0
Thanked 0 Times in 0 Posts
directresponse is an unknown quantity at this point
Search Engine URL Scraper

1) Project Details: (be as specific as possible):
I am looking for a URL scraper similar to the one mentioned on: http://www.codingforums.com/archive/.../t-156958.html

Specifically, I need to be able to upload a list of keywords. This can be done via a csv file or just copy and paste into a text field. I need to be able to process multiple keywords at a time, I don't want to do this one by one.

I need it to scrape the top 100, 250, 500 or 1,000 results (let me pick) in Google, Yahoo, MSN, Bing, Ask (let me pick which ones or all). I see that on the scraper mentioned above, it also included the country type for the search engine (.com, .ca, .co.uk, .cn, .com.au, etc) I'd like this option also for each search engine if possible.

The top 100 results should be written to the screen, and all results to a csv file that I can download.

For the output here is what I need:

1) Keyword phrase used to find the site (since multiple keywords can be searched at once via the upload, I'll need to know which keyword found the site)
2) Search Engine
3) Title of website
4) URL of website
5) Root URL of website (not sure how hard this would be)



2) Payment Amount:
Quote Please

3) Payment method/ details (Paypal, check? Timeline?):
Paypal

As soon as possible

4) Additional Info (about project or potential bidders):

I'm new to this forum, but you can see on www.WickedFire.com that I pay on time for projects.
directresponse is offline   Reply With Quote
Old 06-26-2009, 07:59 AM   PM User | #2
it career
Banned

 
Join Date: Jun 2007
Location: Web Designer
Posts: 321
Thanks: 0
Thanked 6 Times in 6 Posts
it career can only hope to improve
Are you sure it is not illegal ?
it career is offline   Reply With Quote
Old 06-26-2009, 02:15 PM   PM User | #3
gnomeontherun
Senior Coder

 
gnomeontherun's Avatar
 
Join Date: Sep 2007
Location: Houston
Posts: 2,846
Thanks: 10
Thanked 238 Times in 229 Posts
gnomeontherun will become famous soon enoughgnomeontherun will become famous soon enough
Well Google provides an API, I'm sure its not too illegal but might be abusive, depending on what scale this will be implemented.
__________________
jeremy - gnomeontherun
Educated questions often get educated answers, and simple questions often get simple answers.
gnomeontherun is offline   Reply With Quote
Reply

Bookmarks

Jump To Top of Thread


Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 10:10 AM.


Advertisement
Log in to turn off these ads.