04-02-2007, 10:48 PM
is screen scraping eithical? if i wanted to build a website that can provide motor insurnace quotes from "a number" of different providers websites, is screen scapping the way to achieve this?
i found this site - http://www.screen-scraper dot com
someone should make a comparison engine for the finance industry, i could resell that all day long.
04-02-2007, 11:50 PM
Is screen scraping ethical? Not in my opinion. Its content theft just the same as any other method of stealing content. *However* in the example of comparison engines you are effectively, advertising for the companies that come out top, personally I feel it should only be done with the permission of the sites that you are scraping.
04-03-2007, 08:46 AM
so hazel how would i build such an application?
i am uk based if u want to msn
04-03-2007, 09:50 AM
Money supermarket doesn't scrape for it's content! It's basically an affiliate website, with legitimate agreements between the providers and the aggregator. That's the route you want to take, rather than scraping, so you can actually make some money out of it.
04-03-2007, 02:30 PM
thanks pen, moneysup are very respectable i know.
i know someone that wants to outsource this project if you are interested.