...

View Full Version : Fetching Content



Lee Stevens
02-16-2008, 03:55 PM
Afternoon!

Right well, i would like to no if there is a script that can grab content from another website?

More about what i want it to do:
Well, i play a MMORPG and i would like it so when i login the script automatically grabs all the users listed on that page. Then i can use them on my site.

If you dont understand i'll try to explain abit better :P

mlseim
02-16-2008, 05:53 PM
It's called "web scraping", you can Google that.

Your webhost may or may not allow "fopen" to open a URL.
Depending on version of PHP or "php.ini" settings.
You may end up searching for "PHP CURL" functions instead.

I guess it would be similar to creating an RSS Feed Reader.

That leads me to this part ... "web scraping" is not really an
ethical way to get information. You essentially are consuming
bandwidth from the other site. With permission from the other
site owner (they may be OK with it), I guess you can do it though.

That's the whole point of sites providing RSS. They can cache
the XML files and let users gather timely information. The host
of the RSS feed stays in control of the information and the
caching (which affects the bandwidth).

I'm not going to provide any snippets because in my opinion, it's not ethical.

Lee Stevens
02-16-2008, 07:54 PM
That's okay thank you for your reply anyway. I'll defently google that.

The reason i need to "web scrap" is because they don't provide a RSS for this part. So this is the only alternative.



EZ Archive Ads Plugin for vBulletin Copyright 2006 Computer Help Forum