I am looking to find some way to interact with a website in a server side script or application. I basically want to monitor multiple websites for certain information. In order for me to do this, I need something to log into a secure website and navigate a few dynamically generated/ajax controlled pages to get the information I need.
I have basically done this client side in Firefox with Greasemonkey, but I want to be able to put this on my server, update a database, and be able to log into more than one session per website at a time.
I don't really care what language this is done with, but I would like to keep the secure login sessions open while I need them, so I am thinking Java servlets might be better than say perl or python.
Does anybody have any suggestions about how to do this or what I might look at to try to do this?