Hello and welcome to our community! Is this your first visit?
Enjoy an ad free experience by logging in. Not a member yet? Register.
Results 1 to 2 of 2
  1. #1
    New Coder complete's Avatar
    Join Date
    Jul 2005
    Thanked 0 Times in 0 Posts

    How do I get search engine results programatically?

    How do I get search engine results programatically? Some search engines use AJAX to display content and so the URL does not change. This makes it difficult to get result content from a search engine programatically.

    Most search engines do not use AJAX. But two popular ones that I am interested in is YANDEX and DUCKDUCKGO. Both of these search engines use AJAX to advance beyond the first page of results. How do I find a way to programatically access these pages?

  2. #2
    Senior Coder rnd me's Avatar
    Join Date
    Jun 2007
    Thanked 626 Times in 605 Posts
    the url always changes, just maybe not in the url bar.
    use firebug or [F12] to find the real urls that bring in more results.
    if you have permissions to fetch those urls, they should be nearly ready to go.

    btw, you can use yahoo and google's APIs to search those services from any page using JSONp.
    google's was called its "ajax search api" last time i used it, and yahoo has pipes and YQL are going strong.
    Create, Share, and Debug HTML pages and snippets with a cool new web app I helped create: pagedemos.com


Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts