Hello and welcome to our community! Is this your first visit?
Register
Enjoy an ad free experience by logging in. Not a member yet? Register.
Results 1 to 7 of 7
  1. #1
    New to the CF scene
    Join Date
    May 2010
    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Web developer/programmer for new retail site

    I am looking for someone who knows website design, database and web crawling/scraping.

    Basically the idea is that the site would crawl the internet and pull items for sale from different retail websites and organize them in a way on the site (already planned out - in a dynamic scrolling fashion) which would hopefully make the person want to buy the item. The transaction to buy would occur from the website this site pulled it from - but giving the referring site a commission under various affiliate programs. From what I can tell the website design would require knowledge of HTML and all of its versions, Photoshop, Flash and Java, etc. The site should look very modern but doesnt need too many bells and whistles. For the webcrawling piece the coder would need to know how to program the site to be able to scrape this information from other sites ona frequesnt basis keeping the information very fresh, perhaps done in AJAX and XML, and put it in a database?, and then display it on the site.

    If you are interested please reply with a brief description of why you think this project is technically feasible and what programming languages you propose to use. also time required and bid price. I am willing to do this on a step by step basis paying in frequent small intervals so you dont run the risk of not being paid. Strict non-disclosure agreement will be required. Thanks in advance.

    John

  • #2
    Mega-ultimate member
    Join Date
    Jun 2002
    Location
    Winona, MN - The land of 10,000 lakes
    Posts
    1,855
    Thanks
    1
    Thanked 45 Times in 42 Posts
    A few questions on this project...

    First, there are many other price aggregation services out there, what is different about yours?

    Second, what type of caching mechanism are you thinking of implementing? Obviously, a live query to each site isn't feasible, so some type of "get" and "save" mechanism will need to be used. But this will incur a time lag. What's acceptable to you here?

    Third, are you thinking of starting with big affiliate programs like Shopzilla, Amazon, CJ, and link share? If so, many of them offer direct APIs to their inventory, so you wouldn't even need to waste time with "scraping" sites.

    Forth, what's your marketing plan ? How do you plan on driving traffic to the site?

    Fifth, what type of reporting / tracking do you need?

    Sixth, if you are scraping, creating a generic algorithm to consistently grab the product name and price will be an ongoing issue. Because sites will change their HTML, formatting, etc which will make the spiders accuracy deteriorate over time. How do you want to plan for this?

    Seventh, how are you going to match products from one site to another. For example: 2 sites might be selling a "Nikon d50" camera. But one of them may have it as a bundle (so it might be $500) and another would be the camera only (so it might be $250). Unfortunately, UPCs and MPIDs are not always available nor consistent across systems, and sites. How do you propose to handle this.

    Finally, what's your expectation on cost? Are you thinking sub $1k, $5k - $10k, or more? Just some ballpark will help better identify potential programmers.

    I'm interested in helping you on this project, but would like to know the answers to your questions above. You can either reply here, or email me at brandon [ @@@ ] aphion [ dot ] com.

  • #3
    New to the CF scene
    Join Date
    Jun 2010
    Posts
    2
    Thanks
    0
    Thanked 0 Times in 0 Posts
    John:

    I represent an IT Firm headquartered at 'Los Angeles' with our "Development Center" at an offshore destination, for almost a decade now we have built IT Systems which has helped our Clients stay ahead of their competition.

    In response to your post below, I suggest that you visit one of the website we have built which is similar to the one you want, the website is www.theecog.com, the only possible difference would be this site uses API feeds where as that has to be substituted with 'Crawlers' in your case, this is just my perception, I shall be able to give you an intelligent solution once I get to speak to you.

    Please write to me at ross.marian@credentbizsolns.com and I shall call you to discuss after which I shall e-mail a formal proposal which would also comprise of our 'Project Approach"

    Looking forward to hear from you on receipt of this message.

    Sincerely
    Ross Marian



    Quote Originally Posted by john92862 View Post
    I am looking for someone who knows website design, database and web crawling/scraping.

    Basically the idea is that the site would crawl the internet and pull items for sale from different retail websites and organize them in a way on the site (already planned out - in a dynamic scrolling fashion) which would hopefully make the person want to buy the item. The transaction to buy would occur from the website this site pulled it from - but giving the referring site a commission under various affiliate programs. From what I can tell the website design would require knowledge of HTML and all of its versions, Photoshop, Flash and Java, etc. The site should look very modern but doesnt need too many bells and whistles. For the webcrawling piece the coder would need to know how to program the site to be able to scrape this information from other sites ona frequesnt basis keeping the information very fresh, perhaps done in AJAX and XML, and put it in a database?, and then display it on the site.

    If you are interested please reply with a brief description of why you think this project is technically feasible and what programming languages you propose to use. also time required and bid price. I am willing to do this on a step by step basis paying in frequent small intervals so you dont run the risk of not being paid. Strict non-disclosure agreement will be required. Thanks in advance.

    John
    Last edited by credentbizsolns; 06-02-2010 at 09:35 PM.

  • #4
    UE Antagonizer Fumigator's Avatar
    Join Date
    Dec 2005
    Location
    Utah, USA, Northwestern hemisphere, Earth, Solar System, Milky Way Galaxy, Alpha Quadrant
    Posts
    7,691
    Thanks
    42
    Thanked 637 Times in 625 Posts
    Quote Originally Posted by credentbizsolns View Post
    John:

    I represent an IT Firm headquartered at 'Los Angeles' with our "Development Center" at an offshore destination, for almost a decade now we have built IT Systems which has helped our Clients stay ahead of their competition.

    In response to your post below, I suggest that you visit one of the website we have built which is similar to the one you want, the website is www.theecog.com, the only possible difference would be this site uses API feeds where as that has to be substituted with 'Crawlers' in your case, this is just my perception, I shall be able to give you an intelligent solution once I get to speak to you.

    Please write to me at ross.marian@credentbizsolns.com and I shall call you to discuss after which I shall e-mail a formal proposal which would also comprise of our 'Project Approach"

    Looking forward to hear from you on receipt of this message.

    Sincerely
    Ross Marian


    Do you specialize in websites for the legally blind?

  • #5
    New to the CF scene
    Join Date
    Jun 2010
    Posts
    2
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Apology

    My apologies, I just choose the wrong font, I choose '7' thinking that will be too small, but then it turned out to be something else..

    Best regards
    Ross Marian

  • #6
    Senior Coder Rowsdower!'s Avatar
    Join Date
    Oct 2008
    Location
    Some say it's everything.
    Posts
    2,027
    Thanks
    5
    Thanked 397 Times in 390 Posts
    Quote Originally Posted by credentbizsolns View Post
    My apologies, I just choose the wrong font, I choose '7' thinking that will be too small, but then it turned out to be something else..

    Best regards
    Ross Marian
    Please edit that post so it's not such an unbelievable eyesore. In the future you can make use of the "preview post" button, which is located conveniently next to the "submit reply" button.

    I shall be glad to see that fixed. I shall thank you, I shall.
    The object of opening the mind, as of opening the mouth, is to shut it again on something solid. G.K. Chesterton
    See Mediocrity in its Infancy
    It's usually a good idea to start out with this at the VERY TOP of your CSS: * {border:0;margin:0;padding:0;}
    Seek and you shall find... basically:
    validate your markup | view your page cross-browser/cross-platform | free web tutorials | free hosting

  • #7
    New to the CF scene
    Join Date
    Mar 2010
    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by john92862 View Post
    I am looking for someone who knows website design, database and web crawling/scraping.

    Basically the idea is that the site would crawl the internet and pull items for sale from different retail websites and organize them in a way on the site (already planned out - in a dynamic scrolling fashion) which would hopefully make the person want to buy the item. The transaction to buy would occur from the website this site pulled it from - but giving the referring site a commission under various affiliate programs. From what I can tell the website design would require knowledge of HTML and all of its versions, Photoshop, Flash and Java, etc. The site should look very modern but doesnt need too many bells and whistles. For the webcrawling piece the coder would need to know how to program the site to be able to scrape this information from other sites ona frequesnt basis keeping the information very fresh, perhaps done in AJAX and XML, and put it in a database?, and then display it on the site.

    If you are interested please reply with a brief description of why you think this project is technically feasible and what programming languages you propose to use. also time required and bid price. I am willing to do this on a step by step basis paying in frequent small intervals so you dont run the risk of not being paid. Strict non-disclosure agreement will be required. Thanks in advance.

    John
    Hi john,

    You can take help of USourceIT.We help our clients to source their IT needs at NO cost to them.Submit your requirements to our global network of 5,000 plus IT service providers across the globe.

    For more information visit: www.usourceit.com.


    Best wishes for your IT requirement.

    thanks and Regards,

    Sonal


  •  

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts
    •