...

View Full Version : Web developer/programmer for new retail site



john92862
05-28-2010, 03:08 AM
I am looking for someone who knows website design, database and web crawling/scraping.

Basically the idea is that the site would crawl the internet and pull items for sale from different retail websites and organize them in a way on the site (already planned out - in a dynamic scrolling fashion) which would hopefully make the person want to buy the item. The transaction to buy would occur from the website this site pulled it from - but giving the referring site a commission under various affiliate programs. From what I can tell the website design would require knowledge of HTML and all of its versions, Photoshop, Flash and Java, etc. The site should look very modern but doesnt need too many bells and whistles. For the webcrawling piece the coder would need to know how to program the site to be able to scrape this information from other sites ona frequesnt basis keeping the information very fresh, perhaps done in AJAX and XML, and put it in a database?, and then display it on the site.

If you are interested please reply with a brief description of why you think this project is technically feasible and what programming languages you propose to use. also time required and bid price. I am willing to do this on a step by step basis paying in frequent small intervals so you dont run the risk of not being paid. Strict non-disclosure agreement will be required. Thanks in advance.

John

bcarl314
06-01-2010, 03:35 PM
A few questions on this project...

First, there are many other price aggregation services out there, what is different about yours?

Second, what type of caching mechanism are you thinking of implementing? Obviously, a live query to each site isn't feasible, so some type of "get" and "save" mechanism will need to be used. But this will incur a time lag. What's acceptable to you here?

Third, are you thinking of starting with big affiliate programs like Shopzilla, Amazon, CJ, and link share? If so, many of them offer direct APIs to their inventory, so you wouldn't even need to waste time with "scraping" sites.

Forth, what's your marketing plan ? How do you plan on driving traffic to the site?

Fifth, what type of reporting / tracking do you need?

Sixth, if you are scraping, creating a generic algorithm to consistently grab the product name and price will be an ongoing issue. Because sites will change their HTML, formatting, etc which will make the spiders accuracy deteriorate over time. How do you want to plan for this?

Seventh, how are you going to match products from one site to another. For example: 2 sites might be selling a "Nikon d50" camera. But one of them may have it as a bundle (so it might be $500) and another would be the camera only (so it might be $250). Unfortunately, UPCs and MPIDs are not always available nor consistent across systems, and sites. How do you propose to handle this.

Finally, what's your expectation on cost? Are you thinking sub $1k, $5k - $10k, or more? Just some ballpark will help better identify potential programmers.

I'm interested in helping you on this project, but would like to know the answers to your questions above. You can either reply here, or email me at brandon [ @@@ ] aphion [ dot ] com.

credentbizsolns
06-02-2010, 10:32 PM
John:

I represent an IT Firm headquartered at 'Los Angeles' with our "Development Center" at an offshore destination, for almost a decade now we have built IT Systems which has helped our Clients stay ahead of their competition.

In response to your post below, I suggest that you visit one of the website we have built which is similar to the one you want, the website is www.theecog.com, the only possible difference would be this site uses API feeds where as that has to be substituted with 'Crawlers' in your case, this is just my perception, I shall be able to give you an intelligent solution once I get to speak to you.

Please write to me at ross.marian@credentbizsolns.com and I shall call you to discuss after which I shall e-mail a formal proposal which would also comprise of our 'Project Approach"

Looking forward to hear from you on receipt of this message.

Sincerely
Ross Marian



I am looking for someone who knows website design, database and web crawling/scraping.

Basically the idea is that the site would crawl the internet and pull items for sale from different retail websites and organize them in a way on the site (already planned out - in a dynamic scrolling fashion) which would hopefully make the person want to buy the item. The transaction to buy would occur from the website this site pulled it from - but giving the referring site a commission under various affiliate programs. From what I can tell the website design would require knowledge of HTML and all of its versions, Photoshop, Flash and Java, etc. The site should look very modern but doesnt need too many bells and whistles. For the webcrawling piece the coder would need to know how to program the site to be able to scrape this information from other sites ona frequesnt basis keeping the information very fresh, perhaps done in AJAX and XML, and put it in a database?, and then display it on the site.

If you are interested please reply with a brief description of why you think this project is technically feasible and what programming languages you propose to use. also time required and bid price. I am willing to do this on a step by step basis paying in frequent small intervals so you dont run the risk of not being paid. Strict non-disclosure agreement will be required. Thanks in advance.

John

Fumigator
06-02-2010, 10:59 PM
John:

I represent an IT Firm headquartered at 'Los Angeles' with our "Development Center" at an offshore destination, for almost a decade now we have built IT Systems which has helped our Clients stay ahead of their competition.

In response to your post below, I suggest that you visit one of the website we have built which is similar to the one you want, the website is www.theecog.com, the only possible difference would be this site uses API feeds where as that has to be substituted with 'Crawlers' in your case, this is just my perception, I shall be able to give you an intelligent solution once I get to speak to you.

Please write to me at ross.marian@credentbizsolns.com and I shall call you to discuss after which I shall e-mail a formal proposal which would also comprise of our 'Project Approach"

Looking forward to hear from you on receipt of this message.

Sincerely
Ross Marian



Do you specialize in websites for the legally blind?

credentbizsolns
06-02-2010, 11:10 PM
My apologies, I just choose the wrong font, I choose '7' thinking that will be too small, but then it turned out to be something else..

Best regards
Ross Marian

Rowsdower!
06-03-2010, 03:06 PM
My apologies, I just choose the wrong font, I choose '7' thinking that will be too small, but then it turned out to be something else..

Best regards
Ross Marian

Please edit that post so it's not such an unbelievable eyesore. In the future you can make use of the "preview post" button, which is located conveniently next to the "submit reply" button.

I shall be glad to see that fixed. I shall thank you, I shall.

sonal_m
06-04-2010, 08:36 AM
I am looking for someone who knows website design, database and web crawling/scraping.

Basically the idea is that the site would crawl the internet and pull items for sale from different retail websites and organize them in a way on the site (already planned out - in a dynamic scrolling fashion) which would hopefully make the person want to buy the item. The transaction to buy would occur from the website this site pulled it from - but giving the referring site a commission under various affiliate programs. From what I can tell the website design would require knowledge of HTML and all of its versions, Photoshop, Flash and Java, etc. The site should look very modern but doesnt need too many bells and whistles. For the webcrawling piece the coder would need to know how to program the site to be able to scrape this information from other sites ona frequesnt basis keeping the information very fresh, perhaps done in AJAX and XML, and put it in a database?, and then display it on the site.

If you are interested please reply with a brief description of why you think this project is technically feasible and what programming languages you propose to use. also time required and bid price. I am willing to do this on a step by step basis paying in frequent small intervals so you dont run the risk of not being paid. Strict non-disclosure agreement will be required. Thanks in advance.

John
Hi john,

You can take help of USourceIT.We help our clients to source their IT needs at NO cost to them.Submit your requirements to our global network of 5,000 plus IT service providers across the globe.

For more information visit: www.usourceit.com.


Best wishes for your IT requirement.

thanks and Regards,

Sonal



EZ Archive Ads Plugin for vBulletin Copyright 2006 Computer Help Forum