Store Crawler - Spider
$750-1500 USD
Pagado a la entrega
Subject of this project is to develop a program – Store Crawler – which will search the web for retail stores and record next variables:
-Crawl date/time
-URL of the product
-name of the store and its logo
-SKU - product code (if available and can be parsed out of the product page)
-product EAN (if available and can be parsed out of the product page)
-product name
-category and subcategories
-description
-image
-price
Every crawled product must be grouped by SKU, EAN or part of the product name. Grouping algorithm must be very intelligent. It must know which product is similar to other products, so they can be grouped together by product name.
There must be also an option, which tells the crawler which country will be crawled.
The identification whether crawled URL is a retail store or not, must be decided by the robot.
The goal is to build product comparison site.
Your task would be to fill the database with every product searchable through internet with method described below.
For each store custom spider would be made.
Url's of that stores would be scraped from directories or manually entered. Number of retail stores, approx. 3000 or more
Then we need to get all URL's from specific retail store: like sitemap or get it through google index with api search method, using "site:[login to view URL]" parameter.
Custom spider GUI would have start and stop field for each needed attribute, which would instruct the spider what to search on specific retail store.
After that, spider/bot would go through all url's of particular store and search for pre entered terms.
Example:
go at [login to view URL]
We need the price.
Source code tells us, that the price value begins after
td><b>Cena z DDV:</b></td><td>
and ends before
</td>
so crawler would search for that plain text.
Won't work with any type of broker or middleman. You must be the actual coder. We work with individual coders only. We work direct with our vendors.
Details of this small, starter project will be shared inside the PMB with qualified vendors.
Post an offer of $666 and 6 days on this project so I know you've read this and understand English. Price will be set afterwards, when all details will be discussed. Place an offer of anything other than $666 and 6 days and you'll be ignored, I promise.
If you're a real provider, with real experience, post an offer, message and then we'll chat in the PMB.
Nº del proyecto: #2519305
Sobre el proyecto
Adjudicado a:
23 freelancers están ofertando un promedio de $1051 por este trabajo
Hi, We have designed and built websites for various types of businesses very effectively. We work with all of our clients individually to easily coordinate and to keep track of the requirements and scope. We fulfill Más
We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.
Hello There I would like to help you in this task.i will charge $666 and 6 days on this project Thankyou
$666 and 6 days (Can't be posted in BID due to restriction of minimum amount $750). Hi, Bid is to provided exactly what its stated in post, I can show you my recent similar jobs. Many Thanks
Hello, I can do this work for you and I'm ready to start. Please see pmb for details. Regards Raul
I already done like this project. I will collect all products details in CSV. More details sent to you, Thank you
Hello Respected Client, 666 for 6day I have Read your requirements and we are very experience in this concept. please check Message Board for more details. Thanks
Hello Sir, i made the bid as you requested but the mini is 750 so no one can make 666 :!! I'm expert in web scrapping , crawling .
We are a Web design and development company that focuses on regular communication with our clients and timely delivery for all our projects. Some of the technologies/area that we focus include:
It is not possible to bid $666 on this project! I've tried. I am experienced programer. Can I get some more info please?
Dear Sir, Veltrod Technologies is a global software consulting company specialized in providing Mobile applications, Social media frameworks and eCommerce solutions. Leveraging best-in-class people, processes, and Más
Hi, I tried bidding at $666 as per your description/requirement but it is not letting me place a bid lesser than 750. Please check your PM.