Installing , Setting up and Running BuBING Web Crawler on Digital Ocean Droplet
€30-250 EUR
Pagado a la entrega
As a company we have some droplets hosted on Digital Ocean and we have already a very long list of websites and domains (and subdomains) that need to be crawled: from every url, the crawler need to fetch webpage title and metatags (if any).
In order to do so, there is a crawler that is already there, [login to view URL] but it is quite hard for our team to deploy it, install it and run it.
This job requires the installation of BuBing crawler into the droplet, the correct setup in order to not get blocked by webpages and run it. After that, for each page the title and metatags need to be saved into a file that will be then parsed by one of our scripts and given to the databases.
Long story short: install, setup and run BuBing given a list of urls.
Nº del proyecto: #18537468
Sobre el proyecto
6 freelancers están ofertando un promedio de €201 por este trabajo
can do your job. These are my skills related to web scraping and crawling Have done scraping in CasperJS Phantomjs, python. Have done testing and automation with selenium also. Know to deal with database like mon Más
I am very interested in your project, because I have much experience in web Scraping I have good skills with the program language including python, C# , JAVA ,PHP . So I am a expert with web scraping (1000 over pro Más
Hello? How are you? I have good experiences in "Installing , Setting up and Running BuBING Web Crawler on Digital Ocean Droplet" as you can see my profile for these (Shell Script, Web Crawling, Web Scraping). I have Más
Hello, I can install, configure and setup the BuBING Web Crawler in the digital ocean server. Please let me know if you are interested so we can discuss the project further. Waiting for your reply. Thank you
Hi, We would like to Design and Build your online store / personal website / simple website / Management CRM application, We would like to provide you Website Design and then you select it and then if changes need we c Más
