Authenticated website listings scraper & file downloaders

Cerrado Publicado hace 5 años Pagado a la entrega
Cerrado Pagado a la entrega

Looking for a Go developer to create a scraper for 3 websites:

1: login & download excel -> extract rows and send to DB

2: login & download csv -> send to DB

3: login & scrape listings (3 pages):

a) paginated listing page

b) listing admin page

c) listing public page

d) send to DB

Scraper should be 3 Go packages, one for each website. Each package should have:

a) an interface to start/stop

b) detect failure (connection & html format change)

c) configurable retry on connection fail (retry max X times, every Y seconds)

d) delay of X seconds between page requests

e) concurrent listing data export interface

The projects must be developed in the Go programming language.

Golang Extracción de datos web

Nº del proyecto: #17319885

Sobre el proyecto

6 propuestas Proyecto remoto Activo hace 5 años

6 freelancers están ofertando un promedio de $213 por este trabajo

mhmhz

Hi I propose to implement the 3 scrapers in C# (to make it multi-threading) Thanks

$300 USD en 2 días
(98 comentarios)
7.6
bestit4u

Hi I am very,very interested in your project My name is Shan Bin and I'm a Chinese developer. I have 6 years of development experience such this projects. I am a highly skilled developer in C, C++, C#, Python, Java, Más

$155 USD en 3 días
(70 comentarios)
6.8
kenavpatel

1) I am confident to extract the row in Excel and send to the DB 2) also can do CSV and send to DB. 3) 3 pages which you have mentioned will also get scrapped. it is easy for me And Scrapping will be done as you have Más

$200 USD en 2 días
(0 comentarios)
0.0
akhileshgandhi

Hello There, I can develop a scraper for scraping data from different websites. Can also show some samples of your given task. I have extreme experience in Web Scraping. Have done a lot of work of Scrapping. I use Más

$248 USD en 3 días
(0 comentarios)
0.0