Find Jobs
Hire Freelancers

Build me a crawling tool

$30-250 USD

Cerrado
Publicado hace más de 4 años

$30-250 USD

Pagado a la entrega
- We need you to build us a crawling tool from scratch which follow these requirements: --- Requirements --- - The tool should be used Scapy Python and MongoDB. - It should dockerized into docker-compose separated into two containers: web and db. - It should be easier to extend if we gonna crawl the new site. Such as we will have folderA will crawl site A, folderB will crawl site B...etc - It should be easier for configure the database and the site we gonna crawling. - When the structure of codebase is done, we will review it and you need to send us a documentation to show: + How can we setup crawler for new site ? + Which file/folder need to be created + Which command need to be executed to crawl all the sites which were configured in the codebase. - We will send you an example site, so you will do an example for us when the structure of codebase is done. - I will send you invitation to github repository then you will work on it. ---- Note --- - Please read it carefully before you ask us or bid with the right price. - Only release payment if the codebase is good enough and easy for us to crawling the site. - Please mark prefix 'DDPythonMongo' when you bid. Otherwise, I'll skip the bid due to automatically bid or bot.
ID del proyecto: 21358106

Información sobre el proyecto

15 propuestas
Proyecto remoto
Activo hace 4 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
15 freelancers están ofertando un promedio de $181 USD por este trabajo
Avatar del usuario
Hello Respect sir I saw your description, I can't stand the excitement of seeing the project you post on... I bet one's shirt on I have the ability to complete your project perfetly because I have experience with your projet. Let me explain my basic experience at the first. I have been working as the development team leader for 21 years and my basic skills are Object C, C++, C#, Java, Javascript, Pythone, Node.Js. So I have about 1000 web Crawling(Scraping) experiences.(SportsBetting site(Bet365, Betfair, Maxbet, 1Xbet, Aleabet, Stanleybet, Glodbet, Wiliamhill, Eurobet, ---Betburger, Blogbet, Oddsportsal) , CasinoBetting site, Shopping site, Booking site, Dateing site , Nomal site..) The most amazing thing for me is to have a complete analysis and understanding of the betting parts and to have control of Betfair, Bet365, Pinnacle, Bwin, Stanleybet, Planetwin365, Eruobet. etc. Also,the automatic sports '*'Betting Bot'*' for these things (ValueBet, Surebet) I built and more than 1700 clients is contacting me, they are earning a lot of money for use my bots. Also the income of the bot is Awesome!! Please Contact me , I will share when you contact with me , you can check it yourself. In these latter day I have some free times, So I have time to work with you preferentially. Verve !! This is a source of creation Thank you for wishing you happy!
$140 USD en 7 días
4,9 (90 comentarios)
6,9
6,9
Avatar del usuario
Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep
$220 USD en 4 días
5,0 (59 comentarios)
6,7
6,7
Avatar del usuario
'DDPythonMongo' Hello sir, Please take a look at my reviews and portfolio. I have completed web/data scraping jobs many times. I am interested in your project as well. I would like to discuss details via pm. I look forward to hearing from you soon. Best Regards,
$400 USD en 5 días
5,0 (49 comentarios)
5,8
5,8
Avatar del usuario
Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less ,,,,,,, 
$222 USD en 3 días
4,9 (104 comentarios)
5,9
5,9
Avatar del usuario
Hello, How are you? I'm very interested in your job post.I believe my skills would be ideal for your project. I am Python Expert and I have rich experience with Web Scraping and I can help you perfectly. And then I am a good english speaker. So anytime,anywhere you will discuss anything with me freely. My wonderful service will give you pleasure and happiness. I hope you will contact with me and work together. Best Regards..
$140 USD en 5 días
4,8 (11 comentarios)
4,9
4,9
Avatar del usuario
DDPythonMongo. I can create the crawler with python, scrapy and mongo; dockerized with docker-compose, that can be managed from the database (depending on the type and content of sites being crawled and scaled). Please contact me for further discussion.
$200 USD en 7 días
4,6 (13 comentarios)
4,5
4,5
Avatar del usuario
DDPythonMongo Dear, employer. OK, NO PROBLEM! I am a Web Scraping expert. After reading over your description this looks like a perfect fit for my skill sets. I estimate to complete your project within the time-line after clarifying all requirements, project details, and milestones. Ready to work right now. Add in chat for discussing....work right now. Thank you.
$150 USD en 7 días
4,6 (5 comentarios)
3,6
3,6
Avatar del usuario
I've really rich experience in Machine Learning with R (R studio) and Python Programming. I am having 7+ years of experience in Data Science using tools like Python, R, and Spark. I have worked on several similar projects before! Experienced in Machine learning algorithms Worked on several real time case studies Tools: Python Packages: • Scikit-Learn • Numpy • Scipy • Pandas • Matplotlib • Stats models Statistics/Machine Learning Algorithms: • Linear & Logistic Regression • SVM • PCA • LDA • Decision Tree • Random Forests • Clustering • Dimensionality Reduction • Naive Bayes
$140 USD en 7 días
3,6 (6 comentarios)
4,2
4,2
Avatar del usuario
Hi , I am a mathematician. I use scrapy to crawl websites. I use python scripts to shell websites and xpath tofind textual data. I test the python commands in shell using python jupyter before transposing it to code in pycharm. I know how to connect to mongodb in spider folder to save data. DDPythonMongo
$100 USD en 7 días
2,9 (6 comentarios)
3,4
3,4
Avatar del usuario
DDPythonMongo Hello Dear Client, i have read your requirements and based on the information provided i can do this project for you, let discuss more in chat if you are interested and let me know there about the data that needs to be saved and for further process answer my questions there..
$222 USD en 2 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Thanks for your posting      I  already created SIMILAR Project and I am  ready to provide your DEMO WORK FREE AND check out my work and then take your decision     Do you want demo ????   please cåontact me å       I have 15 years of expert team in Mobile apps, Website, Software and Game development.    Thanks and Regards, 
$140 USD en 7 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
DDPythonMongo Hello, I have been developing reptiles for 2 years. I am qualified for this job and look forward to working with you.
$140 USD en 7 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de VIETNAM
Ho Chi Minh, Vietnam
5,0
2
Forma de pago verificada
Miembro desde nov 26, 2016

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.