Find Jobs
Hire Freelancers

Data Engineer

$8-15 USD / hour

Cerrado
Publicado hace casi 2 años

$8-15 USD / hour

Job Description DATA ENGINEER: must also be able to problem solve in a structured way + build scalable and maintainable systems. INTEREST IN WORKING WITH AN EARLY STAGE BIG DATA STARTUP (ON THE CORE FOUNDING TEAM) This position will work under the advisory of a senior data engg advisor. Exp (6months - 3 yrs) with good foundational understanding /experience of data engineering on cloud & relevant Infra & ETL Experience with geospatial data processing is really useful. Experience with using at least one cloud provider or both (AWS preferred) Design and implement the data infrastructure platforms including the data ingestion, data consumption and processing on AWS cloud MUST - Hands on experience of handling large data sets and use of Python or PySpark/SQL/Hive/Impala for data analysis Deploying and scaling ML solutions using open-source frameworks - (MUST HAVE) Experience building ETL/ELT production pipelines from ground-up. Research and assess technology environment and trend for best practises to apply. Must have willingness to learn (demonstrated by work on projects/portfolio or learned any new skills recently) Supporting, Maintaining & Developing new enhancements in Enterprise AWS Developing and maintain IaC (Infrastructure as Code) and CI/CD Pipeline Improving infrastructure operations through better use of monitoring, cloud coding and scripting best practises Must have interest to work for startups rather than large entities Must be a good problem solver (good with structuring problems) Should be able to conceive the design of the cloud infra & pipeline to support MVP development within the time frame You will be responsible for deploying, automating, maintaining and managing cloud based production systems for big data analytics, to ensure the availability, performance, scalability and security of productions as well as delivery systems for initial lean product Must be able to solve processing issues for very large datasets (10GB - 100GB) To apply - reach out to This position is intended to become full time on funding with ESOP grants on offer too.
ID del proyecto: 33544788

Información sobre el proyecto

8 propuestas
Proyecto remoto
Activo hace 2 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
8 freelancers están ofertando un promedio de $16 USD /hora por este trabajo
Avatar del usuario
Implementing projects using Python and Machine Learning is our core forte since we are working on it for more than 5+ years now. We are a team of 50+ developers who have successfully delivered 350+ Machine Learning Projects since now. We also provide developer outsourcing and developer on demand. The recent project we worked on was to create data pipelines, which used millions of data points, for the identification of the best strategies to increase the effectiveness of professional educational events (specifically those events for medical device training all across the USA and elsewhere). This project was implemented for one of the world's largest and top fortune 500 companies "Johnson & Johnson". Apart from this tech stack, we do have hands-on experience in Deep Learning, Python, Neural networks, CNN, ANN, GAN, Data Science, Artificial Intelligence, NLP, NLTK, Computer Vision and so on which would be helpful in working on this project. Let's have a short call to discuss further & to put a point, why are we the best fit for this project. Thank you! Note: There is not much clarity about the project proposal, so please don't focus on the given quote. Post our discussion, we can share an actual ballpark estimation
$12 USD en 40 días
5,0 (1 comentario)
1,9
1,9
Avatar del usuario
I have total 12 plus years of experience especially in Development, DWH, ETL, SSIS, SQA, Database development & maintenance. • Very strong in Open Interfaces, SQL, PL/SQL, Stored procedures/packages, writing Test Scripts, Windows/Linux environment and both back-end database development and front-end development. Business Intelligence & ETL consultant with sound experience in end to end BI implementation. Sound experience in logical & physical modeling of semantic layer, reports and dashboard development in various BI tools like MicroStrategy, Microsoft Excel, Tableau, Power BI. My experience related to DWH of integratrating more than 300+ systems from multiple OLTPs like Oracle,SQL, MySql, DB2, CSV, excel,notepad... I have created my own SQL custom base CDC inform of procedure, SSIS packages and procedure to complete assigned task... Developed Powerful ETL Using PDI (Pentaho Data Integration). Good knowledge of Big Data Analytic s having worked and successfully delivered on Sentiment prediction of Social Data set. • Business Analysis and Requirement Gathering • Effort Estimation and Planning • Solution Design and Architecture • Logical and Physical Data Modeling (Semantic & Core) • Reports and Dashboard Design and Development • Advance Analytics and Big Data…
$11 USD en 40 días
4,8 (3 comentarios)
1,8
1,8
Avatar del usuario
Hi - I am part of a few startups and really enjoy new challenges in Data Analytics - I have many years of experience, am very quick. I have designed, developed and launched 2 Data Analytics dashboards - one in FInance, the other in Healthcare. I have worked for gloabl mining, manifacturing business and also the Royal Flying Doctor Service. Would love to hear your scope and aspirations.
$19 USD en 40 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
I have a 3 year of experience as data engineer. I have a good knowledge of pyspark spark aws sql MySQL python .
$12 USD en 40 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
I have 12+ Years in data and analytics space 7 years in banking in different roles from database developer/ admin / ETL expert/ analyst/ big data specialist. 5+ years in the airline in a different role as a big data architect/product owner. handled 400+TB of data as maximum capacity. handled sub-second call routing system in velocity of a distributed system. handled structured / unstructured/ Edifcat/EBCDIC data types in data variety. I can work best as an individual contributor as well in collaboration with team members and excited to be part of startup architecture. if you are the interested message we can discuss and proceed from there.
$25 USD en 20 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Why hire me ? 1) 3 + years experience in big data engineering. 2) Developed Pyspark Automation codes to automate the complete Spark transformation process. 3) Architectural knowledge of Hadoop, Spark. 4) Programming Languages - Python.,Pyspark, SQL and Hive. I would be working 2 hrs a day initially. Timings are flexible can be chosen by you. Available timings : M,T,W,T -- 7-10 AM IST OR 10-1 PM IST F,S,S -- 8PM-1 AM IST
$15 USD en 15 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de INDIA
Kochi, India
0,0
0
Miembro desde abr 25, 2022

Verificación del cliente

Otros trabajos de este cliente

React Js Developer
₹75000-150000 INR
¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.