Stream a large json file s3 into postgres from java

Cerrado Publicado hace 2 años Pagado a la entrega
Cerrado Pagado a la entrega

I need help with streaming a large json file from s3 into a postgres table from java.

I have a working solution in python but I want to get it done using java

The basic idea is we get mutiple gzipped json files into our s3 from a third party provider.

I want to be able to process those files and load them into postgres without downloading the entire file into the memory

If we can get 1 file work that way we can then look into multithreading

The crux of it is read the content from gzipped json in s3 without downloading the entire file into the memory

More info: [login to view URL]

Java J2EE Arquitectura de software PostgreSQL AWS Lambda JSON PostgreSQL Administration PostgreSQL Programming

Nº del proyecto: #32171658

Sobre el proyecto

35 propuestas Proyecto remoto Activo hace 2 años

35 freelancers están ofertando un promedio de $564 por este trabajo

AwaisChaudhry

Hi, I have read the details I believe I can do this job. While I believe I have some queries which need to be clarified. For that I would request you to start the chat so we could clarify those. We can discuss the time Más

$1650 USD en 30 días
(127 comentarios)
8.7
ahmedbilal2506

Hi sir I am interested to work with you. I can provide you professional web design services. I can design for you according to your requirements. I will give you unlimited revision until you will not satisfy for your d Más

$250 USD en 2 días
(120 comentarios)
6.2
apgrl123

hi, i have rich experienced of java/javafx so that i can give you the perfect result. java/javafx is my top skill and i am majoring it for over 6 years. i have completed the several projects already so i have confiden Más

$500 USD en 7 días
(23 comentarios)
6.4
ayesha0124

Hi there, How r u? I bid as i believe that I can help you with this project as i have the experience with PostgreSQL, Java, Software Architecture, AWS Lambda and J2EE. here is my portfolio: https://www.freelancer.com/u Más

$750 USD en 28 días
(7 comentarios)
5.2
oxankaorb

Hello, Thank you for your job posting. I have good experience to work with streaming large json file from s3 bucket in AWS. As a 5 yrs experience with software development, work with medium and big companies in russia. Más

$500 USD en 7 días
(7 comentarios)
5.3
hsh564cf84accd96

We will do your Json work I am writing this proposal in order to work for you in Software and Web Development. We are highly trained professional developers seeking to freelance and earn online. Having a flair in prog Más

$400 USD en 7 días
(20 comentarios)
5.1
oleksdevr

Strong java and python are required skills for your project. I will do your task in really short period. Let us discuss this soon.

$750 USD en 7 días
(15 comentarios)
5.6
SpencerLuo

Hi I have read your project description and I'm pretty sure I can complete your project in the deadline. I would like to discuss more details via chat. Thanks, Luo

$500 USD en 7 días
(6 comentarios)
4.6
Koki1216

Hi Vivek, this is Koki from Jp and I am familiar working with python/java as well as AWS s3 storage too. I have understood your requirement so send me the one sample file and the demo account for testing if you can do Más

$700 USD en 7 días
(4 comentarios)
4.8
ivanovatale

I’m an IOI/APIO (International Olympiad in Informatics, Asia Pacific Olympiad in Informatics) medalist and ICPC (International Collegiate Programming Contest) semifinalist. I have 2 years experience in coaching informa Más

$500 USD en 7 días
(4 comentarios)
4.5
RomanMatveev1

A Java Expert! Hello, dear client! Hope you are doing well. I have checked your requirements. Your project is not difficult for me at all. Please check my reviews to see my ability. Best regards for you!

$350 USD en 3 días
(14 comentarios)
4.2
gregtechnola9

Hello, Greetings for the day!!! I have gone through your requirement and understood every aspect of them. I can fulfill your requirement flawlessly. I have more than 4 years of experience with happy clients. I ass Más

$750 USD en 30 días
(9 comentarios)
4.4
umairkaramat24

Hi! How are you doing? I have read the project description and really interested in this job, I have 4 years’ experience doing similar jobs regarding to these skills AWS Lambda, Java, PostgreSQL, J2EE and Software Arch Más

$750 USD en 14 días
(10 comentarios)
4.0
vladilavsuhovoy1

Hello ! I am skilled Python developer. I am familiar with Python and I have a lot of work experiences in Java, J2EE, PostgreSQL, AWS Lambda and Software Architecture. I can start right away. I want to discuss for thi Más

$500 USD en 5 días
(2 comentarios)
3.2
tblome

Hello, I'm a Senior Java Backend Software Developer with 15 years of experience. What would be the requested deliverable? A Java library (.jar) that you can use in another project, or a standalone (web-) application? I Más

$500 USD en 7 días
(1 comentario)
3.0
oleksandrscherb7

Hi I read your proposal and I am confident this job. I know Postgres very well. Please discuss more details via chat. Thank you.

$500 USD en 3 días
(3 comentarios)
3.2
perezmirabile

Hello, i am a system engineer (I have a software factory micro company, and have a lot of help from my partners) We can have a call if you consider. Thanks for your time

$500 USD en 7 días
(2 comentarios)
2.5
ToBeFree

Hello, I have all the skills and experience to do this work and in the best way/conditions. For me, the client / employer is completely satisfied or reimbursed Best regards,

$250 USD en 7 días
(1 comentario)
1.8
igorkasatkinweb

Hi, *@Your best fit Here!!@* I’ve read your brief very carefully and I see I can do this as you want prefect. I think I am best suitable for your job, so don't waste time finding other developer. I have strong experien Más

$300 USD en 7 días
(1 comentario)
1.0
sujitnss

I'm a student working as AWS intern in Amazon Development Center. The requirement is not very clear. My understanding is as follows: 1. Read compressed json files from s3. The connectivity depends on the project. thi Más

$700 USD en 14 días
(0 comentarios)
0.0