Find Jobs
Hire Freelancers

Migrate a database to support data warehousing, OLAP and big data

$30-250 AUD

En curso
Publicado hace alrededor de 5 años

$30-250 AUD

Pagado a la entrega
This project aims to transform an existing database to support analytical processing (OLAP) for a data-warehouse that holds a huge amount of data and streams more data on daily basis. The analytical tasks are mostly statistical such as mean, variance, normalization, standardization, max, min, median. The challenge here is that the nested queries and the big data make the response time too slow and consumes lots of computational power that takes the server down. The requirement here is : 1. Propose a solution to make these reports more efficient in a way that allows the site to load in less than a second 2. evaluating the performance of current queries 3. Install and configure the necessary needed software to the server (if any) 4. Migrate the database from the current DBMS (MySQL) to the new DBMS 5. Migrate the views and nested queries in the current database to be efficiently implemented in the new database 6. Review each SQL statements to and propose how it can be optimized to run in the most efficient way 7. Create and optimize materialized views + triggers as needed 8. optimize the performance of the migrated database The deliverable: A new database to be used by the website with response time less than 3 seconds. I will just change the connection string in my site to connect to the new database and it should load the same data from the same views as fast as it can. The new database should be able to handle huge amounts of data (more than 30 million records) Obviously, MySQL does not support nested select statements, so many queries are just created to be used by the end queries for business. The business queries used by the site are listed at the end of the attached document. These queries must be created by the same names in the new database. The other internal queries used implicitly by the main queries can be traced through the code or listed from MySQL Before awarding the project, I will have a chat with each applicant to discuss the proposed solutions, the data warehousing experience and query optimization method.
ID del proyecto: 18770030

Información sobre el proyecto

18 propuestas
Proyecto remoto
Activo hace 5 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
18 freelancers están ofertando un promedio de $415 AUD por este trabajo
Avatar del usuario
Hello, I have checked the project requirements. We can discuss further in more details on this task. Thanks.
$250 AUD en 5 días
5,0 (25 comentarios)
6,2
6,2
Avatar del usuario
Hello, I can work on this project. I have much experience working with Data Warehousing. I worked on Target's Store-BI DTK Toolkit with Data Stage as ETL processes, Hyperrol as Multi-Dimmension Data Cubes (OLAP engine) that help reports, and j2ee for the BI reports (200+ report pages with 5000+ online management users) , Database uses IBM DB2 and Oracle. (Target Stores have about 1800+ Brick-Mortar retail stores located throughout the United States) Best Regards, An Ho
$155 AUD en 3 días
4,7 (2 comentarios)
3,7
3,7
Avatar del usuario
I have more than 18 years of experience working on highly regulated environments and supporting large scale database installations. I am here to help you. Please contact me to learn more details about the project. I have careful reviewed the attachment. The
$1.666 AUD en 15 días
4,8 (1 comentario)
2,9
2,9
Avatar del usuario
Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks
$55 AUD en 1 día
5,0 (2 comentarios)
3,0
3,0
Avatar del usuario
We DataLamp, is a Big Data company which works in Java, Data-Pipeline, BI/Visualisation/Reporting & Recommendation solutions. We also provide optimisation in existing architectural design for better performance. We have done projects in which we were supposed to optimise data warehouse response time. Last project to optimise queries of data warehouse was of a telecommunication in which we optimise the queries response time to 1-3 sec which was 30-40 sec. Would look forward to your reply where our solution architect will interact with you. Regards DataLamp
$277 AUD en 3 días
5,0 (1 comentario)
1,0
1,0
Avatar del usuario
Hi, I have 7+ year of experience in database development and BI implementation. Mostly I worked with Pentaho business suits and most of RDBMS databases. According to my personal experience I suggest you to choose HP vertica db. It has columnar storage support which provides high throughput in aggregating/ analytical queries. It is free till 1tb of storage. Let's have a call for understanding your requirement. I am sure that we will have a good and mutual beneficiary conversation.  Hoping to talk with you soon. Thanks.
$890 AUD en 10 días
5,0 (1 comentario)
1,1
1,1
Avatar del usuario
Hello We are team of smart developers working in IT industry from past 7-years have developed 200+ simple and complex Mobile phone apps for Android & iPhone, Hybrid app and many Websites in RubyOnRails,WordPress , Dot Net and PHP with a wide range of different features and technologies. Our area of expertise includes Android, iPhone, RubyOnRails, AngularJs, Dot Net , Postgresql, SQl Server, PHP, HTML, Graphics designs etc. Supportive - 24 full-time employees - Full-time customer care - Unlimited design options and revisions - 110% satisfaction guarantee Specialization - Website designing ( E-commerce, Static and Dynamic, Cryptocurrency) -CRM design - Logo design - Illustration - Packaging - Print Design - Animated Videos - brochure design We offer customized and high-quality design services at affordable prices. We promise quick turnaround times, great customer service and 100% original designs ! Thank you!
$250 AUD en 3 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Hi I am data engineer with 4+ years of experience. I have worked on analytics solutions using both clouds and on premises. I have experience in bi, dwh and big data. Relevant Skills and Experience Proposed solutions 1. Optimize the way we store data that is store in unnormalized way to make retrieval fast 2. Offload the data processing and bring back the data in prepared form for query
$500 AUD en 10 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Hello , I’m excited to share with you the proposal for this project. As I understand about your project it's truly challenging. I'll assure you that this project will complete within promise day. I’m truly excited to be working with you on your new logo redesign. I look forward to your response. All the best, Soumya
$166 AUD en 9 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
- 7.8 Years of onshore and offshore experience in EIM Technology, specializing in OLAP, ETL, Informatica, IBM DB2, Tableau, Quality Centre, Microsoft Sql Server, JIRA, Data Analysis, Alteryx. - Having a good understanding of Data Warehousing fundamentals including Dimensional Modeling. - Experience for 2 big 4 companies.
$277 AUD en 3 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Hello, Hope you are doing great ! As per your requirements, I saw a 50+ Tables where your destination source will fetch the data and you require a Analytical Database for this perpose. I having a 2+ years of experience in Data warehouse and Analytics as well as I'm a System Architect and have a experience of GCP platform. I have a solutions for your requirements. Regards Rahul Singh
$333 AUD en 10 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
I have gone through your requirement and I have done similar projects in past. The requirement is similar to what I am doing right now. we have a MySQL OLTP which we have migrated to postgresql. We have build DWH with dimensions and few facts based on reports also build aggregation and summary tables instead of using procedures. The ETL tool which I have been using is pentaho community edition. I hope I am pretty much fit to your requirement.
$777 AUD en 15 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
I will improve your system for the lowest possible price for you! I am researching working with big data as a project in my life and would really love to work on this project to endue more knowledge of subclosed data! ~Greetings from a bigdata fan Joeri m. van Velzen
$35 AUD en 0 día
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de AUSTRALIA
Geelong, Australia
4,9
37
Forma de pago verificada
Miembro desde feb 14, 2006

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.