Description:
We have a running environment with MySQL db and we are starting to ingest more data than the db can handle, so we are looking for alternatives to architect Hadoop/Spark environment to offload most of that data into a Hadoop cluster.
Activities:
- Analyze our db and find the data that can be sent to Hadoop
- Build a Hadoop/Spark cluster that may scale in the short/long term
- Integrate both data sets seemingly into our back/frontend
- Collaborate with other developers
- Desirable: to optimize MySQL queries and structure used in the production application
Type of freelancer:
- Data scientist
- Must be able to meet (virtual) with the dev team on Central Time (USA)
- Willing to share knowledge with the rest of the team
About the recuiterMember since Nov 11, 2022 Sri Sindiaaesih
from Grevenmacher, Luxembourg