Our company is dedicated to a project about machine learning applications on a cloud platform managing big data on the cloud and delivering services to stand alone customers.
We are looking for an experienced Fullstack/DevOps engineer that can help us setup and maintain our AWS infrastructure.
We are looking to setup a serverless infrastructure for our machine learning processing operation.
As shown in BigDataPipeline-High-Level-Architecture.
Our system uploads images (as described in the ERD) + meta-data. Which means we need to keep the images on S3 and the meta-data in the databases.
The RDS is there to allow us some flexibility with the queries until we understand our access patterns better.
The data structure should reflect the ERD attached. And be deployed using Terraform.
All code must be accompanied with unit tests.
An end to end test suit for the infrastructure is also a must.
Ultimately, we are looking for a DevOps engineer that can code python/GO/JS. Part devOps part fullstack. But we are willing to consider separate contractors for both. So, If you are only one or the other, let us know and we will consider it.
Responsibilities:
- Deploy infrastructure to AWS using Terraform and infrastructure as code best practices. This includes API Gateway, DynamoDB, RDS.
- Implement DynamoDB CRUD for the RawImage entity from ERD
- Implement Lambda chains for saving the images in S3 and the data in DynamoDB.
- Implement Lambda chains for listening for events on DynamoStream and updating the relevant tables in RDS.
- Implement the API gateway to facilitate the image uploading and querying.
- Implement 2 simple gui for uploading 2 different kinds of images.
Requirements:
- Terraform and infrastructure as code experience.
- Experience with serverless development
- AWS expertise.
- ML experience is a big plus
- Self-managed
- Technical background is a plus;
- Dedicated self-starter but team player attitude;
- Energetic, motivated and results-driven personality;
- Ability to take direction well and adhere to deadlines.
Additional info:
- This collaboration will start with this project as a test task. If successful, we'll collaborate on a different, hourly contract.
About the recuiterMember since May 20, 2018 Aditya Maulana
from Central Serbia, Serbia