Remote Data Mining And Management Job In Data Science And Analytics

Haskell - Reactive Streams for Big data & Systems programming

Find more Data Mining And Management remote jobs posted recently Worldwide

We are looking for engineers with extensive experience with Reactive Stream-based programming to build tooling for a stream library in Haskell.

We are building Realtime data processing systems using Haskell Streamly. Streamly is a high-performance library with Stream fusion, inlining and custom memory management (outside the GC), making it achieve performance gains that are impossible do with JVM based frameworks.

We are looking for Haskell / Scala engineers with deep expertise in stream-based programming - Flink, Spark Streaming, Akka Streams, RxJS etc. , to help us with these projects

- Add telemetry/stream monitoring infrastructure using Prometheus
- Add backpressure support in Streamly
- Add interfaces to Timeseries DBs (TimescaleDB, ClickHouse) and other systems like Redis Streams
- Add stream persistence in local disk
- Add master/worker topology for stream processing - master divides a single stream and uses workers as compute processors

-----
In addition to big data processing, we are also going to use Streamly for systems programming like - writing API rate limiters, Proxies that help in intelligently routing traffic, Intelligent infra auto scalers, Intelligent turn on/off, rerouting rule execution based on realtime data.

-----

People who would like to do high scale engineering & practical production work with FP/Haskell can apply. Thanks!
About the recuiter
Member since Sep 4, 2017
Penelope
from Bangkok, Thailand

Skills & Expertise Required

Data Science & Analytics Data Mining & Management 

Open for hiringApply before - Sep 2, 2024

Work from Anywhere

40 hrs / week

Hourly Type

Remote Job

$34.41

Cost

Offer to work on this project closes in 40 days!
Are you interested in this Opportunity?

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Similar Projects

Artificial Intelligence developer (Machine learning)

Looking for machine learning experienced individual who can help out to create a AI based program to filter data from 1000 or millions of reports based upon the keywords or searching criteria.
The algorithm/website/script will search the database...read more

corrupt jpeg file

i have about 400 images that i took pictures on my samsung s9 and saved to my micro sd card and it shows my images are corrupt...i need to retrieve these pictures....I will provide some examples with shortlisted candidates.

Excel Macro Work

project:
After finding same sentence in sheet1 from sheet2.
Macro work sample that I want would be delivered through a massage so that you can easy understand.