Required software development freelancer for Apache Druid Consultant for log managment job
Posted at - Sep 17, 2024
Toogit Instant Connect Enabled
We are looking for a Druid consultant with the following criteria and scope of work:
1. Has good knowledge of Apache Druid and has worked with this technology in the past. 2. Will need to conduct a POC using Druid consisting of the following (environment to conduct the POC will be provided by us): a. Interface Druid with Kafka using Druid's Kafka Json connector b. Write a script to pump in logs into Kafka at a rate of 20000 logs per second which will be ingested into Druid c. Write a script to pump in logs into Druid directly to ingest six months of data (that is 20000 logs per second for six months) d. Set up Druid cluster as required to handle this kind of load - ensure that Druid runs stably e. Write queries to retrieve log records from Druid - create partitions / indexes etc to enable fast retrieval
About the recuiterMember since Nov 11, 2022 Rabin Ramdjas from Orenburg Oblast, Russia