Data Cleaning with Trifacta and R

I have a continuing flow of data that is extracted from school websites that needs to be checked and validated before it is made available for an R analytics platform.

I am looking at using a combination of R (we already have quite a lot of code) and Trifacta. The data sets are small but they need to be joined together very accurately. Often the data contains errors and incomplete data for linking across sources. We either access the required data from previous data that has been ingested or ask schools for the additional data.

The first task in the process is to identify all issues of validity and completeness in each data set, followed by implementing a strategy for to fix any issues.

I am seeking a consultant who is familiar with Trifacta and/or R to build a strategy that targets each data source with a series of analyses that locate the issues in the data that is drawn from that source. In total there could be up to 100 sources for which we need to develop recipes in this cleaning and validation stage.

We want to automate the process as much as possible, by adding additional rules/procedures to each recipe until it contains all the steps required for the data that comes from each specific source.
About the recuiter
Member since Mar 14, 2020
Karan Marwah
from Neamt, Romania

---

---

Offer to work on this project closes in 59 days!
Are you interested in this Opportunity?

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions