Remote Network And System Administration Job In IT And Networking

ETL work

Find more Network And System Administration remote jobs posted recently Worldwide

I am looking for a team for doing the ETL (Data extraction, translation and loading) work. The work can be given on turnkey basis. The data in context is 5G data which is coming from nodes. scope of work is as follows -

1. The main Project Goal is to deliver the contracted equipment, Software and related services including Requirement Analysis, Solution Design and Planning, Implementation (Installation and Configuration, Customization, Integration and Testing) to enable the service, within an agreed timeline, and with agreed scope.

2. The scope will be high level cover below.

This following item will be required as part of this requirement:
- Implement ETL application to process PM file in xml format and load into database table in raw counter tables.
- Huawei eUTRAN
- ZTE eUTRAN
- KPI Formula parser / loader from excel file
- KPI Meta-Store & Configuration
- Web based Management UI
- Manipulate and aggregate data and insert into counter tables.

The solution will consist of following modules:

Performance Management System (PMS) Meta-store

PMS Meta-store is central repository for data definition as well as Runtime profile. Meta-store contains following items:

- Counter definition

- Formula

- Raw Counter Table definition

- Runtime Configuration

Web-based Configuration

ETL Configuration is web-based application that provide user to manage meta-store. System administrator will use this module to manage Counter definition, Formula, Raw Counter table definition and Runtime Configuration.

Service for ETL Platform:

Following modules need to be implemented:

- Meta-store
- ETL Configuration
- Runtime Controller
- Decoder
- Spark Application
- Loader

The main activities within this Service are:

- Provide installation and configuration software into new hardware
- Provide result of data comparison between counter table loaded by existing and new solution
About the recuiter
Member since Mar 14, 2020
Umesh Sharma
from Guerrero, Mexico

Skills & Expertise Required

XML Big Data Hadoop Apache Spark Data Mining 

Open for hiringApply before - Aug 9, 2024

Work from Anywhere

40 hrs / week

Hourly Type

Remote Job

$4.79

Cost

Offer to work on this project closes in 21 days!
Are you interested in this Opportunity?

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Similar Projects

Scraper needed to sort spreadsheet

Hello,
We are looking for an experienced scraper to sort an Excel spreadsheet with 30 million+ parts in it and run all of the part numbers through eBay, leaving only the in stock parts remaining in the spreadsheet. Anyone who is interested in th...read more

Create Spark Helm Chart (latest version)

Hi, what I need is the following:

- I need a helm script (kubernetes) which installs the latest spark version as yarn cluster on kubernetes

- This setup should provide Zeppelin

- All of this has to work with sparks lat...read more

Craigslist phone scraping

I have ongoing requirement of Craigslist phone number scraping. I need around 20k+ records everyday. I need phone and email given in the reply box. Here i attached the sample data l need.

This is not easy task. I will provide the proxies whi...read more

Data Collection From Sources in Real Estate Industry in US

We are looking to extract data from 4 to 5 different sources for the listings that is available on the internet. We want to have a program which can update it on a daily basis with the data that is available on the different 4 to 5 source. There will...read more

Data Transcription PDF TO .xls

We have PDF rips of a mailing list that we need to be formatted for auto populating. I will provide a break down of every individual category we need preserved and try to send samples of what the data needs to look like when refined. There are over...read more