Remote Data Mining And Management Job In Data Science And Analytics

make a web crawler to monitor websites

Find more Data Mining And Management remote jobs posted recently Worldwide

Hey Guys:

Im looking to make a web crawler, which crawls the page everyday convert it to plain text. Match with the last day results and see if there is any difference of content. If there is it releases Alert via email and RSS Telling what exactly the difference is and on which website.

To make it fast please use any ready-made tool like scrapy, pispider or anyone which have a built-in database and user interface.

I am looking for someone who can do it with in 2-3 days. These 3 tasks.
1. Web crawler framework install, make a UI to enter website links or load them mass via JSON
2. custom script to store results, monitor pages and send rss n email if changes occur (we can use modules)
3. deploy on amazon web server.

This will be on-going project which you can maintain for long -time. No agencies please. No
About the recuiter
Member since Nov 11, 2022
Admin Contact
from Khomas, Namibia

Skills & Expertise Required

PhantomJS Python Scrapy Web Scraping

Open for hiringApply before - Aug 16, 2024

Work from Anywhere

40 hrs / week

Hourly Type

Remote Job

$191.64

Cost

Offer to work on this project closes in 43 days!
Are you interested in this Opportunity?

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Other jobs by this client

Developer needed to make a small game in HTML 5 - Hourly
Colorado attorney wanted - Hourly
Script for job alerts to be emailed in real-time - Fixed
SQL Mentor - Hourly
Mobile Design Experts - Hourly
Draft correction - Fixed

Similar Projects

ArcGIS Designer/Developer for an Interactive Campus Map

Background

We are working with a major university in Texas to demonstrate the power of giving and it impact on the entire worldwide academic network. The mission of the project is to create a storytelling platform that highlights the stories...read more

Solving a fractional differential equation using a neural network.

I want to solve a fractional differential equation. I already make neural network in TensorFlow but it has some bugs I couldnt fix it. May be you can do it.

Looking for a Full stack developer to help add new features to existing web application.

We are looking for a full stack developer to add new features to an existing web application. Must have skills include 10+ experience with HTML, Python, and Java Script.

Preference given to candidates who have expertise with mongoDB, Atlas,...read more

I need data scraped from various website and to document that in a particular mentioned format

I need data scraped from a 2 websites like amazon and Flipkart and store all the data in a particular format. All the product details to be scrapped and the format to save it in csv will be communicated to you.
Right now looking for a freelancer...read more

configuring vs19 with TensorFlow 2.1

Hello,
Im trying to configure python 3.7 with tensorflow 2.1 on visualstudio 19.
As much as it sounds simple the import of tf doesnt work, Im not getting the libraries inside the tf.
looking for someone who knows how to fix this issue