Remote Data Mining And Management Job In Data Science And Analytics

Real-time Web Scraping for a list of Large News Website (need scalability)

Find more Data Mining And Management remote jobs posted recently Worldwide

The task is straight forward: design an script (python preferred) to scrape all article information from a News website in real-time.

There are a few requirements though:
1. Real-time: able to keep the program running and detect any new posted articles.
2. Web application compatible: the script should be capable of being integrated into a web application so that the article information can be pushed onto the web app realtime.
3. Production ready: the script should be able to handle most the exception and detect any anomaly and be production-ready
4. For those who are also web app developer, it would be a plus if you can also handle the integration with the web app.
About the recuiter
Member since Sep 20, 2017
Ca Ankit
from Maharashtra, India

Skills & Expertise Required

Python Scrapy Selenium Web Scraping 
Candidate shortlisted and hired
Hiring open till - Jul 28, 2018

Work from Anywhere

40 hrs / week

Fixed Type

Remote Job

$12.46

Cost

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Other jobs by this client

Seeking French English Translator with Legal experience - Hourly
Wordpress developer experienced in developing an E-commerce website for the food domain. - Hourly
Checkpoint SME - Hourly
Freelance Android and Ios developer - Fixed
Web Design/node.js/scss - Fixed
German SEO Contenwriter - Fixed
FileMaker Pro Integration with Stamps - Fixed
Golang script for Facebook API - Hourly
small php / code igniter application - Fixed
REQUIRED Quickly: Webpage and PHP script to write data to MySQL table on Wordpress site - Fixed
Need help setting up web page for parts store. - Hourly
Wordpress expert needed for some simple jobs! - Fixed

Similar Projects

Python Penetration Testing

I am looking for a Python programmer with knowledge of application security/pentesting to create a series of educational videos on Python and its usage in penetration testing covering network and web application securty (OWASP).

Convert Quantopian Algo to QuantConnect for live paper trading

Hello,

I need assistance to convert my Quantopian algo to Quantconnect for live trading on Interactive brokers. I have worked with developers before and have a completed code on Quantopian.

In my opinion, the trading algorithm is n...read more

Launching database backend using infrastructure tool, Ansible

Using infrastructure automation tool Ansible, launch a simple database backed web application that displays hello world. using Django. Include documentation on how I can execute and run the program.

Developer needed to create a live video-streaming website

Looking for somebody who is proficient in SQL, JavaScript and Python. The project is to build a website that can host video streaming and live chat. This website will be very similar to Twitch.tv.