Remote Data Mining And Management Job In Data Science And Analytics

Crawling a classified website

Find more Data Mining And Management remote jobs posted recently Worldwide

I need a ruby (alternatively python) library / class for crawling a classifieds website: olx.pl, written in ruby.
Data to be extracted by the library:
- Title
- Price
- Phone number
- Date
- Size
- Area
- Description
- URL.

Additional requirements:
The script has to send the data in json to a address of choice as it crawls the website.
The script has to be able to run without a ban / downtime from the website
About the recuiter
Member since Aug 31, 2017
Amar Durga
from Maharashtra, India

Skills & Expertise Required

Web Crawling Data Mining Data Scraping Ruby Scrapy

Candidate shortlisted and hiredHiring open till - Jun 13, 2024

Work from Anywhere

40 hrs / week

Fixed Type

Remote Job

$95.51

Cost

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Other jobs by this client

Looking for qualified and reliable article writers - Hourly
Design UI for Android app - Hourly
Windows system administration - Fixed
10 million USA cities data points - Hourly
Hindi Voice Over (female) and EN-HI translation for DIY videos - Hourly
VO recording & sound designer needed for small corporate - Hourly
Build O365 SharePoint / Teams ? site from ground up - Hourly
Shopify App Developer to Develop an app for Wholesale Pricing - Fixed
Wordpress Theme Customization Needed - Hourly
Social Media Virtual Assistant - Hourly
Server admin - Fix over usage CPU - Fixed
Create "Just Listed" "Just sold" real estate postcard and solicit for new listing. - Fixed
Developer needed - Fixed
Configure Nginx reverse proxy - Fixed

Similar Projects

Developer needed to build custom Auto scraper

I need a custom scraper program that will run automatically every 30 seconds or slow. This scraper would be pulling data from the FMCSA public website. I have actually have instructions of how to build it that i was givin from another developer that...read more

Google Analytics technical expert

Looking for an experienced Google Analytics professional who can work alongside our engineering team to test tags, urls, advise on url approaches, set-up dashboards, funnels, etc. If required must also be able to assist with some SQL work, and excel...read more

Online Sales Navigator Research 501 to 1k ees

I need someone to research and enter data for potential sales prospects using online sources including Google and LinkedIns Sales Navigator.

Please only apply for this job if you have used Linkedins Sales Navigator Tool.

Go to Lin...read more