Remote Data Mining And Management Job In Data Science And Analytics

Webscraping expert needed

Find more Data Mining And Management remote jobs posted recently Worldwide

The job will be an ongoing project, payment will be monthly, ideally someone who is well versed in python, javascript, C# or Kotlin other languages welcome.

- Be able to scrape specific websites using requests, avoiding browser scraping at all costs.
- Be able to find bypasses and exploits on websites to get around their anti-scraping security (WAF), such as Cloudflare, Perimiterx, Akamai, Incapusla, Ticket and more...
- Time sensitive web scraping identifying when online stock is replenished using different product endpoints, in addition identifying when new products are loaded onto the websites
- Familiar with proxies used for web-scraping
- Familiar with fixing caching issues, custom http clients to bypass web scraping security (WAF)
- Comfortable working with a team via discord
About the recuiter
Member since Nov 11, 2022
Scott Deveaux
from Delaware, United States

Skills & Expertise Required

Web Crawling Data Extraction Data Scraping Extract, Transform and Load Web Scraper 
Open for hiringApply before - Jan 12, 2025

Work from Anywhere

40 hrs / week

Hourly Type

Remote Job

$26.71

Cost

Offer to work on this project closes in 140 days!
Are you interested in this Opportunity?

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Other jobs by this client

3D Rendering For Still Photo - Hourly
Developer with Dialogflow knowledge to create a Bulk Intent Importer using CSV - Hourly
Taxi Booking App - Hourly
WordPress and plugins for a Student to Trainer matching website using locations plugins. - Fixed
Construction Estimator - Fixed
Mautic install - Fixed
Report writer with background in economics, cost-benefit analysis and health policy in LMICs - Hourly
Microsoft Dynamics 365 Customer Engagement Plan configuration - Hourly
Excel Spreadsheet Specialist - Hourly
Web Scraping - Fixed
Organising meetings in Shanghai via telephone - Fixed
Tableau Developer needed for fixing issues. - Hourly
Grocery Shopping App Modification - Hourly
Looking for the best branding / website designer to create a PSD for a cool new age company - Hourly

Similar Projects

Data Entry

I have a list of properties that are delinquent on their taxes and the address of their owner. I need someone to convert the PDF format that it currently is in (already converted to an excel file) to a more excel friendly layout. Due to the file orig...read more

PDF Manipulation, Data Scrapping, script writing, web, automating data entry and data management

I need a 338 page pdf turned into an excel file. I then need someone to write a script to go find a zip code for all of the address in the excel file. I then want someone to write a script that fetches the owners address from a website I provide. I w...read more

Excel File - Comparing 2 Sheets (Removing Duplicates etc)

I am seeking an experiecned Excel user who can compare 2 excel files and remove duplicates and provide for me new data only. I will send you 2 excel sheets and you will filter out the duplicates between them and only provide me new data

Developer need for scraping 9 Government Websites

We are building a central inmate database, and need crawlers to collect this information.

These are the list of websites we need crawled:

(Removed by Toogit admin)

These websites need to be crawled several times a week. <...read more

Need help to stop ban when crawling a website with a spider from Scrapinghub

Im using Portia from Scrapinghub to run a spider on a website that keeps banning me. I need to avoid the ban to allow access. I get the following error:

Error 1009Ray ID: ************ - 2018-12-29 23:35:00 UTC
Access denied
What hap...read more

Submit A Proposal