Remote Web Development Job In IT And Programming

Need help to stop ban when crawling a website with a spider from Scrapinghub

Find more Web Development remote jobs posted recently Worldwide

Im using Portia from Scrapinghub to run a spider on a website that keeps banning me. I need to avoid the ban to allow access. I get the following error:

Error 1009Ray ID: ************ - 2018-12-29 23:35:00 UTC
Access denied
What happened?
The owner of this website (www.********) has banned the country or region your IP address is in (DE) from accessing this website.
Cloudflare Ray ID: ************Your IP: ********Performance & security by Cloudflare

Im looking for a freelancer that can solve this issue, probably easy to deal with for anyone experienced with Scrapinghub, which is not my case (my use is very basic).
About the recuiter
Member since Nov 11, 2022
Abhay Sakhare
from Provincia de San Jose, Costa Rica

Skills & Expertise Required

Web Crawling Data Scraping Web Scraping

Open for hiringApply before - Nov 21, 2024

Work from Anywhere

40 hrs / week

Fixed Type

Remote Job

$19.07

Cost

Offer to work on this project closes in 90 days!
Are you interested in this Opportunity?

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Other jobs by this client

advanced study of object-oriented design and programming - Fixed
oracle fusion finance terchnical - Hourly
Programmer needed for a robot trajectory planning simulation - Fixed
Full-stack Developer for website on React and NodeJS/AWS Lambda - Hourly
Trifold Brochure for Camp Albemarle - Hourly
Need legal assistant experienced estate, business and trust administration transactions and property transfers - Hourly
Redhat and Ansible Subject Matter Expert - Hourly
Videographer - Golf Lessons - Fixed
Need an AI-based statistical model set up - Hourly
Android App with Flutter - Fixed

Similar Projects

Backend developer needed to build a custom data scraper & parser service & API

The goal of this project is to scrape, sanitize, and organize the California State Bar Association data set. Specifically, to crawl a website for all attorneys. Data is classified by a variety of status parameters, and we are only interested in a spe...read more

Bulk Scraping of Websites

We are looking to extract specific elements from a list of websites and craw the links on the website for the necessary content.

This is a quick turn around project.

The deliverable will be an excel with the specific elements from...read more

Data scrape a website and export to an excel sheet

Hi there, we are looking for someone to do a data scrape from the following site:
(removed by Toogit admin)
We would like the output to be in spreadsheet. this will mean for each row we need the data provided on that page, as well as the data...read more