Remote Data Mining And Management Job In Data Science And Analytics

Web Scraping (ScreamingFrog) Expert Needed

Find more Data Mining And Management remote jobs posted recently Worldwide

We are looking for a web scraping expert to help configure Screaming Frog to scrape SKU data along with its normal SEO related data (title, meta description, h1, etc.). We need help defining the custom data extraction settings in Screaming Frog which use either XPath, CSS Path or Regex.

The ecommerce platform we are scraping is IBM WebSphere.

It appears that the html defining the SKU includes numbers that are unique per url, meaning that there is not a common pattern to look for.

For example:
The html looks like this for product page A:

SKU:
8373652-83765


But for product page B it looks like this:

SKU:
4283766-65243


So the id is different in both cases. It would have been simpler to scrape if it was just product_SKU in all cases.

Please provide a bid for providing a solution that we can put into screaming frog to extract the SKU.

Also, please tell me about your ability to scrape large ecommerce sites for SEO information (title, description, h1, etc.). We have several ecommerce clients with very large sites and will need help with this.
About the recuiter
Member since Nov 11, 2022
Md Tanweer Hussain
from Provincie Overijssel, Netherlands

Skills & Expertise Required

Web Scraping 

Open for hiringApply before - Aug 5, 2024

Work from Anywhere

40 hrs / week

Fixed Type

Remote Job

$71.78

Cost

Offer to work on this project closes in 19 days!
Are you interested in this Opportunity?

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Similar Projects

Data Engineer

We are looking for a freelancer who has proven experience in Data Engineering projects.

The requirements we are looking for:
- Experience with Python
- Experience with Big Data tools (eg: Hadoop, Cassandra, Kafka)
- Experience wi...read more

Extracting data from booking.com and Expedia, alternatively just hotels combined......

I would like to find the rates for our hotel Comfort Hotel Sydney airport and our competitors rates Ibis budget Sydney airport and Mantra sydney airport for the last 365 days.
I would like to know exactly when rates withing the last 365 day...read more

Scraping Tmall/TaoBao

Scraping Chinese Marketplace

I need the output of a scraping action on Tmall, TaoBao, JD, Secoo.
What I need to dig out are the name of every European brand that has a Flagship Store

Output excel file with:
- Name of the bra...read more

Web scraping and data mining

I am looking for someone who can scrape data from various website databases such as linkedin , yelp and about 10 more. The projects will be specific as far as niche and verticals. I have a long list of projects.

Long Term Scrapy Project

Hi, we are looking for an engineer to join our growing team of big data professionals.

Important: Please answer the questions attached to this application!!!

Requirements:
- You are great with Python 3.X
- Youre a Scrapy ex...read more