I'm looking for someone who can help me create on-going Instagram scrapper.
Goal:
Create desctop application (Win or Mac) that will scrape accounts from multiple Instagram locations
Requirements:
1) All data should be stored in a SQL database including location links and scrapped data
2) Scrapper should work on-going, so each location has its own 'schedule' how ofter if should be scrapped, and it should run automatically based on this schedule
3) Use if necessary proxy server to avoid Instagram block
4) Save basic statistics of scrapped data per day for issues detection
5) Filter duplicate data (use 'exclude' table)
7) Suggested DB structure:
Location table (City_name, Location_url, Scrape_schedule)
Posts (Post_image_url, Post_author_url, Location_id, Date_scapped)
Accounts (Author_url, Location_id) - exclude list of accounts to filter
8) Consider limit of posts per location for one session and adjust scrapping schedule accordingly
Input data:
List of links of Instagram locations
About the recuiterMember since Sep 16, 2017 Aidenv Michael
from Nordjylland, Denmark