I am need of a skilled developer, as this is a very complicated project. Every shopify product has different variants for each option available, and I would like to build a program that scrapes shopify sites, searching through it's variants
Shopify variants are 11 digits long (38531744963). This program must be able to scrape through millions of results, displaying the product name and if possible image of any variant name it discovers.
This program should be designed so that I can search through a specific group of numbers at a time. For example, the program should have the option to search through the numbers 38531744963 and 39531744963, displaying any products it finds inbetween. I have included an example picture to show what I am describing.
This program should be designed to work as fast as possible, and it can be web based or a windows application.
This program must also use rotating proxies when scraping, because shopify bans IP's making mass requests. I will supply the proxies, but the program must offer rotating proxy support to avoid bans.
This program is designed to work on ALL shopify sites, and to help me identify the variants for products I am looking for, so for all products it discovers, it must display the variant, product name, and possibly image.
You can scrape variants by using the link [url removed, login to view]:1
4 freelancers are bidding on average $2272 for this job
Ready to work. We are developers in Ukraine with good experience on creating solutions. We can help you with scrapping Please, contact to discuss details.