
Closed
Posted
Paid on delivery
I need an automated script that visits [login to view URL] under a specific store location (set by postal code) and captures every product available across all categories. The scraper has to run once every 24 hours, overwrite data in a structured file (CSV or JSON—your call), and handle the usual road-blocks on large sites such as store-selection prompts, pagination, lazy-loaded content, captchas, and IP throttling. What I expect from you • A clean, well-commented Python solution—Scrapy, Selenium, Playwright or a comparable stack are all fine as long as it is headless and low-maintenance. • A simple config or .env so I can change the target postal code or output path without touching the code. • A scheduler (cron job, Windows Task Scheduler, or a lightweight cloud function) that calls the scraper daily. • One sample dataset generated from a test run on the live site so I can confirm the fields, category coverage, and location scoping work correctly. • Brief hand-off notes explaining installation, dependencies, and how to add fields later. Acceptance criteria 1. Running the script with the provided postal code produces a complete dump of all [login to view URL] categories for that store. 2. The job finishes without manual captcha intervention and respects site rate limits. 3. Daily schedule fires automatically and writes/updates the output file. 4. Code passes a quick review for readability and dependency hygiene. That’s it—if you’ve built resilient e-commerce scrapers before, this should be straightforward.
Project ID: 40389881
15 proposals
Remote project
Active 6 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
15 freelancers are bidding on average $27 USD for this job

With your project in mind, I believe my capabilities at BN-Droids Digital Services make us the perfect fit. We have extensive experience in building and maintaining robust webscrapers especially for e-commerce platforms like Walmart. Our proficiency in well-commented Python solutions such as Scrapy, Selenium, or Playwright would streamline the entire process of scraping data from Walmart.ca. Moreover, our skills in headless browsing and low-maintenance coding will ensure unfaltering operations even amidst common roadblocks and potential contingencies such as store-selection prompts, pagination, lazy-loaded content, captchas, and IP throttling. Our team will also set up a reliable scheduler to ensure your scraper runs automatically at specific intervals (24 hours) without any manual intervention while abiding by site rate limits. Furthermore, our deep understanding of web data scraping combined with efficient data processing techniques allows us to handle large-scale projects seamlessly. In the past, we've scraped over a million data entries daily and maintained databases with over 20 million retail data points worldwide. Thus, we can guarantee well-structured CSV or JSON files that meet your specifications along with a detailed hand-off notes that explain installation, dependencies and guidance on adding fields later. Finally, you can rely on us to deliver clean codes that pass all the acceptance criteria, respecting readability and dependency hygiene throughout.
$20 USD in 7 days
6.9
6.9

Hi, I can easily DO your work IN 24 HOURS, DM me now to get started, PRICE NEGOTIABLE 100% Work satisfaction is provided
$20 USD in 1 day
2.5
2.5

Hi, I can build this as a clean headless solution with configurable postal code/output path, structured JSON export, and a daily scheduler. My background includes logic-heavy automation, external data parsing, and building tools that handle changing states reliably without overcomplicating the implementation. My profile here is newer, so I’m pricing early projects competitively, but the technical side is backed by real development experience.
$10 USD in 7 days
0.0
0.0

KANGRA, India
Payment method verified
Member since Jan 20, 2019
$10-30 USD
₹12500-37500 INR
₹1500-12500 INR
$30-250 USD
₹1500-12500 INR
$250-750 CAD
$30-250 USD
$10-30 USD
$10-30 USD
₹12500-37500 INR
₹1500-12500 INR
₹600-1500 INR
$250-750 USD
$250-750 USD
$750-1500 USD
$250-750 USD
₹10000-30000 INR
$25-50 USD / hour
$10-30 USD
$30-250 AUD
₹750-1250 INR / hour