Em Andamento

Web scrapper/automation tool (READ DETAILS BEFORE BIDDING !!!) -- 2

The tool has to do the following tasks, using proxies and multithread on target website:

1. login

2. check if an item is present in cart (because it needs one)

3. if condition is met, goes to checkout page

4. will fill coupon field with imported bulk codes list from me in the tool

5. will fill pin code field and try from 000 to 999

until it returns valid/used/expired

if it does, it stores it into the database

Now the problem :

after 10 pins failed successive in unknown given frame of time, coupon code gets banned for 30 minutes

Workaround Idea #1:

since i have coupons in bulk

we can try 10 pins, if wrong pause and move to next coupon, and so on, until 30 minutes has elapsed then go back and resume 1st coupon

coupon 1: 000,001,002,003,004,005,006,007,008,009

pause coupon 1 and move to coupon 2: do the same

pause coupon 2 and move to coupon 3 etc

after 30 minutes go back to coupon 1 to resume: 010-019

we can work multithreaded, 1 thread per pool, a pool being 30 coupons, 10 pin requests per minute, so 30 coupons to go back to first after 30 minutes using round robin algorithm maybe?

Workaround Idea #2:

find the limit of requests/tries that the server can handle within a given frame of time without triggering a ban

the ban lasts 30 minutes, so my guess is that the limit is 10 tries per 30 minutes, maybe do more researches about it (30/10 = 3 minute, 1 try per 3 minutes so I assume this is the limit?)

assign a thread to each coupon (from the imported list) so they can run parallelly without having to pause and resume and move to next coupon unlike idea #1

benefit of the idea #2 is that the project will be less complex

2 options:

Fix the previous PHP script a previous Freelancer coded a year ago, before the target site implements the protection I explained above


Start from scratch (NO Selenium allowed but PHP/ASP script that run on server is welcome)

If you haven't read the project details before contacting me, or claiming you've read it, I will rate and ignore your bid.

If you ask questions that have been answered in the project details, I will stop talking.

If you feel like the task is too complex for you, PLEASE DON'T WASTE YOUR + MY TIME.

If you have interesting questions don't hesitate to ask.

Any suggestions are welcome.

Habilidades: PHP, JavaScript, Python, Captura de dados na web, Programação C#

Veja mais: free web page mockup tool, web scrapper plus, automation tool comparison, delphi web forms automation, web browser automation net, web browser automation, tool read cisco load balancer config file, powerpoint automation tool, resources planning web based online tool, web properties automation tool, qtp web automation tool, please complete these 3 steps before bidding on the project update skills verify your email 3 update profile profile picture, read before bidding, read before bidding), twant to buy an existing bidding website (like freelancer) existing only! please read before bidding or you will be ignored, twant to buy an existing bidding website like freelancer existing only please read before bidding or you will be ignored, Build A Website (Read Fully before bidding)

Acerca do Empregador:
( 31 comentários ) Marseille, France

ID do Projeto: #28416210

8 freelancers estão ofertando em média €202 nesse trabalho


Hi Hiring Manager I am Web Scraping - Data Mining, Java / Python Developer. - web scraping, data mining, data extraction, data transformation, - writing scripts and utilities, - image / file downloading. - scraping i Mais

€140 EUR em 1 dia
(34 Comentários)

✔️ Senior Expert in Web scraping and automation with Python selenium, BS4 module... ✔️ Hi, Thanks for the opportunity to bid on your project. I read your job description carefully. Also, I am an expert in Python with 9 Mais

€200 EUR in 4 dias
(20 Comentários)

Hello, Greetings! Indeed it's a complex and a challenging task with lot of R&D involved. I will wish to have a look at the PHP script which the last developer have dveloped. It's eveident from your project scope that Mais

€250 EUR in 18 dias
(13 Comentários)

Hello there, From the description I understand that you are looking for a developer to help you create a script that automates the validation of coupon codes. I understand what you are trying to do. We can use threadi Mais

€111 EUR in 7 dias
(5 Comentários)

Hi This is a developer specialized in web scraping/automation. I worked on more than 50 projects in web scraping/automation and have proven records. I mastered all relevant skills including but not limited to: - Analyz Mais

€300 EUR in 7 dias
(0 Comentários)

hi, this is Asif Ali, i ma professional in web scraping. i have dpne many task om web scraping. you will be satisfy from my work.

€278 EUR in 6 dias
(0 Comentários)

Hi, it's super easy for me to do it. Especially in python. Just contact me once. I will write it up and finish it up fast.

€200 EUR em 1 dia
(0 Comentários)

Hi, I will do your qa task, Could you please assign me I have completed total of 14+ Years of experience in test automation & manual testing could you please review my below LinkedIn profile [login to view URL] Mais

€140 EUR in 7 dias
(0 Comentários)