webcrawler / webscraping for different websites

We're looking for a team that can build a scraping program for different websites. Its based on the following ideas:

- It has to run 24/7

- The program should be able to monitor all websites simultaneously (around 5)

- As soon as there are any website changes (new product, sizes restocked,..) the program should send a notification to a discord channel

- It should be able to support proxies

- It should be able to filter website changes with keywords (the program should only send a notification when there's a reliable product restocking. The notification should display: Link, Image of Product, Add to Cart Links, Sizes in Stock)

- preferably written in python with the scrapy module.

- It should be as fast as possible

- I must be able to configure the program to certain sites as well as certain keywords.

- The program will check against keywords in the product titles as well description/title.

- The product should be licensed to me and you should be able to give me further support.

- I will most likely be looking to scale this program into bigger as soon as there are more websites i want to scrape

Please reach out to me, if you're interested in my project. This is a big project and I want a experienced developer team.

Habilidades: Extração de Dados, PHP, Python, Arquitetura de software, Captura de dados na web

Veja mais: different websites visit, different websites, different websites french projects, web crawler tool, web scraping, scrapy, web scraping service, best open source web crawler, how to crawl a website, web crawler python, octoparse, login form different websites, wish list add items different websites, collect email addresses different websites, php website crawler read different websites, javascript redirect different websites based, different websites different templates, script collect data different websites, different websites logos, company will advertise different websites

Acerca do Empregador:
( 0 comentários ) Germany

ID do Projeto: #17522598

41 freelancers estão ofertando em média $568 para esse trabalho


Hello,Dear! How are you? I have read your project description very carefully and am very interested in your project. I have experienced in developing Data Mining, PHP, Python, Software Architecture, Web Scraping. I Mais

$555 USD in 10 dias
(102 Comentários)

Greetings, I am already building a scrapper tool which can scrape various sites. Its in development stage. I can customize it as per your needs so that you will be able to configure to scrape numerous sites at once. Mais

$750 USD in 60 dias
(73 Comentários)

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database Mais

$722 USD in 10 dias
(87 Comentários)

Hi. I am very interested in your project, because I have much experience in such projects. I think this bot is sneaker bot. I have already developed the sneaker bot of supreme, Yezzy, kith, Footaction, Footlocker, Mais

$500 USD in 10 dias
(120 Comentários)

Ready to work with you for scrapping website projects for you . Please open Message box so that we discuss it in detail Expertise ================== - PHP - Cryptocurrency - Code Ignator - Magento - Larav Mais

$686 USD in 10 dias
(76 Comentários)

Dear sneakercooks, I have gone through your project description "webcrawler / webscraping for different websites" and could assure you the best of the solution. I am taking it as an opportunity and ready to deliver my Mais

$525 USD in 12 dias
(46 Comentários)

Hello, I can help with you in your project webscraping for different websites I have more than 5 years of experience in Data Mining, PHP, Python, Software Architecture, Web Scraping. We have worked on several sim Mais

$750 USD in 10 dias
(90 Comentários)

Hello Sir/Madam!! I read your requirement and I can handle it and have already done this type of project. it will my pleasure to work with [login to view URL] give me opportunity to work with you. WHY US? I reading your Mais

$611 USD in 10 dias
(117 Comentários)

Hello Very Interested in your project I can do it with 7+ years web scraping experience Have very experienced with all technologies you mentioned like proxy and python and so on. Let's have a talk for more detail Mais

$1111 USD in 10 dias
(21 Comentários)

Hello, Greetings!! I read the project description and I would like to inform you that I am an expert web developer so I am very much comfortable to write a script based given detail to scrap the data from the different Mais

$333 USD in 3 dias
(79 Comentários)

Hi , It’s great to meet you. I’m Somya Tripathi, co-owner of Arkss Technologies Private Limited. We develop: kickass, cutting-edge software for web applications, mobile apps, Blockchain, Cryptocurrency, Tra Mais

$555 USD in 10 dias
(38 Comentários)

Hello. My name is Maciej and I am a Python dev. I understand project requirements and can create such a software. Kind Regards

$1666 USD in 10 dias
(101 Comentários)

Hi there, I’ve read your brief and I’m pretty confident that I will be able to ....... If you'd like to view my previous work, take a look at my Freelancer Portfolio. I’ll provide you with the work as per your re Mais

$750 USD in 10 dias
(68 Comentários)

Hi, my name is Oleksii. I can help you to create a scraping program. I have 19 years' experience in Web Development and Programming. I would like propose partnership with our company Tangram for your project. My team Mais

$750 USD in 10 dias
(31 Comentários)

ready to make a free sample for this work. i have good experience as a scrapper and you can check out my profile and reviews. we can discuss more if you want to. thank you.

$260 USD in 10 dias
(61 Comentários)

Hello, Hiring Manager. How are you? So excited to have a chance to apply in your project. An experienced Web scraping/crawling expert here. Have experience in [login to view URL], [login to view URL], zillow, amazon, nike, etc Mais

$555 USD in 10 dias
(45 Comentários)

Hello. I have rich experiences in Website Scrapping. I have good skills in python , php, etc. I have read your project description and very interest. Contact me please. Thanks.

$500 USD in 10 dias
(117 Comentários)

how are you? I have read your description carefully. I am a website expert and have rich experience for such project. If you want, we can get good results each other. I can show you my previous work. I will wait f Mais

$500 USD in 10 dias
(39 Comentários)

With respect to this project I would like to present myself as a candidate for your consideration. I have more than 8 years of IT experience. I have successfully completed few projects which involved Programming, scrip Mais

$555 USD in 10 dias
(33 Comentários)

Hi, Hope you doing well sir i read your message in given below that i make sure you i can help you to build your scraping program for different websites as per your given requirement as better i can help you to do Mais

$555 USD in 10 dias
(30 Comentários)