Website Monitoring Tool (web crawler, screenshots, email notification)

Hello, We are IT-Engineers and Business Analysts, creating complete web and mobile solutions, for already more than 15 years, supporting our products with custom digital marketing strategies and instruments. Web-crawling systems are especially preferred by our engineers, as we've created a lot of them already, so it seems to be a good match. Before the implementation starts - the initial briefing round takes place, which is free of charge. We are interested in all the details of your specific case. They will allow us to obtain a better vision of your concept and help us create unique solutions for you. Let's schedule a convenient time for the first kick-off conversation. P.S.: Wir sprechen auch Deutsch. :) Best Regards, Andrei Costenco Team Lead, Business Analyst, Senior Engineer Dev Experts Team

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the agreed deadline. Check out my profile and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan

‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less  ,,,,,,,,,,,,. ,

---- Pro Python, Software Architecture, Software Development, Web Scraping, Website Analytics Expert -------------- Dear client, Once I saw a your project, it was attracted my mind because I am very interested in your project and also I have rich experiences and high skills on these fields as you can see my profile. If given a chance, I am highly confident in my ability to deliver the highest quality. I am confident that my involvement in your project will bring it to a successful launch, on time and within budget. I look forward to hearing from you. Kind Regards

Hello Sir/Madam, Greetings of the day..! Hope you are doing well. I have gone through your requirement details and understood it completely. I have enough experience in web scrapping using custom scripts as well as using automation tools. I have following areas of expertize: >>Php5, PHP7, Python2, Python3 >>Mysql5.5, Mysql5.7, Mongo3, Sphinx >>Webcrawling, Webscraping, Data extraction >>Unix, Apache, Nginx, SSL, Postfix SMTP >>Aws EC2, SES, Lambda, RDS, S3. >>Selenium Automation

Hi, This project seems like a simple script which can be called on a weekly CRON request on the server. The data about the sites can be stored and compared at later dates the project is a quick task and will not take no more than a day or two. Contact me so we can discuss details i am available to start. Thanks

I have vast experience of making web crawling and scraping scripts in python, I work as a freelance web scraping expert for multiple MNCs, Let me know about your requirements. Do you want to sell it? That means a fully armed saas. Is UI a concern?

Hi. I can provide you with crawling, checking and testing functionalities including dashboard if required. But it is not as simple as it look on the surface and there are some questions which will have to be answered to make sure it works just the way you want. It is not a critical problem as I can provide solutions in any case, the difference is in the time it will take to develop. For the starters will crawl the whole website in search of all the publicly seen pages. All this will be added to the database and timestamped for later tests. Later when the spider will do additional crawls it will be able to test against all data to see the changes. If want to have screenshot for before and after the modification then each crawled page will have to be stored as a bitmap for every scroll. We will have to decide on how deeply you want to store the changes. If it is only previous and current then there is not many problems. But if you want to store a deep log of how page modified over some long period of time then it might require some clever optimizations. For the content changes it is not very clear on what do you consider a change in content. Is it only visible text/image changes on the page or some inner changes like page metadata and maybe changes is in the scripts are also valuable to you? For the page image difference I will suggest comparing maybe by only pixels and if needed highlight with semitransparent shapes around those changes. Write me for more details.

hi I have more than 4 years of work experience in c#. So far I developed more than 50 software which scraps different websites using selenium framework.

Hourly rate negotiable, same with hours per week, very flexible hours.... WILL GET THE WORK DONE!! That’s a promise