Need to scrape up to 100-1,000 RSS feeds every hour and save (new) unique results to SQL Server via a stored procedure. Multi-Threading.
The RSS feeds TO scrape are also stored from SQL Server and called/retrieved from a stored procedure.
Need functionality effectively broken out in source, e.g., RSS pull, parse; sql processing, etc.
Needs to run with no ongoing human interaction/trigger. Needs to trigger automatically, e.g., using Task Scheduler
Will run on Windows virtual machine on Azure, using SQL web. Source code UWP/.NET
Questions I want to know about your experience with:
1. RSS feeds
2. Scalable web-scraping apps
4. SQL Server
5. writing clear, documented code (would value seeing some of your example code)
This is the first of several interesting projects for healthcare that uses NLP, match, sales data, BI, etc.
Feel free to ask me any FOCUSED questions that you may have.
32 freelancers estão ofertando em média $1179 nesse trabalho
Hi, I have 6+ years of application development experience. I can write a windows service that will do the scrapping in background without no human interaction and task based-multithreaded.
I can set this up to be entirely automated and scalable. I can show you my work where I have handled millions of records. I can also be available to help with the other projects when they are ready. Let’s discuss.