We need to build a crawler where the following will happen:
A CSV file will either be sent somewhere (if I can with salesforce) or once a month we will need to upload it somewhere. That will replace any previous file.
Once a month the postcode and house name or number are pulled out of the file to search the website RightMove and see if there is a sold date. If there is a sold date it checks that date. If the date is before the last stage change date on the CSV file then it is ignored, but if the date is after the last stage change date then that, and every other address where the same happens gets added to another csv file with the date of sale listed. This then gets emailed to us.
If there are any fields that do not have a last stage change date then it needs to use the created date field instead.