I need to develop a program to go out and Crawl / Spider the internet for Websites, links, and other domains and pages out there. Once or while the Crawling / Spidering is complete it needs to filter based on my needs on metrics I need to specify. Take that data store it in the database and export it into a .csv database file if needed.
11 freelancers are bidding on average $180 for this job
I have already done a project like this to get some information from a website. I think I have experience in this field. Let me do it and you will feel happy with my result. Thanks. Liem
i am well experienced in coding script for crawling in python code and saving it as mysql db and csv files. i can make this crawler as per your requirements.