Here is another project I am posting and I would like to say that I have been posting plenty of projects which means that I have work for those who need it and can provide assurances that they can complete the job within the timeframe that the provider specifies. I have forged great business relations with most
of the freelancers I have worked with but as of late I have been very disappointed in the communication and commitment by those whom I have chosen for particular jobs. It takes a lot of work and correspondence
to choose the right person for the project. I am a very easy going person and understanding to circumstances that may cause a project to be delayed. What I am saying stems from a very important project in which I thought I chose the right provider 3 weeks into the project I have not heard from the provider and have made many attempts to contact him. With this being said:
PLEASE DO NOT MAKE A BID OR SHOW INTEREST IN THIS PROJECT UNLESS YOU
ARE COMMITTED TO DOING THE WORK IN THE AMOUNT OF TIME THAT YOU
SPECIFY. ALSO, COMMUNICATION IS THE MOST IMPORTANT COMPONENT OF THIS
AGREEMENT. THE CHOSEN FREELANCER MUST BE AVAILABLE BY MSN
MESSENGER/EMAIL EVERY 2 DAYS AT THE MOST. I'M NOT SAYING THAT WE NEED
TO TALK EVERY 2 DAYS DURING THE PROJECT DURATION BUT IT WILL BE
HELPFUL TO KNOW THAT THE FREELANCER WILL BE AVAILABLE FOR CORRESPONDENCE.
So this is a reposting of a project from about 3 weeks ago. Eventhough it didn’t work out with the developer, he mentioned the way that he was going to build the application and I am hoping that someone can replicate the procedure.
I need to scrape content from the web and insert into a database. The database is ready.
The content consists of text, links, pictures, and video, organized by a subject term. The subject term could be a city, province, country, organization, or person.
Assuming that a bot is needed to perform this task, I will provide the links to the bot to look for the content. I would rather provide the links instead of the bot searching the internet for content that might not be relevant.
Requirements for the bot:
•Need to be able to access an interface to manage.
•Would like to feed it links and then acquire the information from that page. Certain content, maybe even just one paragraph might be needed from a page and NOT all of it. Would need to tell the bot which text, which image to grab from a page.
•Need to know what application is needed to operate the bot.
•The bot needs to operate on a schedule so the content will be new according to the links I provide for the bot to use.
•The bot will need to insert the information into a database. We don't need retrieval tasks done.
Here is an example of snippet of information:
Subject Term - Darfur, Sudan
[url removed, login to view];menu_id=232
Bot is expected to acquire certain information from this webpage
[url removed, login to view];menu_id=232
All content except images
Maybe the first 3 links and description from cnn - [url removed, login to view];intl=true&sortBy=date
First 3 links and description from Foxnews
[url removed, login to view];q=Darfur, Sudan&nav=World
First 3 links and description from BBC
[url removed, login to view];q=Darfur%2C%20Sudan&tab=ns&scope=all
First 3 links and descriptions from ABC news
[url removed, login to view];r=story,world
First 3 videos/description found at google video
First 3 videos/description found at cnn video
First 3 videos/description found at abc video
Same method like above
The developer was going to provide a module to configure scraping bot, created in C#, .NET to run on windows. He was also going allow the bot to configure the data to be inserted into specific tables and columns. Lastly he was going to provide 6 months of support, hopefully by then I would know how to operate the bot to fulfill my needs.
Let me know your thoughts. Hope to forge a great business relationship. thanks
i can extract the data what ever way you want , i have been doing this for years , please mail/ping me at [url removed, login to view](at)[url removed, login to view] Regards, Ashok.C