We request a web crawler based on API functionality

€250-750 EUR

Fechado

Publicado

há mais de 9 anos

€250-750 EUR

Pago na entrega

Crawler-API We request a web crawler based on API functionality which provides as follows: 1. We provide as API request: - URL in format ([login to view URL], or [login to view URL]) - Backlink URL in format [login to view URL] (optional) - Referrer as text ([login to view URL]) - Task as o 1: Just crawl (and create an entry in target web log , visit one or more pages, act as human using the referrer and static IP) o 2: Crawl and locate contact or imprint site (and create an entry in target web log , visit one or more pages, act as human using the referrer and IP) o 3: Crawl and locate contact or imprint site (and create an entry in target web log , visit one or more pages, act as human using the referrer and IP), extract contact data as Name, telephone, address data, e-mail o 4: crawl a given URL and search for a specific link, record link text, target URL and follow status 2. We request the crawler (e.g. scrapy, [login to view URL], [login to view URL]) to do the jobs as requested a. The crawler and API should run on a webserver preferable PHP (Java is possible too) b. We would like to set crawl delay (max. crawls per time unit, time spent on site) c. Record site name and URL, http status code and loading time 3. Send data back to requester Case 1 and 2: reply with each URL, http status and loading time Case 3: reply with each URL, http status and loading time, reply contact data in predefined fields Case 4: reply URL, Link text, Target URL, http status, loading time, follow status, if no link present reply with code

PHP

Software Architecture

ID do Projeto: 6938541

Sobre o projeto

17 propostas

Projeto remoto

Ativo há 9 anos

Quer ganhar algum dinheiro?

Endereço de e-mail

Benefícios de ofertar no Freelancer

Defina seu orçamento e seu prazo

Seja pago pelo seu trabalho

Descreva sua proposta

É grátis para se inscrever e fazer ofertas em trabalhos

17 freelancers estão ofertando em média €600 EUR for esse trabalho

@vw580939vw

Dear Sir, Kindly check our heavy rated portfolio in the proposal itself and do let us know your feedback soon. We are very much positive for your project and eager to discuss with you more in detail. Looking forward for your reply in personal message. Thanks, Milan

€736 EUR em 10 dias

4,9

(139 avaliações)

7,2

@viworld

A proposal has not yet been provided

€434 EUR em 10 dias

4,6

(209 avaliações)

5,8

@solexy

Hello, I have 10 years of advanced experience in web developing. I have analyzed your project requirements and I feel confident to do that and I am the right fit for your project. Start time- ASAP Time- 2 weeks Feel free to ask any questions With sincere interest.

€638 EUR em 20 dias

5,0

(4 avaliações)

5,2

@dabing1205

I am an expert in python/scrapy, and also interested in your project. Please contact me to discuss more detailed requirement, Thanks!

€555 EUR em 10 dias

4,9

(25 avaliações)

5,0

@mbs1092

Hi, Please kindly review my proposal. After reading your requirements, I feel this a project that I can easily complete for you within one week. I have done a number of web scrapping jobs before in the past using languages such as PHP and Perl. I can work with the web crawler frameworks that you mentioned, or use my preferred method of using CURL. I have several years experience working with the full LAMP stack (Linux, Apache, MySQL, and PHP), as well as knowledge in HTML/HTML5, CSS/CSS3, JavaScript, and jQuery. I have been working at least 5 years as an Independent Contractor and Web Developer for a company called Boomdizzle (a social music hip hop website). I help maintain their servers and do server administrative tasks, develop static and dynamic web pages, and create themes based on designs that they provide me. My Resume, as well as full skillset and reviews from over 30+ clients (all of them positive), can be found on my profile. If you would like to see some examples of my work, please let me know. I look forward to working you on this project and would like to discuss further. Please reach out to me when you get a chance and thank you for taking the time to consider my bid.

€500 EUR em 7 dias

5,0

(30 avaliações)

4,3

@dddevelopersd

hello, I am expert in data scrapping and API, you will get job done 100% as mentioned. I am waiting to hear from you, thanks

€277 EUR em 4 dias

5,0

(4 avaliações)

3,7

@webifire

Hello, Hope you had a great day today. I know you are looking for I.T. Programming partners to work on your projects. I will not tell you that we can do this and that; alternatively I would like to find the solution for your need from our existing database. So the project that you are looking for is implemented before the deadlines. Also we keep our rates reasonable if the project has the similarity with the one, which we have done before. If the project is not from our database we will quote a very good and reasonable price for the custom development. We have good database of the software, apps, games, and websites. Those databases can be used only if client permits us to do else we start from scratch and deliver the desired results. We have worked on: Apps app, GPS Navigation apps, Enterprise Apps, Climatic apps, Guide apps, Radio apps, Chat apps, Music apps, IEMI apps, Domain Reg. apps, Social networking apps, Banking apps, File manager apps, Directory apps, Ticketing apps, Real estate apps, Medical apps, Deal apps, QR code apps, Recharge apps, Video editing apps, Shopping apps, etc. Games 3D hunter game, Fighting game, Talking Tom games, Basketball game, Cricket game, Chess game, Volleyball game, Dice game, Farmville game, Casino game, Golf game, Pet game, Racing game, Running game, Soccer game, etc. Looking forward to your reply and expect an inquiry from you. Thanks Mac

€1.000 EUR em 10 dias

5,0

(2 avaliações)

3,3

@abinayats

Hello, Greetings from Roland and Associates !!! With reference to your posted requirement for "We request a web crawler based on API functionality", we would like to express our interest for the same. We reviewed your job posting and we are very glad to inform you that we very much confident in doing this project. We will provide you the work as you have mentioned in the job posting. Looking forward for our fruitful collaboration. Regards Abinaya Note: We can assure you that we will provide you our best quality of work to satisfy you as per your choice and guideline. We are available at Skype/Gtalk/Phone for further discussion.

€261 EUR em 5 dias

4,6

(4 avaliações)

2,5

@muzzammilgadit78

Hello, After reading your job description closely, I understand what you need, and i have a complete command our your required skills, so that i am a perfect fit for this job. I have more than 3 years of experience of web developing and done masters in CSS, HTML 5,PHP, Wordpress, Jumla, .Net and psd to HTML, and I have provided excellent service to all of them uptil now and I specifically target my clients requirements and try to provide the best results possible with maximum accuracy. as well as i am available on skype 24x7 for better coordination with my client I am looking forward for your positive response. Thanks.

€250 EUR em 3 dias

0,0

(0 avaliações)

0,0

@WebHunt1

Hi Mate, WE CAN GIVE WEB CRAWLER BASED API....... I have seen your project post and surely telling you that we have an experience for this kind of project development. We are best in outsourcing business since 2004 and we have 250+ highly skilled developers for Mobile, Web, Animation, Game Development and Internet Marketing. We have to ask some questions regarding your scope so, kindly go through it: 1) What is your best offer and timeline for this task? 2) When would you expect to start this project development? 3) Please share us your SKYPE for best communication. We serve you better and expect us to be choosing my company for your project selection area. Awaiting from hear you very soon..... Cordially, David

€388 EUR em 10 dias

0,0

(0 avaliações)

0,0

@sisodiakaran

Dear Employer, Let me introduce myself as an expert software programmer and am really interested in working with you. I have done many offline jobs. I am willing to complete your job at a very fast pace and at a minimal cost. I guarantee you of providing: 1. Timely delivery of the project. 2. Bug free delivery. 3. Full assistance even after the project is complete until satisfaction. At this point of time I am ready to work at a very low cost so that I can build my reviews. I am new to Freelancer.com but have 6+ years of experience working as a Team Lead in a company. My main aim is to make my clients happy and Earn returning clients. Lets have a word to discuss the project in more details. Hope working with you. Regards, Karan Singh Sisodia

€250 EUR em 3 dias