Build a semi-automated scrapper with user input

This project will be awarded to PigtailXL user. One of our employees approached him for a project called "Build a semi-automated scrapper with user input" - . Our employee did the research and did it on our behalf. Now we can go ahead and do the project.


Original project post:

I have a client and they want to be able to create a new lead entry to Dynamics 365 by scrapping the content from [login to view URL] using the "Entity Name" from [login to view URL] (please be aware that these 2 websites are only accessible from the US or using a VPN connection).

The scrapping process will work like this:

1. user goes to [login to view URL], selects manually "Corporate and LLC", "Corporate" or "LLC"

2. user inputs the "SEARCH METHOD" and the "SEARCH" fields

3. the scrapper uses the company name from the bottom of "Corporation/LLC Name" and gets to the "CORPORATION FILE DETAIL REPORT"

4. the scrapper copies the "Entity Name" from the right site of the table (let's name this "copied field"

5. the scrapper goes to [login to view URL]

6. the user validates the Google reCaptcha

7. the scrapper searches in the "Employer" tab for state "Illinois", current date and "copied field" from the previous website, then click below "Search", then click on the search result

8. the scrapper copies the text that is below each of the following: "Insurance Coverage Provider", "Policy Number" and "Coverage Date"

9. the scrapper then uses Microsoft Dynamics 365 Web API to create a new lead inside a Dynamics 365 account that is supplied

I also attached images for all 9 steps.

Habilidades: Extração de Dados, Dinâmica, Javascript, PHP, Captura de dados na web

Veja mais: php user input city dropdown, load video based user input, user input form, java program ask user input exam scores, let user input image php, facebook user input, php user input database example, want flash program adds numbers user input, word template user input form, dnn user input module, vb6 best grid allow user input, user input facebook app, vba excel pop gui user input data

Acerca do Empregador:
( 4 comentários ) Chicago, United States

ID do Projeto: #14788739

Concedido a:


Hello Sr. this is my offer, after we spoke with Madalina about the details of the project. Habilidades y experiencia relevante My skills/abilities includes website scrape and automation of processes. I will build a Wi Mais

$250 USD em 7 dias
(200 Comentários)

22 freelancers estão ofertando em média $275 para esse trabalho


Hi I work towards providing reliable, relevant and robust IT solutions at most competitive prices to my customers. I ensure 100% customer satisfaction so lets start Thanks Relevant Skills and Experience Data Minin Mais

$250 USD in 10 dias
(451 Comentários)

I have done a lot of scrapping and can scrap any site(even protected one) on challenge. My distinction, payment after your complete satisfaction with the resulted task. Relevant Skills and Experience http://apktower.c Mais

$277 USD in 3 dias
(283 Comentários)
$277 USD in 3 dias
(287 Comentários)
$277 USD in 3 dias
(78 Comentários)

Hi sir, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/scr Mais

$264 USD in 6 dias
(398 Comentários)

Hey Friend, We are 14 person team of developer, designer and tester provide you excellent services. Relevant Skills and Experience Myself having has 10 years experience of web site development. Expert in Custom pr Mais

$250 USD in 8 dias
(243 Comentários)

Hi Thank's for providing us an opportunity to bid on your project. We read you project description and understand clearly so we are highly interested to work for you Relevant Skills and Experience We specialise in PHP Mais

$250 USD in 3 dias
(141 Comentários)

Hello sir. I read your attached files and sure I can do it. A few days ago I've completed vTiger CRM project. So I am the best candidate. Relevant Skills and Experience Web scraping(PHP-curl, c#, Python, [login to view URL], Mais

$277 USD in 3 dias
(103 Comentários)
$257 USD in 3 dias
(54 Comentários)
$250 USD in 3 dias
(73 Comentários)

Hey, I am good on automated scraping tool. I can give you a software demo for this need. Regards, Rocky Stay tuned, I'm still working on this proposal.

$250 USD in 3 dias
(46 Comentários)
$250 USD in 3 dias
(57 Comentários)

Hello Client, Hope you are doing well ! I would like to take a chance to show my abilities and prove that I am a right candidate for this [login to view URL] more then 8 years of experience in,Python,Scraping,Crawlingand Sc Mais

$250 USD in 0 dias
(13 Comentários)

Hey, how’s it going? My name is Mike, I’m a Web Designer & Developer from Boston. I've had a look at your project description and feel that my skills match your requirements perfectly. Relevant Skills and Experience G Mais

$277 USD in 3 dias
(7 Comentários)

final Relevant Skills and Experience To achieve goal with 100% quality we have team of 15 Professional Software Engg/Developer. Proposed Milestones $277 USD - by delivering work of the highest quality on-time and on- Mais

$277 USD in 3 dias
(5 Comentários)

Hello, I am a full-time freelancer and do web scraping jobs only. I am creating automated data extraction systems for more than two years now Relevant Skills and Experience I can scrape any website using any technolog Mais

$277 USD in 3 dias
(7 Comentários)
$277 USD in 3 dias
(7 Comentários)

I checked your website and document details and yes will get your long along with I can do this work fast and deliver you soon. Relevant Skills and Experience I am having 6 year PHP and Wordpress and javascript and jq Mais

$333 USD in 3 dias
(3 Comentários)

Hello, I am a developer, web designer and computer programmer offering over +5 years of experience on both client and server sides. I work quickly and quality is my top priority. I am perfectly capable of following i Mais

$250 USD in 20 dias
(2 Comentários)

I may be able to help you integrate API. I have over 7 years of experience. I have previously helped test and integrate API. Please get in touch with me for more info Relevant Skills and Experience - Database (8 years Mais

$277 USD in 3 dias
(1 Comentário)