Write a Python script to scrape a website and save data it to a single file

I need to scrape data from this website: [login to view URL]

The script must log in to the website, fill out a form, submit a request, then download data from a page that has links to futher pages that must be scraped for data.

I have included pictures of the pages that appear as someone would navigate through the process. I will describe it here as steps:

1. Log in to the website using a key (which I will provide)

2. Enter data into the form, some of which are text fields, and some of which are drop downs

3. Click on the Vessel Summary button

4. Scrape the data on the resulting Summary page

5. Click the detail button on each entry (row)

6. Scrape the data on the detail page

7. Move to the next row/entry

8. After getting the details for each entry/row on the first page, move to the NEXT summary page and repeat 4-7 until there are no more summary pages

Habilidades: Engenharia, Javascript, Python, Arquitetura de software, Captura de dados na web

Veja mais: web scraping python beautifulsoup, web scraping examples, python 3 web scraping, web scraping techniques, web scraping multiple pages python, web scraping tutorial, python get data from website, python web scraping to csv, python script scrape website, need help write python script operate telit module, need write python script telit gc864quad module, script scrape website, create save data excel file php script, php script parse email save data mysql, python script scrape web site, perl script scrape website, perl script scrape website rss, php script scrape website, python script crawl website, python script retrieving website data

Acerca do Empregador:
( 0 comentários ) Pittsburgh, United States

ID do Projeto: #19642850

Concedido a:


Open chat fast, you are risk! I have a lot of experience in scraping as freelancer with scrapy/selenium/beautifulsoup (python) and Goutte (php). I also have developed a python script with implemented multithreading an Mais

$155 USD em 3 dias
(20 Comentários)

29 freelancers estão ofertando em média $165 para esse trabalho


Hello, Dear How are you? I have read your project description and am ready for discussing with you about project. I have experienced in developing Engineering, Javascript, Python, Software Architecture, Web Scrapin Mais

$200 USD in 3 dias
(112 Comentários)

Hi, I am interested in your project related to build a scraper to get data from I have checked the 4 screenshots, and have some questions/remarks : 1- What is the output format you need ( eg. CSV , SQ Mais

$280 USD in 7 dias
(377 Comentários)

Hello sir Thanks for clear job description. I am a senior python developer with 9 years of experience about web scraping. I have fully understand the requirements and am confident with this project. I am using S Mais

$155 USD in 3 dias
(112 Comentários)

Hello Sr./Madam Hope you read my proposal and take a look into my Portfolio to see my reputation and capabilities. I am an experienced Windows Desktop Apps Developer (C#, C++), Web Data Extractor & Automator (using d Mais

$250 USD in 5 dias
(204 Comentários)

First of all thank you for a detailed description! I'm one of the best Python and web scraping experts here (check my reviews) that's why I'm sure you'll be impressed with my work. I can provide you a Python scraping Mais

$180 USD in 2 dias
(487 Comentários)

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I can create you script in Python for ''[login to view URL] '' that will do all things that you Mais

$179 USD in 4 dias
(92 Comentários)

Hello? Nice to meet you. I am excited to work with you on this project. I am ready to start work immediately. So I think I can help you if you want. Here is on of my scrap with python working result. [login to view URL] Mais

$140 USD in 7 dias
(112 Comentários)

Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Pl Mais

$250 USD in 4 dias
(76 Comentários)

Hello How are you My name is Xu as python expert I have so scrpaer built before i have full time and I can start to work immediately Please contact me and do let us discuss about your project Thanks for your postin Mais

$200 USD in 7 dias
(62 Comentários)

Dear Hiring Manager. I am so excited to apply in your project. just went through the job description. I am an experienced web scraping and crawling expert using Python script. You can review my ability checking t Mais

$277 USD in 3 dias
(51 Comentários)

Hi there, We understand your request because we build same project for our client we can provide you fast service Let me introduce our Company about .. Clientsoftech Solutions (Cs) is a leading Development professio Mais

$250 USD in 4 dias
(20 Comentários)

Dear, employer. My name is Lee, I am an experienced web developer, and web scraping expert. I have good experiences in web scraping using PHP, Python, Java and so on. I read your job description, and I am interest Mais

$144 USD in 3 dias
(22 Comentários)

With respect to this project I would like to present myself as a candidate for your consideration. I have more than 8 years of IT experience. I have successfully completed few projects which involved Programming, scrip Mais

$140 USD in 4 dias
(33 Comentários)

Hi, I have vast experience of developing tools for automating process on websites. I have 2 solution options for this process. a)Create python based script using selenium, which will automate Google Chrome. It wi Mais

$120 USD in 2 dias
(60 Comentários)

Hi, I'm a python dev specializing in web scraping and development, as well as in data processing and analysis. Site you need data from seems pretty straight forward on first glance, so i'm confident i can deliver the d Mais

$125 USD in 3 dias
(28 Comentários)

Hi, How are you? I am interested in taking up your project. I can complete your project on time and within your budget. I have worked on similar projects to what you are looking for, and I am confident I can exceed Mais

$140 USD in 3 dias
(15 Comentários)

Dear Sir/Madam, I fully understand your requirements. Ready to start ***************************************************************

$111 USD in 3 dias
(9 Comentários)

*** I have checked your description, the link and attach file. I have good experience with scraping data from websites. I can do your project asap and as well. I want to discuss with you this project. Thanks.

$200 USD in 7 dias
(14 Comentários)

Hi, Dear. Nice to meet you. I have rich experience in your project. I read your requirement in detail. I will complete your project within 2 days at most. Before I have been developed projects similar as your requireme Mais

$170 USD in 2 dias
(3 Comentários)

I'm a electrical engineer with over 8 years experience in Software & Web Development in both national and international market. My Expertise: Web Site - (PHP frameworks ,SPSS, Mintab, Joomla, Wordpress, Magento,Laravel Mais

$50 USD em 1 dia
(1 Comentário)