Build a web scraper for a specific website (Perl or Ruby)

I need to create a web scraper to gather a list of events listed on a single specific website. The scraper will convert events found on a website's online calendar into files containing the detail of those events.

At this URL you will find a "calendar" listing upcoming events:

[login to view URL]

The scraper must be written in Perl or Ruby. The program should take two command line arguments.

* The first argument should be an integer number of days into the future to scan. For example, if this argument were zero, it would indicate that only today's events should be scanned or if this argument were 2 it would indicate that all events occurring today, tomorrow, and the day after should be scanned.

* The second command line argument should be the name of a local directory where output files are placed.

Each "event" found on the calendar should cause the creation of one output file. The output file name should consist of the date on which the event "occurs" (in the format YYYY-MM-DD) as well as any additional characters to make the output filename unique and the file suffix should be ".yaml". An example of a valid filename might be "[login to view URL]" to indicate the second event occurring on February 17, 2019. The output file format should be YAML. An example of a valid output file is attached.

Each YAML file is built up from scraping the event detail page such as this one: [login to view URL]

In the attached example, the scraped data elements are circled in red. Please note that the detail page shown in the example actually has multiple events on it and should generate multiple output YAML files (one for each date/time).

For example, suppose that the script you create is called [login to view URL] and you invoke it with this command line on a Linux server:

./[login to view URL] 2 /tmp/scrapefiles

It would generate perhaps 6 yaml files in the /tmp/scrapefiles directory.

Habilidades: Perl, Ruby, Captura de dados na web

Veja mais: web scraping mechanize ruby, web scraping ruby vs python, ruby web scraping gem, ruby web scraping javascript, perl web::scraper, rails nokogiri scraper, ruby on rails nokogiri tutorial, web scraping ruby on rails, build website urbandictionary ruby rails, web scraper perl java, cgi perl java web scraper, build basic web scraper java, perl web scraper access, perl web scraper code, web scraper perl, build dotnet web scraper, perl web scraper line, php code build web based scraper, web application minimal website build, web developer london python perl ruby

Acerca do Empregador:
( 25 comentários ) Tempe, United States

ID do Projeto: #18803855

Concedido a:


I'm one of the best Perl web scraping experts here that's why I can provide you a working script in less than a day for just $100. It will read two command line params and output yaml files just like you want. Yo Mais

$100 USD em 1 dia
(433 Comentários)

18 freelancers estão ofertando em média $157 para esse trabalho


Hi, the project description is clear to me. I'm ready to come out a Perl script for you. _______________________________________

$155 USD in 2 dias
(72 Comentários)

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within th Mais

$155 USD in 3 dias
(74 Comentários)

Hi there! I see you are looking for a Perl expert who can build a web-scrapper for you. Here I am! I can offer you 10+ years of working experience and a wide range of projects completed successfully by me. Here are so Mais

$250 USD in 2 dias
(33 Comentários)

Hi, I am Ruby developer and DevOps. Skills: - Ruby - System Admin - Docker, Virtualbox , Nanobox, Kubernetes - Hosting & Maintaining any platform - Git, Bitbucket - MySQL , PostgreSQL - Web Scrap Mais

$200 USD in 3 dias
(24 Comentários)

Hi there, The requirements look quite clear and straightforward to implement. I just have a single question. Assuming we've started the scraper on March 6 as [login to view URL] 4 /some-path That means events on March 6, Mais

$150 USD in 3 dias
(18 Comentários)

Hello, I will create the web scraper in Ruby, please send me a message so we can discuss more, i have 8+ years of experience, i have done similar job for many web applications. Thanks!

$155 USD in 3 dias
(21 Comentários)

Hello, I have gone through the JD, i can work on the scraper, i have done similar job before, i have 9+ years of experience in ROR, please send me a message so we can discuss further. Thank you!

$100 USD in 3 dias
(5 Comentários)

Hello, After reading your project details I believe I'm suitable for this project. As I'm expert on it with more than 7 years experience. Please feel free to contact me. I am looking forward to hear from you. Mais

$130 USD in 3 dias
(21 Comentários)

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON Mais

$111 USD in 3 dias
(23 Comentários)

Hi I'm Colin - Ruby developer I have worked in many scraper project written in ruby with the supports of gems like Nokorigi, Headless Chromium/Firefox, PhantomJS, or simple HTTP I hope we can work together in Mais

$155 USD in 3 dias
(3 Comentários)

Hello there, I have been writing scraper scripts & desktop apps for my clients for quite a while now, either on here or upwork. You can look at the one of the latest scraping jobs I've done for another American f Mais

$244 USD in 3 dias
(3 Comentários)

Hi, glad to see your project. This is Kang from Shanghai, China. I'm a web application developer who has a lot of experiences in developing web scraping tools. I've carefully read your description and clearly unders Mais

$90 USD in 3 dias
(4 Comentários)

Hi I am experienced in web scrapping using Ruby. Using gems Nokogiri to scrap static HTML pages and Watir for JavaScript based web pages (also using watir for browser automation tasks). If you are interested please co Mais

$166 USD in 3 dias
(1 Comentário)

Hello, I can do what you are looking for. I am using ruby for web scraping (Watir and/or Mechanize gems).

$90 USD in 5 dias
(1 Comentário)

Certifications & Achievements • Certified ScrumMaster® • Certified PRINCE2® Project Manager • ExStartup Founder with reasonable Exit Product/Project Management Experience • Agile Coach for cultivating Agile Cult Mais

$250 USD in 3 dias
(3 Comentários)

Hi, We have gone through the details. We can automate things as well as scrap the content from the website for you and will result the output as well in yaml format for further import but we can do this script Mais

$222 USD in 3 dias
(0 Comentários)

Hi , I can achieve this using perl. I have 7byears of experience in perl. I would also like to know the platform you are using to run the script. let me know your preferences. thanks,

$111 USD in 7 dias
(0 Comentários)