Encerrado

Ruby (on Rails) expert for Web Scraper / Web Scraping Job needed

Intro.

I am looking for a multi-talented Ruby (on Rails) expert in web scraping. You are going to build an entire webapplication with Ruby (on Rails) - using the newest Rails 6.0.0 version and the latest compatible Ruby version. You will find all the links to Frameworks, Templates, Gems etc. below.

Target website.

The first website will be AirBnB's room / housing listings. Please take a very careful look at a few of those listings. AirBnB's is randomly generating id and name HTML-attributes to protect their site from scraping. The structure seems to stay the same though. You will always be presented with 300 search results - even in cities like New York City. To see all listings you have to adjust the price (increase, decrease). In addition to that, use the map to get all the results (zoom in and out, move the map).

Backend.

• You will use the Kimura framework for scraping jobs (link below)

• You will create a "command script" that triggers an AWS EC2 server to be setup, configured and destroyed for every single scraping job (see tutorial / links below). This server will function as a proxy. You are going to use Terraform for that.

• Authorization through CanCanCan (Guest, User, Manager, Admin)

• Authentication through Devise (Basic User table with login is enough)

• Historization of all listings through Papertrail

Scraping job.

The scraping job needs to run when triggered (e.g. if I want to have a new city to be scraped). Also, the job needs to re-scrape an existing listing - the old version can be saved through Papertrail, or you just create a new listing and reference the old with the new one.

Frontend.

I will provide you with a Bootstrap admin template that needs to be used for the frontend. This Bootstrap admin template is built on top of the Bootstrap framework, SASS, jQuery, HTML5, and CSS. So you need to know how to work with those!

Links.

[login to view URL] (Ruby Framework)

[login to view URL] (Create AWS servers tutorial)

[login to view URL] (EC2 proxies)

[login to view URL]

[login to view URL]

[login to view URL]

Habilidades: Amazon Web Services, CSS, HTML5, PostgreSQL, Ruby on Rails

Veja mais: ruby rails web service response types, ruby rails agile web development freelance dev book, ruby rails web reservation system, ruby rails job kochi, web service post xml ruby rails, job careers scraper scraping york web, ruby rails webmaster job description, rss web services ruby rails, setup ruby rails shared web host, web scraping job employment, web scraping job python, web scraping page scraping job posting, ruby rails web development, become ruby rails expert, ruby rails expert job, script scraping job classifieds web, ruby rails web scraping, web scraping using ruby rails, ruby ruby rails expert

Acerca do Empregador:
( 0 comentários ) United Kingdom

ID do Projeto: #20015968

14 freelancers estão ofertando em média $540 para esse trabalho

bhavesh1508

Hello, I can do the job, please send me a message so we can discuss more. I am a skilled and experienced Developer having 7+ years of experience in ROR Web Development, Front-end Development, API Development, T Mais

$555 USD in 10 dias
(24 Comentários)
6.5
arvindkushwah9

Dear, I have 7+ years experienced in Web Development. I'm full stack Ruby On Rails developer, I have experience in developing the application like you want with, i can do this job very well. Specialties: Ruby Mais

$555 USD in 10 dias
(65 Comentários)
6.5
JinTaiZhe

Dear Client. I see your job post and I'm sure this is my job. I have rich experiences in Ruby on Rails with React.js, Angular.js, Vue.js frontend. You can check out my skills reviewing these websites. [login to view URL] Mais

$500 USD in 7 dias
(8 Comentários)
5.8
mjainror

Hello, I can do the job EASILY, your requirement is matching with my skills. I am a senior Ruby on Rails developer with 6+ years of extensive experience in building various responsive and beautiful websites. Pleas Mais

$300 USD in 7 dias
(12 Comentários)
5.5
protovosolutions

Hi, We've expertise in Ruby on Rails, Reactjs, Redux, Heroku, JavaScript - [login to view URL] and we'd like to work with you on your project, can we please discuss in detail? Currently, we're working on a marketp Mais

$840 USD in 20 dias
(34 Comentários)
5.5
kipdev13

Nice to meet you. I've read the task description and can develop definitely. I'll provide you with the highly skill to complete this task in time. I'll also do my best for you. Please contact with me. Thank you ve Mais

$555 USD in 10 dias
(11 Comentários)
4.9
sky930320

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spide Mais

$500 USD in 7 dias
(7 Comentários)
4.6
zeke

Dear Customer! I have built many scrapers. This is my favorite type of job. I am absolutely confident I can complete your project easily and on time. Ready to begin immediately and finish as soon as possible. Please co Mais

$500 USD in 14 dias
(15 Comentários)
5.4
kapilgoyal6

Hi there, Well, I’m a Senior Ruby on Rails Developer having an experience of 6+ years. I have technically rich hands-on developing applications in Ruby on Rails, Python, Wordpress, Jekyll and develops the APIs as wel Mais

$250 USD in 4 dias
(6 Comentários)
3.7
sagarbommidi

Hi, I have solid experience in building web applications using Ruby, Rails, Sinatra and Python with Flask. Have worked on many projects from small POCs till large projects which has large scale of data processing. Hav Mais

$750 USD in 15 dias
(1 Comentário)
2.4
jitingroofl

Hello, Greetings for the day!!! I'm Front-end Developer with 5+ years of experience designing, developing, and managing a complex website. Specializes in various types of layouts, elements, grids, animations, res Mais

$500 USD in 15 dias
(2 Comentários)
2.0
smilingcstar

Hello! I see that you need some help for web scraping I can help with that and can start right away! I hope to chat with you. Thank you!

$500 USD in 7 dias
(0 Comentários)
0.0
evonsystems7

Dear Prospect Hiring Manager. Thank you for giving me a chance to bid on your project. i am a serious bidder here and i have already worked on a similar project before and can deliver as u have mentioned "I can do th Mais

$550 USD in 7 dias
(0 Comentários)
0.0
noslopy

Hey, My name is Ben, and I'm a software engineer from Hungary currently working for a US based startup. I'm currently working with Node.js, Go-lang back-end and React front-end stack. Previously I have been working wi Mais

$700 USD in 10 dias
(0 Comentários)
0.0