Em Andamento

Convert ruby cron job scrapers to run as background jobs in a queue

Stagecoach Software Pty Ltd is developing a website to contain statistical profiles of a particular industry in Australia. Our stack is Ruby on Rails 4.1.2 and MySQL 5.5. We run a 3 server configuration on Engine Yard (Gentoo) with dedicated instances for our db, web app and utilities.

Our database receives about 30,000 new rows per day through scraping operations. We have about 22 scrapers that run at least once per day on cron jobs on our utility instance. We want to convert the scrapers from cron jobs to run in a rails queue to make better use of our system resources.

Bidders should state what rails processes they would use or recommend to achieve this objective and why.

There is a steady pipeline of projects available to the freelancer who completes this job successfully and promptly.

Habilidades: Ruby on Rails

Veja mais: cron job sitemap, automator cron job, cron job tutorial php mysql, ruby on rails, fake cron job script run days, run cron job upload, run automator cron job, run vielerets php cron job, creating background jobs ruby, run windows background jobs, run grabber cron job, a job in australia, app developing job website, app engine cron, australia and jobs, australia available jobs, australia freelancer job, australia in jobs, australia job for freelancer, Australia jobs

Acerca do Empregador:
( 57 comentários ) Idalia, Australia

ID do Projeto: #8151912

9 freelancers estão ofertando em média $603 para esse trabalho


Hi, Have 3+ years of experience in web development, my motive is to attain utmost perfection in every assignment that I undertake, irrespective of its size. Currently I've a rich experience in Agile web framework ( Mais

$555 AUD in 10 dias
(1 Comentário)

Hi, Near 5 years rails development experiences. also i have an expirince with postgres, LAMP ,mysql,Linux, Apache, MySQL, PHP, Heroku, Github ,amazon ec2, engineyard etc project experiences. More backend devel Mais

$555 AUD in 10 dias
(36 Comentários)

Hello. I hope scrapers written in Ruby? I plan use Sidekiq (together Redis) for to achieve goals. Sidekiq is a mature solution that we used a lot of time in their projects.

$655 AUD in 10 dias
(2 Comentários)

Dear Sir/Madam, I am happy to bid for your company. I am Shyam V, experienced Ruby on Rails developer with over 8 years of experience. According to your description, to convert scrapers from cron jobs to run in Mais

$555 AUD in 10 dias
(15 Comentários)

Hello, Since last 9+ years I've been working as Full Stack Web Developer and from last 6 years as a Ruby on Rails(ROR) Developer. Ruby & ROR is my passion, my skill but apart from it, I have a good expertise in othe Mais

$444 AUD in 5 dias
(44 Comentários)

Hi, I have read your post and understood your requirement. I have great experience in handling /Ruby on Rails/PHP/MySQL/HTML5/jQuery/Wordpress/Magento/Joomla/Drupal/AngularJS/node.js/CSS3/Java/Python/Django/Javas Mais

$1030 AUD in 10 dias
(0 Comentários)

I joined BangTheTable [login to view URL] 7 years back when they were a team of business heads and sales pros. I single handedly started developing their online engagement platform [login to view URL], and late Mais

$555 AUD in 5 dias
(0 Comentários)

Hi, thanks for invite me to this project. I'm placing this bid but I'm not 100% sure on what do you need to be done. I'm assuming that you already have these scrappers on ruby and that they're already working. In my p Mais

$526 AUD in 10 dias
(6 Comentários)

My extensive experience with Rails include building end to end RoR backed websites, offer community solutions to critical problems, provide framework level security fixes for Ruby on Rails. It is Rails that helped Mais

$554 AUD in 10 dias
(0 Comentários)