Crawling/Scraping Engineer

We're looking for a scraping/crawling engineer to join full time our 3-people Crawling team for a 3-month period.

This team is responsible for extracting information from thousands of websites every day. Due to constant changes in some of these websites, a number of our extractors break every day, so we need to continuously adapt them. We also need to continuously create new extractors for new sources.

Our tech stack: scrapy + Selenium. We use JIRA for the management of tasks.


- fluency in English, both written and spoken

- scraping/crawling experience (3+ years) using scrapy + Selenium

- python programming experience

- experience with online services, such as AWS and Cloudera

Please apply only in case you're an individual (i.e. no agencies) interested in joining the team full time for the next 3 months. Links to GitHub projects that you've developed in the past and any other references will be much appreciated.

A technical interview will be conducted before awarding the job.

Habilidades: CSS, Python, Scrapy, Captura de dados na web, xpath

Veja mais: web scraping, job scraping tools, web crawler api, web crawler, web crawling techniques, scrapy, web crawler tutorial, web crawler python, google job online data entry, job online php developer prado, getting job online live chat agent, engineer job sweden spanish, apply for a job online, system engineer job online, apply for job online graphic design, apply for job online in dubai for graphic designer, apply job online for graphic designer, apply typing job online, engineer freelance job online, find job online for web scraping

Acerca do Empregador:
( 0 comentários ) Munich, Germany

ID do Projeto: #19991162

34 freelancers estão ofertando em média €17/hora para esse trabalho


Hi. We are working on a new web crawling platform which we think have some advantages over scrapy and especially Selenium, which is limited in many ways. If you are interested to find out more let me know and we can t Mais

€17 EUR / hora
(113 Comentários)

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the Mais

€20 EUR / hora
(96 Comentários)

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spide Mais

€15 EUR / hora
(27 Comentários)

Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Pl Mais

€18 EUR / hora
(37 Comentários)

Hi There I have 10 years experience in Python and web development. 8 years developing Django sites and services. I did lots of projects in scrapy and crawler. i offer/accept lower price to get more rank. technology tha Mais

€23 EUR / hora
(70 Comentários)

Hello, Glad to meet you I have strong experience and skill in crawling and scraping as you could see in my recent reviews. Scrapy and selenium is my major skill for crawling. I am also so familiar with team work thro Mais

€12 EUR / hora
(45 Comentários)

Hi Nice to meet you. I have enough experience in python script. Below the libraries are I used in past project. selenium, pandas, matplotlib, lxml, beautifulsoup, scipy, and other useful libraries. I have written Mais

€16 EUR / hora
(51 Comentários)

[login to view URL] Credit is my motto. I am expert web scraping. I can avoid recaptcha. I can do your job with BS4 ,Perl script, Seleinum framework of python. I can do any project in your demand completely by my good experiences Mais

€15 EUR / hora
(41 Comentários)

Dear As an expert in web scraping, I developed 1000+ spiders using python, scrapy, php,nodejs,c# and proxies. And I scraped data and download images, files for CEOs and output result as csv, json, xml(yellow, ebay, w Mais

€15 EUR / hora
(66 Comentários)

Hello, We are IT-Engineers and Business Analysts, creating complete web and mobile solutions, for already more than 15 years, supporting our products with custom digital marketing strategies and instruments. Scra Mais

€70 EUR / hora
(1 Comentário)

Hi, Client!! @$@$@$PLEASE CONTACT ME. I CAN DO IT WONDERFULLY.$@$@$@ ##% Your idea is attracted me to your world.%## I am Python expert. i have various skills. @@PLEASE GIVE ME CHANCE TO PROVE MY SKILLS@@ :-): Mais

€16 EUR / hora
(31 Comentários)

Hi, ➲ 10+ years of full-time experience in Python / Django with 50,000+ Upwork hours billed and 50+ successful Python projects ➲ Upwork Top 10 Certification for Python and Django ➲ Guaranteed Results Policy: Pay onl Mais

€12 EUR / hora
(13 Comentários)

""I can do it"" Food/Restaurant/order/Delivery/Eat: [login to view URL] [login to view URL] [login to view URL] [login to view URL] 3D Cart: https: Mais

€14 EUR / hora
(2 Comentários)

‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHO Mais

€16 EUR / hora
(52 Comentários)

Note: We are an Agency but still placing the bids because in data fetching we have developed a product "Dragon SRCH, which may help you run the daily routine job. Dragon SRCH Platform is a cloud-based research eng Mais

€20 EUR / hora
(3 Comentários)

Hello, I'm Android (since 2012) and web (since 2013)developer. I can speak in English freely. I tend to keep myself up to date with important changes in the Android world and web frameworks and regularly look into ne Mais

€16 EUR / hora
(7 Comentários)

Hi, Dear. I have many development experiences, getting work about. As I am interested in your project, I want to do work it. I've read the project description and definitely can develop your task. If you hire me, I w Mais

€12 EUR / hora
(14 Comentários)

Hello, Webcrawls is may main skill !!! As I have accumulated gained rich experience with web applications, I'm pretty sure I can deliver satisfactory product for you. I can give you better suggestion based on detail Mais

€16 EUR / hora
(13 Comentários)

Respected Sir/Ma'am Job seems challenging, but, I can do it. You have mentioned that the structure of the sites is changing frequently, I can handle it. Try me, you won't be disappointed, give me a site(whose struct Mais

€12 EUR / hora
(4 Comentários)

Hello, I have experience in web scraping with Python. I can use Selenium, Scrapy, BeautifulSoup and Requests to make the best web scrapers! I hope to work with you!

€16 EUR / hora
(2 Comentários)