
Fechado
Publicado
Pago na entrega
I need a reliable, fully-automated pipeline that pulls fresh information from every listing on [login to view URL] once per day, stores it in a query-friendly repository, and highlights what changed since the previous run. Core requirements • Daily crawl of the entire marketplace, respecting [login to view URL] and avoiding rate-limit blocks. • Change tracking that flags brand-new ads as well as listings that disappear (sold or removed). • On-the-fly statistics—total ads, average price per brand, mileage ranges, etc.—saved alongside the raw data for quick dashboards. • Clean, well-commented code that can scale beyond the Greek market if I later add more portals. Data points to capture - Price and Mileage - Brand and Model - Year and Condition - Any additional fields your scraper can reliably expose (seller type, fuel, transmission, photos, location, description text, listing URL, timestamp). Deliverables 1. Source code (Python, Node.js or another language you propose) plus requirements file or Docker image. 2. Schema-controlled storage layer (PostgreSQL, MongoDB, or flat files—convince me of the best fit). 3. One-click or cron-ready execution script and README. 4. Sample CSV/JSON export demonstrating daily deltas and summary stats. Acceptance criteria • A 24-hour test run proves 100 % listing coverage with no duplicate rows. • Second run correctly labels adds/removals and updates analytic tables. • Installation from a clean server takes under 15 minutes using only the supplied documentation. If you’ve built Scrapy spiders, headless-browser collectors, or data pipelines on AWS/Lambda/GCP before, I’m keen to see your approach and a quick timeline to MVP.
ID do Projeto: 40169240
71 propostas
Projeto remoto
Ativo há 8 dias
Defina seu orçamento e seu prazo
Seja pago pelo seu trabalho
Descreva sua proposta
É grátis para se inscrever e fazer ofertas em trabalhos
71 freelancers estão ofertando em média €165 EUR for esse trabalho

⭐⭐⭐⭐⭐ Build a Reliable Data Pipeline for Daily Car Listings Updates ❇️ Hi My Friend, I hope you're doing well. I've reviewed your project needs and see you're looking for a fully-automated data pipeline for car listings. You don’t need to look any further; Zohaib is here to help you! My team has successfully completed 50+ similar projects for data scraping and automation. I will create a reliable system that pulls fresh data daily, tracks changes, and provides on-the-fly statistics, all while keeping the code clean and scalable. ➡️ Why Me? I can easily build your automated pipeline as I have 5 years of experience in data scraping, Python programming, and database management. My expertise includes web scraping, data storage, and change tracking. Additionally, I have a strong grip on technologies like PostgreSQL and Node.js, ensuring a smooth implementation of your project. ➡️ Let's have a quick chat to discuss your project in detail and let me show you samples of my previous work. Looking forward to discussing this with you! ➡️ Skills & Experience: ✅ Python Programming ✅ Web Scraping ✅ Data Storage ✅ Change Tracking ✅ API Integration ✅ Database Management ✅ Data Analysis ✅ Clean Code Practices ✅ Automation Scripting ✅ Data Visualization ✅ Docker ✅ Project Documentation Waiting for your response! Best Regards, Zohaib
€150 EUR em 2 dias
8,0
8,0

Hello I will design and deploy a robust, fully-automated daily data scraping pipeline for car.gr. This reliable solution will extract and deliver structured, clean data efficiently, incorporating comprehensive error handling and retry mechanisms. You'll receive consistent, accurate data daily without any manual intervention, ensuring a seamless and high-performance flow to meet your operational needs. Giáp Văn Hưng
€117 EUR em 7 dias
6,8
6,8

⭐>>-- Scraping Boss is here--<<⭐ I totally understand what you want. I have S_T_R_O_N_G experience in web/data scraping and crawling. I can scrape any website and overcome all anti-bot policies like Recaptcha, IP detection, etc... Just click the "Chat" button for further discussion. Thank you.
€250 EUR em 7 dias
6,8
6,8

Greetings, I will engineer a robust, fully automated pipeline to meet your exact requirements for car.gr. Leveraging my extensive experience with Scrapy and headless browsers, I will build a scalable, respectful crawler for daily full-market snapshots. The system will implement precise change detection for new/removed ads and generate on-the-fly analytics. I propose a PostgreSQL schema for optimal querying and will deliver production-ready, well-documented code, a seamless deployment setup, and verifiable sample outputs within a clear MVP timeline. Regards, Joseph
€200 EUR em 2 dias
6,1
6,1

Hi there, I have reviewed your requirements and believe that my expertise aligns perfectly with them. It seems like something we can easily accomplish Please check my profile to learn about my expertise: https://www.freelancer.com/u/AliGhazanfar2 Looking forward to the opportunity to work together. Regards Ali
€30 EUR em 1 dia
5,3
5,3

⚠️ If you’re not happy, you don’t pay ⚠️ Hello, As a Senior Web Developer, I assure 100% listing coverage using a Python-based automated pipeline with Scrapy spiders for daily crawls on car.gr. The tech stack will include Python, Scrapy for scraping, and PostgreSQL for efficient data storage. I've successfully built similar pipelines ensuring brand-new ad flags and disappeared listings detection. Analogous to your project, I created a robust system for real-time data tracking, handling similar data points and dashboard-ready statistics. My proposed roadmap includes an initial audit, core development implementing Scrapy spiders, and final testing for seamless functionality. Could you please clarify the preferred method for defining listing URLs for change tracking purposes? Best regards, Piyush Gupta Senior Web Developer | Python Expert
€150 EUR em 2 dias
4,7
4,7

Hello, I hope you are doing well. I build robust data pipelines and scalable scrapers for dynamic marketplaces. My approach combines reliable daily crawls, change-detection, and a clean, query-friendly storage layer to empower quick dashboards. I focus on maintainable code that scales beyond one portal and adapts to new sites. In similar setups I’ve delivered daily crawls with delta tracking (new vs removed ads) and on-the-fly statistics, with tools like Scrapy/Playwright and PostgreSQL or MongoDB, packaged in Docker for easy deployment—plus clear README and sample exports. gareentee that I will deliver perfectly. Please feel free to contact me so we can discuss more details. I am looking forward to the chance of working together. Best regards, Billy Bryan
€250 EUR em 3 dias
4,0
4,0

Hi there, I'm excited about your project to create a reliable and fully-automated data scraper for car.gr. With over 9 years of experience building high-accuracy web scrapers and data pipelines, I’m confident in my ability to deliver a solution that meets your requirements. I've successfully built similar systems that track changes and provide on-the-fly statistics, ensuring no listing goes unnoticed. I can start immediately and will incorporate best practices to ensure the scraper respects crawl limits and is scalable for future projects. The resulting pipeline will include clean code, a documented README, and quick execution scripts for seamless deployment. I look forward to discussing this further and ensuring every detail is tailored for your needs.
€250 EUR em 10 dias
2,5
2,5

Welcome to professional Python development services! Hi there, I'm Alema, a Python expert programmer who strives for clear code in atmospheric, numerical weather prediction, physics, and all other seminal fields. I'm ready to provide you with high-quality services. I have completed 350+ projects with a 100% Positive Rating. If you are looking for Quality work, look no further. Also, we are a team of professional workers, and we are always available 24/7 to help employers without limitations, and delivery is guaranteed on time. Your faithfully. Eng. Alema Akter v
€30 EUR em 1 dia
2,5
2,5

Hi, I am Vardan Agrawal. With 6+ years of solid professional experience in JavaScript, PHP, I bring a strong track record of delivering high-quality, reliable, and results-driven solutions. I’ve reviewed your requirements thoroughly, and I’m confident I can execute this project with precision and consistency — exactly the way you need. I also have direct, proven experience working with the exact skills you’ve listed — PHP, JavaScript, Python, Web Scraping, Node.js, PostgreSQL, Web Development, Data Scraping — and have successfully delivered similar projects for clients across different industries. My focus is always on building dependable, scalable, and well-structured solutions that perform flawlessly in production. Please do checkout my portfolio and past works on my profile at: https://www.freelancer.com/u/vardanagr67/ Let’s connect in chat to discuss the technical roadmap, production workflow, and project budget in detail. I’m confident I can deliver exactly what you're looking for and ensure this project is completed smoothly, professionally, and on time. Regards, Vardan Agrawal
€140 EUR em 7 dias
1,9
1,9

As a successful full stack IT expert with a solid background in building data pipelines and web scraping applications, I have the skills, experience, and expertise you need for your data scraper project. Having worked intensively with Python, I am deeply familiar with Scrapy spiders and headless-browser collectors - just the tools needed to create an automated pipeline like yours. My proficiency with Django and related frameworks makes me fully capable of delivering robust solutions that can scale beyond the Greek car market if needed, without sacrificing performance. Let me reiterate that I’m about innovation. Given your interest in ML, my prowess in PyTorch, Scikit-learn, OpenAI perfectly complements your demand for on-the-fly statistics. Remember working with APIs? With me you get RESTful & GraphQL APIs using Django DRF & FastAPI—those are the ones you won't regret! Trust me to build efficient and clean code with thorough documentation for easy installation from any server within minutes. As a seasoned professional, I maintain a results-driven approach focused on driving business growth and innovation consistently over two decades—a trait that will surely guarantee a successful and satisfying outcome for this project!
€140 EUR em 7 dias
3,1
3,1

Hello Ada M., We went through your project description and it seems like our team is a great fit for this job. We are an expert team which have many years of experience on PHP, JavaScript, Python, Web Scraping, Node.js, PostgreSQL, Web Development, Data Scraping Lets connect in chat so that We discuss further. Regards
€140 EUR em 7 dias
0,6
0,6

Hello I use tools like Python (BeautifulSoup, Scrapy, Selenium, Playwright) and Node.js (Puppeteer, Cheerio) to extract data accurately and efficiently. I also handle challenges like rate limiting, CAPTCHAs, user-agent rotation, and proxy integration to ensure the scraper works smoothly and avoids blocks. Whether you need to scrape product listings, pricing data, directories, job postings, social media content, or any other type of information, I can build a tailored solution and deliver the data in formats like JSON, CSV, Excel, or directly into your database or API. I look forward to discussing the project further and providing you with the best possible service. Best regards
€140 EUR em 7 dias
0,0
0,0

This is the kind of data pipeline I usually design end-to-end: crawling, persistence, and analytics treated as one system rather than separate scripts. I’d likely use Python with a mix of Scrapy and lightweight headless fallback only where strictly needed, keeping the crawl efficient and respectful. Storage-wise, PostgreSQL with a well-defined schema gives you excellent querying and historical comparison, especially for “what changed since yesterday” questions. Each daily run would generate a run_id, making it trivial to compare snapshots and flag new, removed, or modified listings. I’ve handled marketplaces with frequent listing churn, so disappearance detection is something I build in from day one. The code would be cleanly structured with clear abstraction boundaries so extending beyond Greece later is straightforward. I also put effort into reproducible environments, either via Docker or a simple requirements-based install.
€100 EUR em 2 dias
0,0
0,0

What stands out to me is your emphasis on reliability and future expansion rather than a one-off scrape. I’ve built spiders that crawl entire national marketplaces daily and survive months of unattended operation. For this project I’d propose a Scrapy-first solution with smart throttling and robust error handling, storing results in a normalized database with explicit lifecycle states for each listing. That makes identifying new ads, removed ads, and updated fields trivial and auditable. On top of that, I’d add a small analytics layer that precomputes totals, averages, and ranges per brand or model after each run. The structure would be generic enough to plug in additional portals later with minimal effort. I take documentation seriously, so you’d get a README that walks from empty server to first successful crawl without guesswork.
€160 EUR em 2 dias
0,0
0,0

Hello! I can build your automated pipeline as you mentioned in project description. I am an independent and professional developer holding 100% completion rate. I am highly interested about your project, Feel free to reach out for a brief discussion
€120 EUR em 5 dias
0,0
0,0

Frankfurt am Main, Germany
Membro desde jan. 22, 2026
₹12500-37500 INR
£20-250 GBP
$15-25 USD / hora
₹1500-12500 INR
$10-30 USD
$2-8 USD / hora
₹5000-10000 INR
₹1500-12500 INR
₹37500-75000 INR
€750-1500 EUR
$15-25 USD / hora
$15-25 USD / hora
$250-750 USD
₹75000-150000 INR
₹1500-12500 INR
$15-25 USD / hora
$30-250 USD
$250-750 USD
$30-250 USD
₹1500-12500 INR