
Open
Posted
•
Ends in 7 hours
Paid on delivery
I will supply the full URL of the target site and need an automated crawl that captures every internal page, pulls out all text and every embedded image, and records the direct URLs discovered along the way. Rather than a flat file hand-off, the collected material should be transferred into another website I specify, maintaining the original page structure so that links, headings, and image references remain intact. Please handle the job with a reliable stack such as Python, Scrapy or BeautifulSoup for the crawl, and use whatever bridge—REST, direct database import, or CMS API—you find most efficient for moving the scraped data into the destination site. Deliverables • A reproducible script or crawler project. • Full text and image assets migrated to the destination site, preserving hierarchy and links. • A mapping file (URL → new location) for verification. Acceptance Criteria All public pages are reachable from the destination site, text matches source pages, images load correctly, and no broken links appear after migration.
Project ID: 40454130
212 proposals
Open for bidding
Remote project
Active 17 hours ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
212 freelancers are bidding on average $142 USD for this job

Hi, Building an automated crawl to map every internal page and its corresponding images requires more than just a simple scrape. I see you need to move the source text into a new site while keeping the original page structure and link integrity. Managing that hierarchy manually is impossible at scale. I can build this using Python and Scrapy to handle the data extraction. To move everything into your destination site, I will create a custom bridge using the CMS API or a direct database import. This ensures your headings and image references stay intact without me having to touch every page by hand. My goal is to make sure the mapping file matches your source site perfectly so no links break during the move. We recently built a Python deterministic engine that focused on this kind of data accuracy and auditability. Want a 2-min screen recording of how I would build your custom ETL migration bridge? Just say the word. ~ Rajesh
$140 USD in 7 days
9.4
9.4

Hello, As a seasoned developer for over [X] years, I have accumulated a wealth of experience that will prove beneficial to your web scraping project. My proficiency in languages such as PHP lays the foundation for efficient, adaptable and reproducible scripting - a skillset that aligns perfectly with the requirements of your project. In particular, my familiarity with Python and its libraries such as Scrapy and BeautifulSoup can automate your website crawl and data transfer seamlessly. I strongly believe in keeping the integrity of the scraped data intact; your desired website structure with working links, headings, image references, is guaranteed to remain unchanged throughout the migration process. At Our Software, we are driven to add a "WOW" factor to every project we undertake, no matter its scale. Your requirements are no exception. We are dedicated to delivering not just functional outcomes but solutions that go beyond expectations. In addition, you can expect constant communication, regular updates and strict adherence to deadlines. Let's embark on this project together and turn your vision into a reality that will propel your business towards new heights. Thanks!
$130 USD in 2 days
8.6
8.6

With expertise in web scraping using Python and BeautifulSoup, I understand your need for an automated crawl to extract text and images from the target site and migrate them to another website while preserving original structure. Could you clarify if the destination site's CMS API integration is required for this project? Regards, Yogesh Kumar
$120 USD in 7 days
8.4
8.4

Hi there, I will build a Scrapy crawler that captures all internal pages, extracts text and images, and migrates everything into your destination site — preserving page hierarchy, headings, links, and image references. I will also generate the URL mapping file for verification. One thing I will handle early: relative-to-absolute URL conversion during the crawl, so internal links and image paths resolve correctly on the destination site without post-migration cleanup. Questions: 1) What CMS or platform is the destination site running — WordPress, custom, or something else? 2) Roughly how many pages does the source site have? Looking forward to talking through the details. Kamran
$90 USD in 5 days
8.4
8.4

Hi there, We’ve developed a similar solution that automatically scrapes multiple websites, extracts content, and imports it into WordPress while preserving the original structure. We also built a custom WordPress plugin to manage and schedule these imports, ensuring that the content is always up-to-date. For your project, we can use a combination of Python and PHP to create a robust solution that handles both scraping and importing. This way, you get a fully integrated system without the need for multiple separate tools. Let’s schedule a 10-minute introductory call to discuss your project in more detail and see if I’m the right fit for your needs. I’m eager to learn more about your exciting project. Best, Adil
$154 USD in 7 days
7.5
7.5

Greetings, I appreciate the opportunity to help with your website scraping project. You’re looking for a way to automate the process of crawling a website, capturing all internal pages, text, and images, while ensuring everything transfers smoothly to a new site without losing the original structure. My approach would involve using Python with Scrapy or BeautifulSoup to create a reliable crawler that gathers all the necessary data. I’ll ensure that the migration maintains the hierarchy of links and images, and I will set up an efficient method for transferring the data, whether it’s through a REST API or direct database import. You’ll receive a reproducible script for future use and a mapping file for verification, ensuring everything is intact after the move. Best regards, Saba Ehsan
$200 USD in 4 days
7.1
7.1

Dear Sir, I am an expert in web automation, web scraping and lead generation, with extensive experience using the latest technologies, including Java (Jsoup, Selenium) and Python (Scrapy, BeautifulSoup). To review the quality of my work, I invite you to visit my Freelancer profile at the link below: https://www.freelancer.com/u/p4logics I would be happy to discuss your project requirements in detail and am available to begin work immediately. I look forward to hearing from you. Best regards, Deepak
$250 USD in 7 days
7.8
7.8

Hi I can build a reproducible crawler that captures every internal page from the target site, extracts text, embedded images, links, headings, and page hierarchy, then migrates the content into your destination website. The main technical challenge is preserving the original structure while avoiding broken image paths, duplicate pages, malformed HTML, or missing internal links after migration. I would use Python with Scrapy, BeautifulSoup, requests, or Playwright if dynamic rendering is needed, depending on how the source site is built. For the migration side, I can connect through REST API, CMS API, direct database import, or a structured import format based on the destination platform. I can also generate a URL mapping file showing each original source page and its new destination location for verification. The final crawler will be reusable, documented, and designed to keep page content, image references, and internal navigation intact, assuming you have permission to copy the source content. Thanks, Hercules
$140 USD in 7 days
7.1
7.1

I can build a reliable full-site crawler and migration pipeline for your project using Python (Scrapy + BeautifulSoup). The system will: • Crawl the entire website, capturing all internal pages recursively • Extract full page text, structure (headings/links), and all embedded images • Preserve original site hierarchy and internal linking structure For migration, I will integrate a suitable method based on your destination platform (REST API / CMS API / database import) to directly publish the scraped content while maintaining structure and media integrity. Deliverables will include a fully reproducible crawler project, migration scripts, and a complete structured data transfer ensuring no broken links or missing assets on the destination site.
$140 USD in 7 days
6.8
6.8

I can build a full-site crawler using Python/Scrapy to capture all internal pages, text, images, and URLs, then migrate the content into your target website while preserving structure, links, and media references. I’ll provide reusable scripts, URL mapping for verification, and ensure the migrated site is fully navigable with no broken links or missing assets.
$120 USD in 3 days
7.2
7.2

Hello, I understand you need a full website crawling and migration solution that can recursively scrape all internal pages of a target website, extract complete text content and embedded images, and then reconstruct and transfer that structured data into a destination website while preserving the original hierarchy, links, and page relationships. The key requirement here is not just scraping, but accurate structural replication with clean URL mapping. I will build a robust Python-based crawler using Scrapy (or BeautifulSoup where needed) that will systematically traverse all internal links, extract page-level content (HTML structure, headings, text blocks), and download all media assets while preserving original references. I will then implement a transfer layer using either REST API, CMS import tooling, or direct database mapping (depending on your destination stack) to rebuild the site structure. A complete URL-to-new-path mapping file will also be generated for verification and traceability. The final delivery will include a fully reproducible crawler project, a structured migration pipeline, and a verified destination site where all pages are accessible, media loads correctly, and internal navigation remains intact without broken links. The solution will be modular so you can rerun the crawl or adapt it to other sites later with minimal changes. Thanks, Asif
$250 USD in 3 days
6.8
6.8

Hi, I can build a reliable crawler/migration pipeline to scrape all public pages, extract text/images/URLs, and transfer content into your target site while preserving structure, links, and hierarchy. Deliverables include reproducible script, migration mapping file, and validation for broken links/assets. Same timezone collaboration preferred, budget negotiable. Let’s discuss source/destination details.
$140 USD in 7 days
7.0
7.0

Hello, I can build a reliable Python crawler using Scrapy or BeautifulSoup to collect every internal page, extract text and image assets, and keep the discovered URL structure clean for migration. I can also connect the output to your destination website through the best available method, whether that is REST API, CMS import, direct database insert, or a custom bridge, while preserving headings, links, images, and page hierarchy. I will provide the reproducible crawler project, migrate the content, and create a URL to new location mapping file so you can verify all pages, images, and links after transfer. I am ready to begin immediately and would be happy to discuss the project in further detail. Thanks, Teo
$200 USD in 2 days
6.5
6.5

Hello! I will create a PHP script to scrape data you need Please provide the details I have extensive experience in writing PHP scripts for data scraping Please see my reviews for reference.
$300 USD in 3 days
6.7
6.7

Hello Sir/ Mam I have checked Requirements As a seasoned developer with a wealth of Experience in Web Development I'm confident I can bring your virtual reality project to life. My track record as demonstrated in my 100% job completion and 5-star review rating showcases My ability to deliver exceptional results on time and with utmost quality I believe that my skill set makes me the ideal candidate for this project Please come on chat we will discuss more about this I will be waiting for your reply . Thank you !
$140 USD in 2 days
6.4
6.4

Hi, I’ve read your Comprehensive Website Scraping Delivery project and I’m confident I can build a reliable crawler that captures every internal page, pulls all text and embedded images, and records direct URLs while preserving the original page structure for migration to your destination site. I’ll use a robust Python stack with Scrapy or BeautifulSoup to crawl, and I’ll implement a clean mapping of URL → new location to ensure links, headings, and image references stay intact, then transfer data via REST or a CMS API for seamless migration, aiming for a reproducible script that you can run again if needed. I have several years of experience handling similar projects, including preserving hierarchy and assets during migrations, and I’ll tailor the workflow to your target site and destination system following your requirements. I propose delivering a reproducible crawler project, a complete text and image migration, and a URL-to-new-location mapping file, with a clear timeline and validation checks to verify that all public pages are reachable and no links are broken after migration . Best regards,
$155 USD in 7 days
6.4
6.4

Hi! My name is Marjan and I'm here to offer you my services as a skilled applicant with over a decade of experience working on Freelancer.com. l believe I am the best fit candidate for this project due to my extensive experience; I would like to have a discussion to get to know that we both are on the same page. Once the scope will be locked, I will start working on it right away.
$140 USD in 7 days
6.6
6.6

Hi, I am interested in your project because I have strong experience in building scalable web scraping systems and structured data migration pipelines using Python, Scrapy, and BeautifulSoup, which directly matches your requirement for full-site crawling and content transfer. I will develop a robust crawler that recursively maps all internal pages, extracts text, images, and URLs, and preserves the original site hierarchy in a structured data model. The extracted content will then be programmatically migrated into your target website using the most suitable integration method, such as REST API, CMS API, or direct database mapping, ensuring page structure, links, and media references remain fully intact. I will also provide a URL mapping file for verification, along with a reproducible codebase and deployment instructions so the system can be rerun or extended easily. The final delivery will ensure all pages are accessible, content matches source accurately, images load correctly, and no broken links exist after migration. Please contact me to discuss the target platform and begin implementation. Alexander
$200 USD in 7 days
6.8
6.8

Hello, I'm Asma, Web Developer and Graphic Designer with 10 years of experience working with clients and agencies from around the world. Creative problem solver with a passion for creating visually appealing and user-friendly digital solutions. I love building luxurious brands and designing captivating visual identities. I've worked with clients in lifestyle, property, fashion, hospitality, and luxury sectors. 24/7 Support & Faster Response . #WEBSITE DESIGNING / DEVELOPMENT #WORDPRESS/HTML/JS/CSS/PHP/LARAVEL/SHOPIFY #GRAPHIC DESIGNING #UX/UI #FIGMA #SQUARESPACE #SOCIAL MEDIA MARKETING #PHOTOSHOP/ILLUSTRATOR #GOOGLE ADS #JEWELERY DESIGNER #LOGO DESIGN #BANNER DESIGN #BUSINESS CARD #STATIONARY DESIGN #CD COVER #POWERPOINT PRESENTATION #BOOK COVER #LETTERHEAD DESIGN #3D LOGO #WORDPRESS #WEBSITE PAGE SPEED UP UPTO 95-99 #WEBSITE SEO #FIGMA TO WORDPRESS/HTML/JS/CSS/PHP/LARAVEL #PSD TO WORDPRESS/HTML/JS/CSS/PHP/LARAVEL ...... ETC :)
$250 USD in 3 days
6.4
6.4

Hello dear, Greetings from MD. Toriqul Islam! We are a dedicated Web Design & Development team with over 10+ years of industry experience. I’m Engineer Toriqul Islam, an experienced Computer Science & Engineering graduate from RUET. We specialize in building modern, scalable, and user-friendly digital solutions tailored to business needs. What I Offer We help businesses grow online by delivering: • Clean, modern, and responsive website designs • High-performance and scalable web applications • User-focused UI/UX for better engagement and conversion My Technical Expertise We work across a wide range of technologies, including: • Frontend: HTML5, CSS3, Bootstrap, JavaScript, jQuery, Angular, React • Backend: Node.js, PHP, Laravel, .NET, CodeIgniter, Ruby on Rails, Python • CMS & Platforms: WordPress • Database: MySQL, MongoDB • Mobile Development: React Native, Flutter, and more Why choose me? ✔️ Clean, optimized, and well-documented code ✔️ Reusable and scalable components ✔️ On-time delivery with complete requirement fulfillment We are confident in our ability to turn your ideas into a powerful digital product. Let’s discuss your project and make it a success. Looking forward to working with you! Best Regards, Md. Toriqul Islam
$45 USD in 2 days
6.2
6.2

Manama, Bahrain
Payment method verified
Member since Oct 9, 2024
$10-30 USD
$10-30 USD
£250-750 GBP
₹1500-12500 INR
£750-1500 GBP
₹1500-12500 INR
$30-250 USD
£20-250 GBP
$250-750 NZD
$10-30 USD
₹12500-37500 INR
$30-250 USD
€750-1500 EUR
₹600-1500 INR
$30-250 USD
$250-750 USD
$30-250 USD
₹600-1500 INR
$30-250 USD
€30-250 EUR
₹12500-37500 INR
₹600-1500 INR