Daily Trending Products Detection Program

Encerrado Postado há 3 meses Pago na entrega
Encerrado Pago na entrega

The goal of this project is to develop a program that can identify trending products on a daily basis from specific e-commerce websites (the list will be provided later). The program should retrieve relevant product data, analyze it to identify trending products, and then output the results in a useful and structured format.

**Key Responsibilities**:

1. **Data Acquisition**: You are responsible for developing a system that retrieves product data from the provided list of e-commerce websites. This may involve web scraping or API integration, depending on what each platform allows and provides. Python, with libraries such as BeautifulSoup and requests for web scraping, or requests alone for API integration, is our preferred language for this task.

2. **Data Analysis**: The program should analyze the retrieved data to identify trending products. A product's trendiness can be determined by factors such as a high number of recent sales, a spike in social media mentions, or a rapid climb in the sales rank. Tools like pandas, NumPy, or SciPy in Python can be used for this task.

3. **Automation**: This entire process needs to run automatically on a daily basis. Depending on the deployment environment, this can be accomplished by setting up a cron job, using a task scheduler, or other methods.

4. **Output**: The program should output the results in a clear and structured format. This should be a CSV file, a JSON file, and a database.

5. **Error Handling and Logging**: It's crucial to handle potential errors gracefully so the program can recover or, at the very least, log the error for troubleshooting. Logging mechanisms need to be implemented throughout the program.

**Required Skills**:

1. Python programming

2. Familiarity with web scraping libraries such as BeautifulSoup, Scrapy, etc.

3. Experience with API integration

4. Data analysis and manipulation with pandas, NumPy, or similar libraries

5. Task automation and scheduling

6. Logging and error handling

7. Familiarity with JSON, CSV, or databases for data storage and output


1. Source code of the program.

2. Documentation detailing how to run, maintain, and troubleshoot the program. The documentation should also describe the data flow, and explain the logic behind how trending products are determined.

3. A sample output of the program.

**Additional Notes**:

1. All web scraping should respect the target website's terms of service and [login to view URL] files, and comply with all relevant laws and regulations.

2. While developing, always consider the load you're putting on the target websites and design your program in such a way that it minimizes the potential disruption.

3. Ensure the program is designed with scalability and maintainability in mind.

4. Communication is key. Regular progress updates are expected.

Extração de Dados PHP Python Arquitetura de software Captura de dados na web

ID do Projeto: #36706095

Sobre o projeto

25 propostas Projeto remoto Ativo em há 2 meses

25 freelancers estão ofertando em média $595 nesse trabalho


Hello, Warm Greetings! I am pretty sure I can produce high-quality and perfect results for your project. By using Python, I used to make AI engines, BOT, Web Scraping Tools, and so on. PHP and Python are my majors, so Mais

$750 USD in 7 dias
(196 Comentários)

Hello, With over 10 years of industry experience, I offer expertise in web scraping, Python programming, and data mining. I specialize in efficiently extracting data from websites, automating data collection processes Mais

$900 USD in 10 dias
(76 Comentários)

I'm a senior Python & ML developer and owner & founder of Dedeoglu Dev Company. Kindly send me a message to get in touch with me, Thanks, Yusuf

$500 USD in 7 dias
(26 Comentários)

<<< السلام عليكم >>> I'm sure that I can help you. I'm artificial intelligence engineer experienced in Data Science, Machine/Deep Learning for more 9 years. Feel free to contact me for further details because I am l Mais

$850 USD in 7 dias
(30 Comentários)

Hello there! My name is Ali and I'm a Web Developer, App Developer and Graphic Designerr with 10 years of professional working experience. I understand that you are looking for a program that can identify trending prod Mais

$500 USD in 7 dias
(11 Comentários)

Greetings, I have gone through your project description. I find myself as a perfect fit for this job. I am working as a Python Developer from last 2 year. Some of my expertise is in the fields: 1. Web Scraping/Web Au Mais

$250 USD in 2 dias
(74 Comentários)

Hi, i have already worked on similar jobs. using python scrapy and/or selenium, i will develop a bot that would go through the eCommerce websites collecting products with relative data to help us determine the trendi Mais

$450 USD in 5 dias
(16 Comentários)

Hi there! My name is Salman ullah, and I'm a freelance developer with expertise in Python, machine learning, and Django. I've worked on a wide variety of projects throughout my career, which has given me firsthand expe Mais

$500 USD in 7 dias
(7 Comentários)

Results-oriented, meticulous and innovative and experienced Web, software developer and automation engineer with expertise in systems analysis, Web site design, and application integration. Ability to increase reliabi Mais

$500 USD in 25 dias
(15 Comentários)

I understand you are looking for a program that can identify trending products on a daily basis from specific e-commerce websites. Python with the libraries such as BeautifulSoup and Requests would be my best choice fo Mais

$300 USD in 2 dias
(3 Comentários)

Hello, sir! I'm a python(Django, Flask) development expert with 8+ years experience and I'm very familiar with web scraping and data mining using BS4, selenium, Data Scraping, Data Entry and undetectable chrome driver Mais

$500 USD in 7 dias
(3 Comentários)

Hi Mate, Surely I can help you in creating a program that will identify trending products on a daily basis from specific e-commerce websites. The program will retrieve all relevant product data, analyze it to identif Mais

$500 USD in 7 dias
(1 Comentário)

Experienced freelancer in SolidWorks, logo design, programming, and scriptwriting. I offer expertise in these areas and deliver high-quality results. Let's work together to bring your project to life. Contact me now! # Mais

$250 USD in 2 dias
(0 Comentários)

Hello there! My name is Bala Niranchan, and I'm a data science specialist with a strong background in Python, machine learning algorithms, deep learning algorithms, statistics, data analytics, natural language processi Mais

$500 USD in 7 dias
(0 Comentários)

Hello, my name is Soham and I am an accomplished data analyst with 4 years of experience in the field. I specialize in transforming raw data into valuable insights that drive strategic decision-making. As a part of my Mais

$300 USD in 7 dias
(0 Comentários)