Python web scraping and analysis with scrapy trabalhos

...will have experience with building templates for dashboards, organizing data, generating reports, and analyzing various types of data including sales, financial, customer, and inventory data. Key Requirements: - Experience in building templates for dashboards is a must. - Adept at organizing and analyzing complex sets of data. - Ability to translate data into clear and visually appealing reports. - Proficiency in working with various types of data, including sales, financial, customer, and inventory data. - Understanding of creating customizable templates in Excel. - A keen eye for design with a focus on clean and simple layouts would be appreciated. The project involves enhancing existing templates and providing su...

...innovative AI/ML system with distinct functionalities. Ideal skills should include: • Extensive experience with AI/ML models. • Known for providing solutions with Natural Language Processing (NLP) capabilities, recommendation systems, data analysis, and data visualization. • Proficiency with QR, WhatsApp, LLM, DB, managing user profiles, cataloguing orders, generating recommendations, and facilitating payment systems. 1. Implement a QR code as the entry point for users to access WhatsApp chat. 2. Utilize WhatsApp APIs to initiate chat sessions. 3. Employ Language Model (LM) capable of Hindi, English, and Hinglish for conversational interactions. 4. Integrate LM with backend logic for CRUD operations on a D...

I need a Python code to perform data analysis on text data sourced from tables. This project emphasizes the importance of being highly familiar with Python and its data analysis and text processing libraries. Key tasks: - Extract text data from tables - Perform comprehensive text data analysis Ideal skills: - Proficient in Python - Extensive experience with data analysis and text processing libraries - Familiarity with table data extraction - Strong understanding of text data analysis techniques and methodologies. I look forward to hearing from experts in Python data analysis. This is a chance to demonstrate your ability to solve complex data processes.

I'm in need of a professional with expertise in SEO and Social Media Marketing to help optimize my website and increase its online sales. Key Responsibilities: - Implementing effective SEO strategies to boost website visibility and traffic - Crafting compelling social media campaigns to enhance our online presence - Conducting regular analysis and reporting on digital marketing efforts, identifying areas for improvement As for the website: - The website should be built on WordPress, so proficiency in this platform is crucial - The main goal of the website is to increase online sales, so a strong understanding of e-commerce best practices is important Skills and Experience: - Proven track record in SEO and Social Media Marketin...

...Ads PPC agency focused on driving conversions through creating, managing, optimizing campaigns with primary goal of boosting sales for our client. We are targeting mostly US audience and potentially other English speaking audiences. I am seeking an expert in Google Ads Pay Per Click (PPC) to create, manage, and optimize a campaign with my primary goal of boosting sales. Our clients primarily own businesses that fall under construction niches (B2C) with rather high paying clients - so it would be best if you already have experience in that kind of market. Key responsibilities include: - Keyword research and selection - Ad creation and optimization - PPC bid management and ROI tracking - Analysis and reporting - Cra...

I'm in search of a versatile ...versatile full stack developer to assist in the completion of a project. Although I have not set specific tasks, I'm looking for someone who can handle both front-end and back-end development tasks, as well as database management. The ideal candidate should have a strong background in all the skills required for full stack development. The project will involve creating a website or building a web application, and possibly require some mobile app elements. Key skills and experience required include: - Proficient in JavaScript, Python, and/or Ruby - Ability to handle both front-end and back-end development - Experience with database management - Strong problem-solving skills. If you'r...

I'm in need of a skilled data entry f...need of a skilled data entry freelancer who can assist me in extracting and entering mixed data from various online sources. Your support in this task will be crucial for my data analysis project. Key responsibilities include: - Extracting mixed data from a range of different online sources. - Accurate and careful data entry to ensure quality and reliability. - Following specific guidelines to categorize and structure the data. The ideal candidate should have: - Proven experience with data entry and data analysis. - Familiarity with handling mixed data types. - Strong attention to detail and accuracy. - Excellent time management and ability to meet deadlines. Your as...

...need a web scraping expert to scrape Title, Price, star ratings, delivery window from a specific e-commerce site on a regular basis. - The scraping should cover a range of products, ideally with the ability to specify categories for tracking. - The data needs to be scraped frequently, so automation and scheduling will be crucial. - It's important that the extracted data is accurate and up-to-date as this will be used to inform pricing strategies and customer service. The ideal freelancer for this project should have: - Proficient experience in web scraping, particularly from E-commerce sites. - Proficiency in programming languages like Python or R for automation. - Good understanding of data management and...

I'm seeking a skilled Python developer proficient in Selenium or other scraping tools, AI and others API integration. The main tasks in this project include: - Integrating APIs: You'll be responsible for seamlessly integrating the following APIs: - Send/reveive data from trained AI - Collect data using scraping - Payment Gateway - Other websites: API to integrate with other websites - Developing B2B Features: We're looking to expand our platform to cater for B2B transactions. Your role will be to create and incorporate features that facilitate B2B interactions. Key skills and experience required: - Proficient in Python - Experienced with Selenium or other scraping tools - Proven track rec...

I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.

I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.

I am currently looking for a skilled Python developer who can assist with an API integration project. The tasks to be completed will primarily involve: - API Integration: The key responsibility will be to integrate the Google Maps API into our system. - Location Tracking: The primary functionality we require from the Google Maps API is location tracking. This will be a key component of the project. Ideal candidates should have: - Proficiency in Python: A strong understanding of Python programming is essential for this role, as the primary development language will be Python. - API Integration Experience: Experience with integrating APIs, particularly the Google Maps API, would be a significant advantage. - Familiarity with Location Trackin...

...need of a proficient technical writer with a sound understanding of artificial intelligence. The task at hand is to develop a comprehensive research report that delves into the current trends within the AI landscape. This report should be tailored for an audience of industry professionals. Key Points: - The report should provide an in-depth analysis of the current trends within the field of artificial intelligence - The language and content should be suitable for an audience of industry professionals, meaning that a certain level of technical understanding can be assumed - The report should be well-structured, engaging, and present complex information in a clear and concise manner Ideal Skills and Experience: - Proven experience in technical r...

Max Budget is $50. PLEASE READ CAREFULLY. I'm currently in a bit of a tight spot. A web application was recently developed and installed by a non-professional freelancer. Unfortunately, after less than a week, the system has stopped working. In light of this, I am seeking a highly skilled professional to help me debug and rectify the problems at hand. My company's WINDOWS SERVER 2016 OR HIGHER BASED system, , is designed for data analysis and reporting. The system was set up less than a month ago and was functioning as expected. However, 10 days ago, it suddenly stopped loading properly, without any changes being made to it or its environment. I have working copies of the site and desktop versions that I can upload. The appli...

I am seeking a Machine Learning engineer with proficiency in Python. You should be able to apply your skills to solve a classification problem with a text dataset. Key Responsibilities: - Develop and implement a suitable ML model for the text classification problem - Conduct detailed data analysis and preprocessing Ideal Skills & Experience: - Extensive Python programming experience - Wide understanding and experience in Machine Learning, specifically in classification problems - Experience in working with text datasets - Familiarity with popular Python libraries used in ML such as scikit-learn, pandas, and numpy If you have a strong grasp of Machine Learning techniques, particularly in text cl...

I'm in need of an expert to analyze our Joomla...I'm concerned whether this is genuine or bot-generated. This is a high-priority task for me, and I need immediate action. Key Tasks: - Verify if the current traffic is genuine or bot-generated - Implement necessary security measures to prevent future bot traffic - Restore the website online and ensure it can handle an increased traffic load Ideal Freelancer: - Proficient in Joomla and its security features - Experienced in analyzing web traffic and differentiating bot-generated traffic from genuine - Familiar with implementing security measures to protect websites from bot attacks - Available to tackle this issue urgently If you're confident in your abilities to address these requir...

Our SaaS site () is getting a bit old. We need an experienced designer/front-end developer to completely freshen it up,We operate in the Web Scraping industry and would like our new site to stands out w.r.t. competition. We want a site that's easy on the eyes and presents our product offering better than how it is currently presented. Requirements =========== . New home page should have a section for testimonials/clients and a section for awards/review badges. . Each product (currently scrape and extract) have their dedicated page. Their illustrations need to be redone and the scrape page should have some icons/illustrations on top of each "Applications" box. . We need a new nav menu item for "Resources". The site...

...various sources. The ideal freelancer should be well-versed in web scraping, especially from websites, social media platforms such as LinkedIn, publications, and news sites. This will help in gathering relevant data for building a recommendation system. Key requirements include: - Proficiency in data scraping from multiple sources - Ability to effectively scrape data from websites, social media platforms like LinkedIn, and news sites - Experience with handling and storing data in a database - Understanding of how to structure and manage data for machine learning purposes Your task will be to gather the data and store it in a database for further analysis. Having a solid background in data handling, artifici...

I am looking for a expert statistician experienced in JASP software and predictive modeling. My project requires: - Comprehensive data analysis - Development of statistical models Your key tasks will be data interpretation, model creation, and generation of reports based on your findings. Ideal freelancers would have extensive experience in JASP, a clear understanding of statistical modeling and data analysis, and prior exposure to projects involving predictive modeling. My primary goal is to effectively utilize predictive modeling to drive strategic decisions. Your expertise will contribute substantially toward this goal.

...assist with a range of tasks primarily centered around Excel and Word. - Excel: The emphasis will be on crafting sophisticated formulas and performing financial projections. I need someone with an understanding of finance and the ability to manipulate data in Excel. A depth of knowledge in Excel formulas, calculations, and data analysis is crucial. - Word & PDF: Apart from Excel work, there is a need for expert formatting and layout design skills in Word, as well as converting Word documents to PDF format. Finally, I am seeking someone who can apply a professional design to a CV. The style I want to embody is professional, and therefore a good understanding of professional layout design and typography will b...

I'm seeking a proficient statistician to help me with a data analysis project. Specifically, I have a set of sales data that I need to be analyzed for the purpose of identifying trends. The main goal of this project is to discover any patterns or trends present within the sales data, which could potentially inform our future strategies and decision-making.

...to assist with data entry and the organization of several Excel spreadsheets. Your primary task will involve entering data from various not-specified sources into Excel, as well as categorizing and structuring this data in a logical and efficient manner. Desirable Skills & Experience Required: - Mastery of Excel functions and formatting features - Strong attention to detail and accuracy - Proven experience in data entry - Ability to work with limited supervision - Data analysis and detection of irregularities is considered a plus. The task doesn't necessarily require prior relevant experience but being familiar with Excel and data structuring principles would be advantageous. Due to the nature o...

...for a professional who can help me with two specific aspects of my project: performing advanced data analysis and creating macros to automate repetitive tasks. Key Requirements: - Data Analysis: You should be well-versed in data visualization, statistical analysis, and data cleaning and manipulation. Your ability to extract insights from complex data sets and present them clearly is crucial. - Macro Development: You will be responsible for automating repetitive tasks in Excel, including generating reports, automating data entry, and creating efficient formula calculations. Your macros should be user-friendly and easy to maintain. Ideal Skills: - Proficiency in Excel, including advanced functions and VBA prog...

Por favor, Cadastre-se ou Faça Login para ver os detalhes.

I'm seeking a Python developer who's proficient in web scraping to help me extract data from social media platforms. Key Responsibilities: - Develop and implement a Python script for web scraping data from social media channels. Deliverable: - The scraped data should be compiled and delivered in an Excel spreadsheet for further analysis. Ideal Candidate: - Proficient in Python with a strong background in web scraping techniques. - Prior experience in scraping data from social media platforms will be a big plus. - Ability to deliver the end results in an organized, neat and easily accessible format, such as an Excel spreadsheet. Please reach out if you think you'...

I'm urgently in need of a highly skilled programmer who has proficiency in Python, Java, and C++. Key skills and experiences will be: - Proficient in Python, Java, C++ - Strong problem-solving skills - Ability to work under pressure and adhere to tight deadlines - Previous experience in general programming, specific project genre unspecified Due to the urgent nature of this project, I'd appreciate it if interested freelancers could contact me immediately.

I'd like to extract the phone numbers of real estate agents from a particular website Key Requirements: - Extract agent contact information Ideal Skills and Experience: - Proficiency in web scraping - Experience with data extraction and automation - Strong understanding of data privacy laws and regulations Please note that the data is intended for internal use only and will not be shared with any third-parties.

I need a talented web designer with expertise in APIs, data scraping, and AI to help me build a professional portfolio website. - Design: The designer needs to create an engaging and visually appealing layout for the website, considering it's targeted at professionals. - Integration: I require the integration of API functionalities into the website. - Data Scraping: The designer should implement data scraping. - AI /ML Features: The website will also need AI-based features. The primary goal of the website is to serve as a showcase for my work. It’s important that the design is not only aesthetic but also functional, user-friendly, and professional. I am looking for someone who can bring a high level of creativity, tech...

...trading application for my company. This app needs to be compatible with both Android and iOS. Key Functions: - Real-time Market Data: The application should provide up-to-the-second market data to users. - Trading Orders: Users must be able to place buy and sell orders directly from the app. - Portfolio Management: A feature for tracking and managing their investment portfolios. - Research and Analysis Tools: The app should include tools that allow users to conduct in-depth research and analysis. - Watchlist: Users should be able to create and manage watchlists of stocks or other financial instruments. - Position Calculator: A tool for calculating the position size for a given trade. Ideal Skills: - Proficiency in Android...

I'm looking to implement an OCR system that can read and extract characters from digital/Mechanical meters. The purpose of this OCR system is to process images captured by cameras in real-time. The OCR system will be used for analyzing the data extracted from the digital meters, so a high level of accuracy is required. Key Requirements: - Develop an OCR feature that can accurately read and extract characters from digital meters - Implement the system to process images captured by cameras in real-time Ideal Skills and Experience: - Strong background in OCR technology, python, Tesseract, customized ocr readers, particularly with processing images from cameras - Experience in developing systems for specific industrial use cases is a plus elec...

We are looking for a web designer who has minimum 3 years of experience in Full Stack Development. Tech for backend can be python/node.js and for frontend react.js. We have the UI for what we want to build, we need backend and frontend to be developed for the same. Our website is a marketplace, where publishers can register and add their offerings and advertiser can purchase it and place orders, admin panel UI is also available. You should know how to follow structured approach and keeping scalability in mind.

...experienced mechanical engineer specializing in thermal analysis and simulation to work on a project related to Li-ion batteries. I have already done some work. I don't know about battery modeling on ANSYS Fluent. I am trying to mimic TR using a thermal model. The geometry and the parameters are taken from the research paper (the research paper is attached). I propagated TR using a user-defined function (UDF) on ANSYS Fluent, but I couldn't get a higher cell temperature than the one mentioned in the paper. The UDF contains the data points and Time extrapolated from the research paper (Fig. 5). The heat generation is calculated using q''' = rho*Cp*dT/dt. (The work should be done on ANSYS Fluent). Key Tasks: - Conduct detailed ther...

Accounting, stock control Integrate AI for generate content for marketing. All develop in python. Able to run at aws Propose your timeline and price.

...developer who can create a functional scraping tool for me. The purpose of this tool is to download JPEG product images from a specified URL that increments numerically. Key Requirements: - Scrape images from a continuously changing URL (i.e., www.****/asdasd/1234 then 1235, and so on). - Ability to tweak URL structure according to my needs. - Images must be saved in JPEG format. The ideal candidate for this task: - Has experience in web scraping and dealing with dynamic URLs. - Understands how to name files after the URL page number. Please note that the key goal is to download product images, not data extraction or process automation. Hence, your proposal should focus on delivering this specific requirement. Your understanding of this pr...

...in SQL and R programming for a detailed data analysis project. This project involves extracting, analyzing, and reporting on data from a sophisticated relational database setup. The ideal candidate should have a solid background in data science, with specific skills in SQL and R. Responsibilities: Efficiently query and manage data using SQL from a SQLite3 database. Apply R programming techniques for advanced data cleaning, analysis, and visualization tasks. Ensure data integrity and optimize data processing workflows. Analyze results to derive actionable insights and compile detailed reports. Document all processes and code in a clear and comprehensive manner. Requirements: Profound knowledge of SQL ...

I'm looking for a developer who can update the Godiva viewer to be compatible with the Copernicus WTMS service. Your objectives are: - Updating the viewer to access and display data from the Copernicus WTMS service - Enhancing its functionality to better display Copernicus data Key Features Needed: - Interactive time-series analysis, for better data interpretation - Dynamic layer ordering, to enrich data visualization The ideal freelancer for this project is one who is proficient in the WTMS system, has a good grasp of Godiva viewer operation, and can provide these specific updates. An understanding of the functions and usage of a geospatial portal viewer is a plus. You should also be a creative thinker, with an eye for improving inte...

Here's a paraphrase of the summaries for the tasks: **Extracting data from images (Task 1a):** * You'll need ...the features you extracted in Task 1, you'll train different machine learning models for a client. * The client has collected soil samples, and you can potentially combine their data with yours to improve the model's accuracy for their specific property. **Evaluating model accuracy (Task 2b):** * You'll need to assess how well the models you trained in Task 2a perform on the client's data. * This involves choosing appropriate metrics to measure accuracy and comparing the different approaches you used. * Based on the results, you'll decide which model performed best for the client's property. * This information will...

...project should be able to: - Perform data analysis: This includes understanding, interpreting, and presenting data to inform decision-making. - Manage data integration: The candidate should be capable of combining data from various sources to create a cohesive dataset. - Develop data visualization: The engineers will need to create meaningful and understandable visual representations of the analyzed data. The necessary skills for this role are: - Proficient in Python: The candidate should be well-versed in Python programming language to work with our system. - Knowledge of Hadoop: Experience with Hadoop is a must for this position to handle the data integration and data storage tasks. - Knowledge of Kafka Prior experience in big ...

...backend to facilitate real-time analysis. Key Project Requirements: - **AI Model Development**: An accurate bone fracture detection model should be developed using Python and TensorFlow. The primary goal of the model is to ensure precision in diagnosing fractures from X-ray images. You can use any datasets available online for free. Model should be able to predict the fracture, body part, highlight the fracture part, - **User Interface**: The UI should be designed to offer an intermediate level of interactivity. This includes incorporating some interactive elements like progress bars to enhance user experience. Use HTML, CSS, Javascript for this. Ideal Skills and Experience: - Proficiency in Python and TensorFlow, with demonstrabl...

I'm looking to hire a freelancer to provide a political analysis on former Secretary of State, John Kerry. This project requires the ability to conduct research and have a strong understanding of political discourse. The analysis should be pro-Kerry, and of sufficient length to allow for an in-depth examination of John Kerry's political career. Specifically, I would like the analysis to be more than 2000 words in length. As a client, I need assurance that the analysis will be professionally done and adhere to standards of academic integrity.

...The primary issue revolves around frequent errors that are hindering its stability and functionality. - The backend is primarily developed using a mix of Python, Java and Node.js. - The main task would be debugging, ensuring all scripts and functions are working as intended. - Additionally, I'm looking for the identification and resolution of any underlying issues that could be causing the frequent errors. - A crucial requirement is the ability to enhance the stability and reliability of the backend, ultimately improving the overall performance of the system. Ideal Skills: - Proficiency in Python, Java, and Node.js - Extensive experience in backend debugging and stabilization - Strong troubleshooting and p...

...have designed a model of a Kamps jet engine and I am now seeking an expert familiar with ANSYS software to simulate its operation. The primary fuels I am interested in are JetA and biodiesel. Understanding the performance of these fuels in relation to thrust, efficiency, fuel consumption, and emissions is of the utmost importance. This will be used for personal reasons. Ideal candidates for this project should have: - Proficient experience with ANSYS software - Understanding of jet engine operations - Knowledge of jet fuels (particularly JetA and biodiesel) The deliverable for this project will be a comprehensive report detailing the simulation results with comparison and analysis on the primary parameters: thrust, effici...

I'm on the lookout for an e...provide precise price estimates to my clientele. Hence, your proficiency in understanding and drafting cost estimates is key here. The quotation format I need should include two specific sections: - Service Description: A well-structured outline underlining the services offered. - Terms of Payment: Details on the payment structure and timeline. The perfect candidate would have excellent financial analysis skills to provide an accurate price estimate and outstanding attention to detail to compose the aforementioned sections. Additionally, prior experience in creating quotations for consultation-centric industries will be a major plus. In essence, I am seeking a person with a keen eye for detail and a substanti...

I'm on the hunt for a skilled...Data Analyst who will work closely with our customer data, primarily formatted in Excel/CSV. The primary goal of this analysis is to identify trends and patterns that could aid our business processes. Key Responsibilities: - Deep analysis of customer data to identify patterns and trends - Create visually engaging and understandable reports Ideal Skills and Experience: - Proven track record as a Data Analyst - Comprehensive understanding of data analysis methodologies - Superior skills in Excel/CSV data processing - Ability to present complex information in an engaging and understandable manner. Your contribution will hugely impact our business decisions. I look forward to viewing your...

I need a professional who's capable of modifying an existing Lua code. The successful candidate should be able to: - Understand and work with existing codes - Add an unincorporated parameter, specifically the 'tool tip radius coefficient,' into the current Lua code - Develop a method for analyzing gear size data to determine the aforementioned parameter Demonstrable experience in working with Lua language and proficiency in data analysis, specifically in gear size data, would be extremely beneficial in executing this task successfully. Strong understanding of gear parameters and a knack for intuitive problem-solving are greatly preferred.

I am seeking a proficient Python programmer who can create a web scraper for Lazada. Key Responsibilities Include: - Develop a Python program that will enter query in search box and scrape Lazada for the following data: product name, images, price, description, seller, and URL. - The scraper should be able to handle pagination plus also bypass captcha using 2captcha api Ideal Skills and Experience: - Proficiency in Python and web scraping frameworks. - Familiarity with the Lazada's web structure and data extraction. - Experience creating scrapers for e-commerce platforms. Website lazada .

...reconciling sales data with weekly remittances over a span of 2.5 years in Excel. This requires merging multiple remittance files into one cohesive dataset, and then cross-referencing the sales data with the remittance data using a unique identifier (e.g., order number). The goal is to ensure that each sale corresponds to an accurate payout in the remittance, identifying any discrepancies or missing payments. Project Tasks: Data Collection: Gather all sales data and remittance files spanning 2.5 years. Ensure each dataset includes a unique identifier (e.g., order number) for matching. Data Merging: Consolidate all remittance files into one master remittance dataset. Arrange the data in a structured format for ease of analysis. Data Reconciliation: ...

I'm seeking a skilled PowerPoint creator for a marketing-focused presentation. The key topics crucial for discussion include an in-depth Company Overview, highlighting our unique selling points; comprehensive Product Specifics, demonstrating the key features and benefits of our products; and a detail-oriented Market Analysis. A deep understanding of marketing strategy and visual storytelling is necessary for enhancing the appeal and impact of this presentation. Time is of the essence, and I need this project completed ASAP. Referral : Need to create PPT for Starwalk from ISON Presentation

...instructions from a Confidential Information Memorandum (CIM). Key project requirements: - Basic assumptions and financial projections: Your model should include detailed financial projections based on the provided assumptions. - Operating model and capital structure: You will need to build a comprehensive operating model, and structure the capital in line with the LBO requirements. - Sensitivity and scenario analysis: I expect you to provide a detailed sensitivity and scenario analysis that is easy to interpret. - I have a CIM and a template excel sheet that you can use to create the model. I have other instructions as well in which I will provide after you bid. Time is of the essence, and I need this completed wit...

I'm seeking a proficient data scientist with a specialization in unstructured data (e.g., text, images) for a project focused on data analysis. Key Responsibilities: - The primary goal of this project is to perform in-depth data analysis on unstructured data. - You will be required to identify patterns, trends, and insights within this data set. - The data analysis should be thorough and aim to provide actionable results. Ideal Candidate: - Strong background in data science and particularly, in working with unstructured data. - Experience in data analysis, with the ability to find and interpret patterns. - Proficient in using relevant tools and software to analyze unstructured data. - Strong analyti...