m-ets.ru scrapper
https://m-ets.ru scrapper. I deciphered the m-ets cipher and created the functions for generating cookies on the fly. The scrapper is asynchronous. It works with Celery. You can monitor tasks with Flower. The scrapper is super effective. It uses only bs4. There is a possibility of using proxy. It scrapes around 110K lots. The total data size is above 10GB. The database record has more than 30 fields. It downloads all files and extracts all periods from a lot page. I used MongoDB database. I attached the example of database record.
About Me
Believes in Trust, Quality and Profit. I'm a Python developer with 3+ years of experience. I'm comfortable with HTML5, CSS5, Flex, Bootstrap. I know the basics of Java and C/C++. I'm actively learning JavaScript and Data Science. Learning something new non-stop. The main services I provide: chat-bot development, web-scrapping, web-development (mainly back-end), machine learning, computer vision, natural language processing, primitive desktop applications development. I'm mainly using such databases technologies: MySQL, PostgreSQL, MongoDB, sqlite3. My core skills: pytelegrambotapi, aiogram, pymysql, psycopg2, pymongo, CherryPy, bs4, Celery, Selenium, scrapy, lxml, aiohttp, requests, furl, re, Flask, Django, scikit-learn, opencv2, PIL, numpy, scipy, pandas, matplotlib, NLTK, PyQt5.
$ 15 USD/hr
NEW FREELANCER!
