Python- Loops, data, csv
Orçamento $10-30 USD
Scenario: Website has 100 categories, and roughly 50 amount of pages in each category. On each page, I'll be taking names. I have already created a working system that gets users from the first page, I need help with looping it to the next page, and than the next category when pages are ended for that category. From there to save all names to a .csv file column. Than we can remove the duplicates.
======================================================
category = 1
page = 1
web = ("wget [url removed, login to view]" + category + page)
output = [url removed, login to view](web)
names = [url removed, login to view]('name=')[1:]
for i in names:
print([url removed, login to view]('">')[0])
if [url removed, login to view]("[url removed, login to view]") == -1:
print "Set loop to go to next page"
else:
print "End of category pages, continue to next category.."
========================================================
^sample code, will not work as is but gives you a great idea.
Need someone who is proficient in python. If you can multi thread this be faster, let me know also.
22 freelancers estão ofertando em média $34 para este trabalho
I can create fast and efficient threaded Python spider for you. Just give me target site URL and output you want. Thanks. Roman
can loop through pages , and can make multithreaded version either. But I have to look what you have there already, and check out target website for this tas.
hello I have read your requirement. I can help you to finish this work. Can you provide more information about this project? Thank you
i am post doc research my research area is about computer vision and robotics, I am expert on python, i have many academic papers about it. you can check my google scholar page here is [url removed, login to view] Mais
Hey We are a team of Technical Developers and have got expertise in such stuff. Ping me if you are looking for a quick resolution
Hey there, I am willing to work on this project. More discussions over chat. "I can start work right away." Thanks for looking forward to my proposal.
i have already worked for multithreaded content fetch from the websites. The application will provide an easy interface for the project holder
I can give it a try. I like to do this type of work. And I will also try to optimize the solution for you....
Hi I am Zubair, expert in web scrapping, Data mining, and web research. I have gone through your project and I am interested in your project. We can have a detailed discussion on the project over chat… Thanks and Rega Mais
Dear Sir/Madam, Confident in this project. I am experienced in Python and i have a lot experience for parsing data into excel spreadsheet. Thanks,
sir i worked on many python assignments and projects i can do this task easily if you hire me please. thanks hi7