Em Andamento

Python- Loops, data, csv

Scenario: Website has 100 categories, and roughly 50 amount of pages in each category. On each page, I'll be taking names. I have already created a working system that gets users from the first page, I need help with looping it to the next page, and than the next category when pages are ended for that category. From there to save all names to a .csv file column. Than we can remove the duplicates.

======================================================

category = 1

page = 1

web = ("wget [url removed, login to view]" + category + page)

output = [url removed, login to view](web)

names = [url removed, login to view]('name=')[1:]

for i in names:

print([url removed, login to view]('">')[0])

if [url removed, login to view]("[url removed, login to view]") == -1:

print "Set loop to go to next page"

else:

print "End of category pages, continue to next category.."

========================================================

^sample code, will not work as is but gives you a great idea.

Need someone who is proficient in python. If you can multi thread this be faster, let me know also.

Habilidades: Linux, Python

Ver mais: python programming loops, python csv data processing, mysql update csv data, csv data feed creator, import yellowpage csv data, csv data compiler, csv data capture, csv data dating profiles, convert php python, modules python, python system programming, python client google apps, python twisted ldap, python hmi, stock control python, email feedback loops, python sso, python google apps, bid python programming projects, monthly salaries python developer, python download email attachments

Acerca do Empregador:
( 14 comentários ) New Jersey, Canada

ID do Projeto: #14083327

Premiar a:

Acetolyne

Hi I have years of python experience and have done some big projects that require multithreading. I can help you accomplish your goals and get everything working exactly as you want it. If you want to know more about m Mais

$15 USD em 1 dia
(1 Comentário)
0.4

22 freelancers estão ofertando em média $34 para este trabalho

gangabass

I can create fast and efficient threaded Python spider for you. Just give me target site URL and output you want. Thanks. Roman

$55 USD em 1 dia
(119 Comentários)
6.3
$70 USD em 1 dia
(30 Comentários)
5.0
$40 USD em 1 dia
(29 Comentários)
4.7
algispetkuns

can loop through pages , and can make multithreaded version either. But I have to look what you have there already, and check out target website for this tas.

$60 USD em 1 dia
(19 Comentários)
4.5
deaswang

hello I have read your requirement. I can help you to finish this work. Can you provide more information about this project? Thank you

$50 USD em 1 dia
(17 Comentários)
4.6
leemilun

I understand about your requirements. I have 5+ years of Python, PHP programming experience. I think I can do your work perfectly. If you choose me, I will finish it in time and do my best. I will provide you one m Mais

$30 USD em 1 dia
(8 Comentários)
4.1
roboticres

i am post doc research my research area is about computer vision and robotics, I am expert on python, i have many academic papers about it. you can check my google scholar page here is https://scholar.google.fr/cita Mais

$30 USD em 1 dia
(7 Comentários)
3.9
$25 USD em 1 dia
(3 Comentários)
3.8
$25 USD em 1 dia
(16 Comentários)
3.9
MetaoriginLab

Hey We are a team of Technical Developers and have got expertise in such stuff. Ping me if you are looking for a quick resolution

$35 USD em 1 dia
(3 Comentários)
2.2
freelancerelec

Hey there, I am willing to work on this project. More discussions over chat. "I can start work right away." Thanks for looking forward to my proposal.

$34 USD em 1 dia
(2 Comentários)
1.8
usatyarth

i have already worked for multithreaded content fetch from the websites. The application will provide an easy interface for the project holder

$25 USD in 2 dias
(1 Comentário)
0.8
$25 USD em 1 dia
(0 Comentários)
0.0
$25 USD em 1 dia
(0 Comentários)
0.0
$55 USD in 2 dias
(0 Comentários)
0.0
TusharCoder

I can give it a try. I like to do this type of work. And I will also try to optimize the solution for you....

$25 USD em 1 dia
(0 Comentários)
0.0
Zubairashraf123

Hi I am Zubair, expert in web scrapping, Data mining, and web research. I have gone through your project and I am interested in your project. We can have a detailed discussion on the project over chat… Thanks and Rega Mais

$10 USD em 1 dia
(1 Comentário)
0.0
teknogeek

A proposal has not yet been provided

$35 USD in 15 dias
(0 Comentários)
0.0
LancerYang

Dear Sir/Madam, Confident in this project. I am experienced in Python and i have a lot experience for parsing data into excel spreadsheet. Thanks,

$25 USD em 1 dia
(0 Comentários)
0.0
hi7technologies

sir i worked on many python assignments and projects i can do this task easily if you hire me please. thanks hi7

$25 USD em 1 dia
(0 Comentários)
0.0