Python- Loops, data, csv

Encerrado

Descrição

Scenario: Website has 100 categories, and roughly 50 amount of pages in each category. On each page, I'll be taking names. I have already created a working system that gets users from the first page, I need help with looping it to the next page, and than the next category when pages are ended for that category. From there to save all names to a .csv file column. Than we can remove the duplicates.

======================================================

category = 1

page = 1

web = ("wget [url removed, login to view]" + category + page)

output = [url removed, login to view](web)

names = [url removed, login to view]('name=')[1:]

for i in names:

print([url removed, login to view]('">')[0])

if [url removed, login to view]("[url removed, login to view]") == -1:

print "Set loop to go to next page"

else:

print "End of category pages, continue to next category.."

========================================================

^sample code, will not work as is but gives you a great idea.

Need someone who is proficient in python. If you can multi thread this be faster, let me know also.

Habilidades: Linux, Python

Ver mais: python programming loops, python csv data processing, import csv data sql express 2005, mysql update csv data, csv data feed creator, import yellowpage csv data, excel chart provide csv data, csv data feed web page, csv data compiler, create invoice import csv data, csv data capture, website csv data feed reader, mysql read delimited csv data, csv data dating profiles, import csv data sql server table, convert php python, modules python, python system programming, python client google apps, python twisted ldap, python hmi, stock control python, php create table csv data, python parse file database, email feedback loops

ID do Projeto: #14083327

Premiar a:

Acetolyne

Hi I have years of python experience and have done some big projects that require multithreading. I can help you accomplish your goals and get everything working exactly as you want it. If you want to know more about m Mais

$15 USD em 1 dia
(0 Avaliações)
0.0

25 freelancers estão ofertando em média $33 para este trabalho

gangabass

I can create fast and efficient threaded Python spider for you. Just give me target site URL and output you want. Thanks. Roman

$55 USD em 1 dia
(110 Comentários)
6.2
$70 USD em 1 dia
(29 Comentários)
5.0
$40 USD em 1 dia
(29 Comentários)
4.7
deaswang

hello I have read your requirement. I can help you to finish this work. Can you provide more information about this project? Thank you

$50 USD em 1 dia
(14 Comentários)
4.3
$25 USD em 1 dia
(12 Comentários)
3.7
leemilun

I understand about your requirements. I have 5+ years of Python, PHP programming experience. I think I can do your work perfectly. If you choose me, I will finish it in time and do my best. I will provide you one m Mais

$30 USD em 1 dia
(7 Comentários)
3.5
algispetkuns

can loop through pages , and can make multithreaded version either. But I have to look what you have there already, and check out target website for this tas.

$60 USD em 1 dia
(11 Comentários)
3.9
MetaoriginLab

Hey We are a team of Technical Developers and have got expertise in such stuff. Ping me if you are looking for a quick resolution

$35 USD em 1 dia
(3 Comentários)
2.2
$25 USD em 1 dia
(2 Comentários)
1.0
$55 USD in 2 dias
(0 Comentários)
0.0
$25 USD em 1 dia
(0 Comentários)
0.0
teknogeek

A proposal has not yet been provided

$35 USD in 15 dias
(0 Comentários)
0.0
usatyarth

i have already worked for multithreaded content fetch from the websites. The application will provide an easy interface for the project holder

$25 USD in 2 dias
(0 Comentários)
0.0
LancerYang

Dear Sir/Madam, Confident in this project. I am experienced in Python and i have a lot experience for parsing data into excel spreadsheet. Thanks,

$25 USD em 1 dia
(0 Comentários)
0.0
TusharCoder

I can give it a try. I like to do this type of work. And I will also try to optimize the solution for you....

$25 USD em 1 dia
(0 Comentários)
0.0
jamdarvikas

I have 4 years of expereince in python. I have worked in Core Python libaries, python web development. My skill are : Python2.7, Linux,HTML,CSS,Bootstrap,JQuery,REST,GIT,SVN. I would like to hear more from you for t Mais

$25 USD em 1 dia
(0 Comentários)
0.0
freelancerelec

Hey there, I am willing to work on this project. More discussions over chat. "I can start work right away." Thanks for looking forward to my proposal.

$34 USD em 1 dia
(0 Comentários)
0.0
$25 USD em 1 dia
(0 Comentários)
0.0
roboticres

i am post doc research my research area is about computer vision and robotics, I am expert on python, i have many academic papers about it. you can check my google scholar page here is https://scholar.google.fr/cita Mais

$30 USD em 1 dia
(0 Comentários)
0.0
hi7technologies

sir i worked on many python assignments and projects i can do this task easily if you hire me please. thanks hi7

$25 USD em 1 dia
(0 Comentários)
0.0