Collect all reddit topics and comments for a specific subreddit

$250-750 USD

Concluído

Publicado

há quase 8 anos

$250-750 USD

Pago na entrega

Hi, Looking for someone to write a piece of software that will fetch all reddit posts and comments for a subreddit from the year 2015. Please take the reddit API limits into account and find a workaround for that. Return format for each topic should be a python dict. Comments are stored nested in the post dict: posts = {{'author': {'username': redditusername, 'timestamp':timestamp, 'url': topicurl 'topictext':text, 'comments': {{'comment': text, 'timestamp': timestamp, 'author': {'username': redditusername, 'profileurl': url}, {comment2 etc..}} }, second post here ... } Output stored to a text file. Looking to get this done ASAP. Get in touch to discuss details.

Data Processing

Python

Software Architecture

Web Scraping

ID do Projeto: 10606322

Sobre o projeto

11 propostas

Projeto remoto

Ativo há 8 anos

Quer ganhar algum dinheiro?

Endereço de e-mail

Benefícios de ofertar no Freelancer

Defina seu orçamento e seu prazo

Seja pago pelo seu trabalho

Descreva sua proposta

É grátis para se inscrever e fazer ofertas em trabalhos

Concedido a:

@akprj

Hello Final year CS undergrad at IIT Bombay. Had done a similar crawler project for codechef and stackoverflow a couple of months ago using bs4 and python. Can do this in a few hours. Looking forward to work on this. Ping me if interested. Regards, Aditya

$250 USD em 1 dia

5,0

(3 avaliações)

3,1

11 freelancers estão ofertando em média $342 USD for esse trabalho

@e3d

Hi, I can scrape those from reddit with no problem but to properly estimate this project I need to know which subreddit you're talking about.

$263 USD em 3 dias

5,0

(268 avaliações)

8,7

@mananraja

Hi there, I have read the project & would like to discuss.. I can scrape data from website using custom made scripts in Python.. I have good web scraping reviews as well.. I have experience with APIs as well as like Google Facebook Twitter. etc Hope to hear from you..

$250 USD em 1 dia

5,0

(171 avaliações)

6,4

@mwarrenschultz

Hello! I can get around Reddit's API limit by avoiding the API altogether, and interfacing instead directly through the browser using Selenium. I am a professional programmer with many years of web scraping experience using Python. I have written Selenium based projects many times before, and I would be happy to show examples. Please contact me so we may speak further and so I can send files. Thank you for your consideration.

$444 USD em 10 dias

4,9

(69 avaliações)

6,5

@DhvanitAkbari

Hello, I am a computer engineer, I have experience in web scrapping using python so we can chat further to discuss project. Thanks

$500 USD em 2 dias

5,0

(19 avaliações)

3,9

@Fonseca25T

hello, I can automate this tasks considering the Reddit api limitations. This will be up the amount of post the subreddit would have and all the comments too. For example, if the api limitations will reach the top in an specific range of time, I will subscribe a new task to get the next batch of posts the next day, this loop will be finished once the script reach the current timestamp and the I will mail to you the ouput.

$500 USD em 15 dias

5,0

(1 avaliação)

1,6

@tonygiorgi

Hello, I am currently building my own software and am in need of work to help supplement the costs of building my own business. I am a graduate of UC Berkeley with a breadth of professional experience as a product manager, VP of Customer Success and sales representative. I know that I am more than capable of handling this task and could have the results to you within 24 hours. I would really appreciate the opportunity to take on this project. Starting my business requires a great deal of hard work and funding, and small jobs like this help keep me going. Regards, Tony

$277 USD em 5 dias