Em Andamento

Web Crawler for YouTube Videos

I am doing a measurement study.

A web-crawler is needed to be designed to collect data from YouTube.

Then I will do some simple analysis to observe the relationship of the data in a social network aspect.

(e.g. people in US like watching NBA games while those in UK like football, girls like cosmetics and boys like sports) << some kind like this

So, I need a web crawler that can crawl information like:

-ID

-Uploader

-Date Added

-Category

-No. of Views

-Rating

-No. of Ratings

-No. of Comments

-Related Videos

-etc

I think the above meta-data can be extracted from YouTube API and some of these are needed to scrape from the video's webpage.

Also, the crawler needs to retrieves information on YouTube users such as their personal information(nationality, gender, age, etc for relationship analysis),the number of uploaded videos and friends of each user from the YouTube API.

I wish the web crawler should run by breath first search.

I wish the crawling activitity will operate regularly say 5 days.

I wish the crawler can update the statistics of previously found videos to study the growth trend of the video popularity. (only retrieve the no. of views, ratings and comments as well as the rating for relatively new videos)

I wish a [url removed, login to view] will be generated after each crawl indicating the start and finish time, depth of the crawl and correspoding [url removed, login to view] videos and time used for each depth of crawling.

As this is a personal study and not for commercial, I do not expect to pay much on the crawler.

Habilidades: Algoritmo, Programação C#, Microsoft Access, SQL, YouTube

Ver mais: youtube crawler, youtube web crawler, web crawler youtube videos, web crawler youtube, web crawler video, web crawler videos, crawler youtube, web crawler api, youtube videos web crawler, web crawl youtube, crawling youtube videos, crawler youtube video views, youtube videos crawler, youtube videos comments crawler, youtube video crawler, crawler video, video web crawler, web crawler used youtube, crawler search video, crawl youtube, youtube data api crawl, youtube video rating, web video commercial, web trend, web-crawler

Acerca do Empregador:
( 0 comentários ) hk, Hong Kong

ID do Projeto: #581548

Premiar a:

endesign

Please see PMB.

$40 USD em 1 dia
(0 Avaliações)
0.0

4 freelancers estão ofertando em média $123 para este trabalho

VirtuosoIT

Hi, I have already written youtube crawler. With some modifications, I can give it to you. Please check PMB. Thanks, Yogesh

$100 USD in 5 dias
(7 Comentários)
3.8
rajtuhin5

please check PMB.

$250 USD in 5 dias
(0 Comentários)
0.0
uongthiduc

Ready to do this work.

$100 USD in 5 dias
(1 Comentário)
0.0