Em Andamento

Build a FB Scraper using Macros, PHP cURL or anything else!

** As FB uses Ajax to load its content, it is important that you make sure that you are able to do this job before placing a bid. **

Summary

This project is to build a scraper using macros – ie. iMacros – or PHP Curl’s for Facebook’s Newsfeed (“NF”) ads.

--

Identifying NF Ads

Facebook's NF ads the ones that show between status updates of your friends here: [url removed, login to view] The challenge is, there's several different formats of NF ads as can be seen here: [url removed, login to view] What we're looking to do is identify story/update DIVs that contain the word "Sponsored" - as this is the common attribute among all NF ads. Then extract data from those DIVs only.

Here are a few sample NF ads:

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

We will provide you with the accounts that are display these ads.

--

Logging Into Accounts

When logging in to each account, the macro will need to ensure that the appropriate proxy for each account is used – which we will provide. When switching between accounts, the macro will need to clear all Temporary Internet Files (including Cookies) to ensure that the accounts aren't linked together.

--

Extracting NF Ads

The scraper will need to continue scrolling to the bottom of the page, until it encounters the following messages:

* Old FB Format: "Add your friends to see more of their photos and stories in your news feed."

* New FB Format: "There are no more posts to show right now."

It will then need to identify the DIVs that contain the text "Sponsored" and:

* Identify a unique parameter (to keep track of when it was first seen, last seen, times seen)

* Extract all the content within the DIV

* Click the advertiser's link and record all URL redirects

* Load and save any images displayed within the DIV

* Save which account saw the advertisement

* When the advertisement was first seen

* When the advertisement was last seen - if the same ad has been seen several times

* The number of times the advertisement was seen - if the same ad has been several times

However, we do not need to record social information such as the number of likes, comments, etc. All this information will need to be saved in whichever format you prefer.

** As FB uses Ajax to load its content, it is important that you make sure that you are able to do this job before placing a bid. **

Habilidades: AJAX, Vale Tudo, PHP, Captura de dados na web, Design de Sites

Ver mais: php curl imacros, using re, unique comments facebook photos, extract data facebook, text macros, add facebook feed website, newsfeed, new facebook formats, logging facebook, last seen, imacros, fb job, fb ads, build unique facebook page, build unique, anything, imacros facebook, text extracting, php facebook sample, php redirects, add macros, curl extract text, save div, php macro, php likes

Acerca do Empregador:
( 19 comentários ) Toronto, Canada

ID do Projeto: #5142489

Premiar a:

webscrapinggurus

I specialize in projects like this. This is best done with phantomjs and python, phantomjs loads javascript and ajax just like a real browser, but runs headless in the background so a browser window does not have to p Mais

$773 USD em 15 dias
(34 Avaliações)
6.1

17 freelancers estão ofertando em média $1124 para este trabalho

buraqtech

1. Crowd Funding Site In these days we are already near to finish a full CMS based crowd funding site which is a clone of kickstarter but we implemented many unique features in this project to distinguish it from kic Mais

$1427 USD in 22 dias
(85 Comentários)
8.0
SigmaVisual

Dear Client, I can help in your project. We have already experience of working on similar projects. Please see below to get idea of our experience: Amazon/Ebay Bots: http://sigma-dns.sigmavirtual.com/PDemo1/Am Mais

$773 USD in 10 dias
(271 Comentários)
7.9
zeke

Dear Customer! I am an expert PHP developer with over 6 years of experience and very interested to work on this project. Available to start immediately and finish as soon as possible. My bid is for fast professional s Mais

$1134 USD in 20 dias
(173 Comentários)
6.9
sonarkaushik

Sir, I am well versed in this kind of jobs and can do your project as per requirement. Refer my online work portfolio at http://bit.ly/Lta2EN Looking for further discussions in this matter. with than Mais

$1184 USD in 12 dias
(200 Comentários)
6.6
sainathkohta

Hello Sir, I am from Confianza Technologies. I have gone through your requirements. We have developers who have vast experience in required technologies. We are interested in your project, but before finalizing budget Mais

$1500 USD in 25 dias
(40 Comentários)
6.6
MattLA

Dear Valuable Client, If you look at my ratings on my profile, you can see that I can complete medium to large projects successfully with great satisfaction. I specialize in advance scripting and can do even the most Mais

$1443 USD in 21 dias
(5 Comentários)
6.4
wildlily980

Hi Do you want scrape ads with "sponsored" in the right side?Like this one? http://2.youpiaoma.com/cencia/1.PNG It seems I can do it because I have experiences with facebook login and ajax contents and good at scrap Mais

$1111 USD in 10 dias
(48 Comentários)
6.2
techwelfare

hi we could do it perfectly with accuracy, please let us know if you want any clarification. if you want us to share our skill and previous work please initiate the chat..

$1184 USD in 10 dias
(61 Comentários)
6.2
aoefmpes

Hello Sir, I have much experience on web scraping. did you know selenium ? i will use it to get FB adv . Selenium can simulate as real browser and can get any thing from that pl ping me and discuss, and i will send Mais

$888 USD in 10 dias
(60 Comentários)
5.5
annaijobs

Hi, I take this opportunity to introduce myself. My name is Jeni and I am the BusinessDevelopment Executive of annaijobs. Understanding: 1. To Work on the website area. The project would cost 1159 USD and 15 USD Mais

$1159 USD in 15 dias
(18 Comentários)
5.4
MaxwellZone

Hello, I have done various kind of Facebook scrapping projects with iMacros and recently done scrap and parse FB user profile data such as Music, Movies, TV shows, Games, Likes, Groups, Notes and etc in to Excel she Mais

$1250 USD in 10 dias
(12 Comentários)
4.2
omanasoft

MY WORK I have developed (in the Java Programming Language) a Generic Web-Scraper Tool - called OpenMana Web Information Miner (OmanaWIM or OWIM) - that can be configured to scrape any information from any website. Mais

$1250 USD in 10 dias
(3 Comentários)
4.0
developwisely

Hi, I've done similar projects before and can handle ajax scraping, please see the sample screenshots of "Airpush Apps Manager" on my portfolio page, airpush.com uses ajax to load/save apps detail, you can see real au Mais

$888 USD in 10 dias
(2 Comentários)
3.2
nashirqureshi

Hi There, Thanks for giving me chance to bid on your task and taking a minute to read my profile brief.We are"WEB GLOBAL IT" is an "INDIA" based ISO 9001:2008 certified web design, web development and mobile applic Mais

$1030 USD in 20 dias
(4 Comentários)
2.0
ElanceCoder

Hi, YOUR PROJECT: ============= I know what you need and in order to study your requirements furthermore and in order to provide a precise time-cost estimate, I will be needing you to provide the following info: Mais

$778 USD in 10 dias
(0 Comentários)
0.0
pvoorneveld

Hello, My name is Peter Voorneveld. I used to be in the same situation as you. For many years I have been scraping websites, databases and social media. I decided to make a company of it. www.scrapersolutions.eu A Mais

$1111 USD in 10 dias
(0 Comentários)
0.0
inviz

Hello, you are absolulty right. Facebook is loading it's content trough ajax, wich makes it really hard to make this kind of slution in php. I could make this kind of scraper in javascript, using phantomjs (http: Mais

$1250 USD in 7 dias
(0 Comentários)
0.0