I am seeking someone who has existing software and/or expertise in scraping leading social media websites. I am posting a few applications on Freelancer, please review all of them, and also advise if you have other valuable applications you may already have that I may have interest.
TWITTER FOLLOWERS WEB SCRAPE:
A. I will provide a flatfile of Twitter Usernames, such as:
@KingJames
@JustinBeiber
@KobeBryant
B. You would read use Usernames sequentially and convert the Username to its Follower's Page URL, as follows:
[login to view URL]
[login to view URL]
[login to view URL]
C. Then using a REGULAR EXPRESSION, for each Follower's page, retract all of the Twitter Usernames (Followers) from that page. The format of a Username is as follows (Use a Regular Expression for this):
i. The @ symbol
ii. Following by a group of letters or numbers
iii. Terminating with a SPACE
FOLLOWERS are listed sequentially in a TABLE on the Follower's Page. Make sure you can extract the full page, because in the HTML version, AJAX is used to retrieve more usernames as the user presses PAGE DOWN on that page. In the webscrape, I'm not sure how many users are provided at once. You may need to call the Follower's page many times with a counter or something to get all the Usernames. Please test this to ensure you can do it.
D. Append all of the followers to the indicated OUTPUT TEXT FILE
The application would be an EXE that runs from the DOS Command Window with the following Syntax: TwitFollowers username,password, [login to view URL], [login to view URL]; where TwitFollowers is the name of the application, Username is the Twitter Login Username, Password is the Twitter Login Password, [login to view URL] is the text file of usernames, and [login to view URL] is the output file of followers. A config file or command line approach for params are okay.
E. The format of the output file should be as follows:
[Username]
LIST OF FOLLWERS
For example using the sample file provided above, the output file should look like:
[@KingJames]
@Follower1
@Follower2
@Follower3
...
@FollowerX
[@JustinBeiber}
@Follower1
@Follower2
@Follower3
...
@FollowerX
[@KobeBryant]
@Follower1
@Follower2
@Follower3
...
@FollowerX
Hello; your 5-star data scraping expert is ready to help you... kindly check my profile and feedbacks; and get back to me if you wish to proceed with a top-rated expert here...regards,