272
edits
Changes
Jump to navigation
Jump to search
Twitter News Finder (Tool) (view source)
Revision as of 16:11, 1 November 2016
, 16:11, 1 November 2016Created page with "{{McNair Projects |Project Title=Twitter Follower Finder (Tool) |Topic Area=Resources and Tools |Owner=Christy Warden |Start Term=Fall 2016 |Status=Active |Deliverable=Tool |A..."
{{McNair Projects
|Project Title=Twitter Follower Finder (Tool)
|Topic Area=Resources and Tools
|Owner=Christy Warden
|Start Term=Fall 2016
|Status=Active
|Deliverable=Tool
|Audience=McNair Staff
|Keywords=Webcrawler, Database, Twitter, API, Python
}}
== '''Finding Sources of News Crawl''' ==
== Description ==
This is a crawler that will operate on a dummy account (@testapplicat2) that is following popular news sources. Every fifteen minutes, the application does an analysis of its timeline, and
sends any tweets that contain buzzwords (matched by a regex) to the BakerMcNair account in a direct message with an @ to the source.
== Development ==
Same as [[Christy Warden (Twitter Crawler Application 1)]]
== Test Plan ==
Let is run for this week (sending DMs to my personal account) and see if the crawler can function infinitely (will twitter shut us down?). Also, checking to make sure that the tweets that the regex catches are interesting and worthy of making someone look at.
==Log:==
''11/1''
Built application. Having issues with rate limiting (sigh) but plan on letting the crawler sleep for 15 minutes every time it does anything, which might negate the issue. This probably won't matter, because no more than 200 tweets should likely be posted within 15 minutes on the timeline anyway.
[[Category:Internal]]
|Project Title=Twitter Follower Finder (Tool)
|Topic Area=Resources and Tools
|Owner=Christy Warden
|Start Term=Fall 2016
|Status=Active
|Deliverable=Tool
|Audience=McNair Staff
|Keywords=Webcrawler, Database, Twitter, API, Python
}}
== '''Finding Sources of News Crawl''' ==
== Description ==
This is a crawler that will operate on a dummy account (@testapplicat2) that is following popular news sources. Every fifteen minutes, the application does an analysis of its timeline, and
sends any tweets that contain buzzwords (matched by a regex) to the BakerMcNair account in a direct message with an @ to the source.
== Development ==
Same as [[Christy Warden (Twitter Crawler Application 1)]]
== Test Plan ==
Let is run for this week (sending DMs to my personal account) and see if the crawler can function infinitely (will twitter shut us down?). Also, checking to make sure that the tweets that the regex catches are interesting and worthy of making someone look at.
==Log:==
''11/1''
Built application. Having issues with rate limiting (sigh) but plan on letting the crawler sleep for 15 minutes every time it does anything, which might negate the issue. This probably won't matter, because no more than 200 tweets should likely be posted within 15 minutes on the timeline anyway.
[[Category:Internal]]
