Python Script for Exporting (Large) Twapperkeeper Archives By User
FWIW, I started putting together a script that will grab individual hashtag archives, or all the hashtag archives created by a single user, from Twapperkeeper (which is shutting off its archives in early January).
The script should be capable of grabbing tweets from even large archives (hundreds of thousands/millions of tweets), though it’s probably not very efficient in the way it does it…
You can find the script here: Twapperkeeper archive rescue
If you have any problems with the script, or make any improvements to it, please let me know via the comments…
[...] I also doodled a Python script to download (even large) Twapperkeeper archives, by user Rate this: Share this:Like this:LikeBe the first to like this [...]
Rescuing Twapperkeeper Archives Before They Vanish, Redux « OUseful.Info, the blog…
December 12, 2011 at 5:36 pm
[...] Python Script for Exporting (Large) Twapperkeeper Archives By User [...]
Rescuing Twapperkeeper Archives Before They Vanish « OUseful.Info, the blog…
December 12, 2011 at 5:37 pm
[...] you really want to get your hands dirty, you could try Tony Hirst’s Python script for rescuing (i.e. exporting) TwapperKeeper [...]
So Long, TwapperKeeper, and Thanks for All the Archives - ProfHacker - The Chronicle of Higher Education
December 15, 2011 at 8:02 pm
Wow! This is exactly what I was looking for! I am very very new to computer science, I have never done anything worthwhile, I’ve just started learning, but I need some archives from TwapperKeeper, could somebody explain to me (like I am 5) step by step how to use this script? I’d be very grateful! I am on mac os x and I want to export archives for 3 hashtags. Thanks in advance!
dira
December 18, 2011 at 5:28 pm
It works perfectly now, turns out I just didn’t have a few things installed.
dira
December 19, 2011 at 3:52 am
[...] download a Twapperkeeper archive to a CSV file using a Python script as described in Python Script for Exporting (Large) Twapperkeeper Archives By User; the CSV file should contain a single column with one row per archive entry; each row includes the [...]
A Tool Chain for Plotting Twitter Archive Retweet Graphs – Py, R, Gephi « OUseful.Info, the blog…
December 21, 2011 at 4:55 pm
Don’t works for me. Any fix?
mrta
February 1, 2012 at 11:37 am
Twapperkeeper archives will probably have been shut down by now…
Tony Hirst
February 1, 2012 at 12:56 pm
Other working alternatives? Thanks
mrta
February 1, 2012 at 1:29 pm
What do you mean? Other Twitter archivers? There’s a personal version of Twapperkeeper (myTwapperkeeper?), ThinkUpApp, or Martin Hawksey’s TAGSExplorer Google Spreadsheet Twitter archiver.
Tony Hirst
February 1, 2012 at 3:24 pm