Taking Twitter Metrics to a New Level (Part 2)

Update: I’ve clarified/corrected some of the details relating to the percentile metrics contained in the first table which metrify.awk generates. Update 2: revision 1.2 of metrify.awk adds further functionality in addition to what is described below. These changes are detailed here. In the previous post, I’ve introduced metrify.awk, our new multi-purpose tool for generating Twitter …

Taking Twitter Metrics to a New Level (Part 1)

So, 2011 is finally over – and what a year it’s been. While the confluence of natural disasters, political crises, and other major events has also provided us with the basis for a new research programme in crisis communication, let’s hope that 2012 is a little less intense, please… To start the new year on …

Twitter Research Methods

Following on from the “World According to Twitter” research workshop at QUT, today we presented our research methods at a pre-conference workshop at Communities & Technologies 2011. This was probably the most extensive presentation of our work on Twitter research to date – including a live demonstration of how to work with basic yourTwapperkeeper datasets. …

Gawk Scripts for Processing Twitter Data, Vol. 1

Well, getting stuck in Melbourne for a day and being unable to participate in day one of our ATN-DAAD workshop with Cornelius Puschmann and Katrin Weller from the University of Düsseldorf has at least enabled me to put the finishing touches on something I’ve been meaning to do for some time: to collect and share …

Extracting images from Twapperkeeper archives

This is just a quick post to share another new script – this one takes a list of tweets with pre-resolved URLs, and filters the list for known image-hosting services. I whipped this up as part of our ongoing efforts to go deeper into the dynamics of communication at various phases of the Queensland Floods …

Media use in the #qldfloods

As I’m sure you’re aware, last week was pretty rough for Queensland (and then New South Wales and Victoria), as devastating flash floods ripped through Toowoomba and the Lockyer Valley, quickly followed by extreme river flooding in Ipswich and Brisbane that saw thousands of homes inundated. As in any emergency situation or other ‘acute event’, …

Visualising Twitter Dynamics in Gephi, Part 2

OK, so this is the second part of my post on turning Twitter data from Twapperkeeper into a dynamic network visualisation in Gephi. Last night’s post did the groundwork, generating a GEXF file from our #spill hashtag dataset (covering Twitter discussion of an Australian Labor Party leadership spill between 7 p.m. and midnight (AEST) on …

Visualising Twitter Dynamics in Gephi, Part 1

In the following posts I’m finally keeping my promise to explore in earnest the use of Gephi‘s dynamic timeline feature for visualising Twitter-based discussions as they unfolded in real time. A few months ago, Jean posted a first glimpse of our then still very experimental data on Twitter dynamics, with a string of caveats attached …

More Blog Network Data Cleaning with Gawk

The other day I outlined some first steps in cleaning our blog network data (generated by our partner researchers at Sociomantic Labs) ahead of visualising it, and posted a first tentative visualisation of the part of the Australian blogosphere that we’re currently tracking. In this post I’ll continue that discussion, describing a few more steps …

Cleaning Up Blog Network Data with Gawk

Having done a fair amount of work with Twitter data over the past couple of months, I’m keen to get back now to the other substantive part of our ARC Discovery project on mapping online public communication in Australia during this first year of the project: examining patterns of interaction within and across the Australian …