{"id":15,"date":"2010-07-19T13:14:15","date_gmt":"2010-07-19T03:14:15","guid":{"rendered":"http:\/\/www.mappingonlinepublics.net\/dev\/"},"modified":"2012-04-20T15:27:28","modified_gmt":"2012-04-20T05:27:28","slug":"resources","status":"publish","type":"page","link":"https:\/\/mappingonlinepublics.net\/dev\/resources\/","title":{"rendered":"Tools"},"content":{"rendered":"

TWITTER<\/strong><\/span><\/p>\n

Our work with Twitter<\/em> data builds on a number of tools. Many posts on the blog describe how we’re using them. Here are our key tools:<\/p>\n

Data Gathering<\/span><\/strong><\/p>\n

yourTwapperkeeper<\/a><\/em> – an open source platform building on the popular Twapperkeeper<\/em><\/a> Web service. Both capture tweets containing particular hashtags or keywords.<\/p>\n

We have made some further extensions and modifications to the yourTwapperkeeper<\/em> platform in order to ensure compatibility between TK<\/em> and yTK<\/em> datasets and to be able to export data in comma- and tab-separated formats. These modifications are described here<\/a>; the modified yTK<\/em> PHP scripts are available here:<\/p>\n

yTK-modifications-v1.0.zip<\/a> (9.4 kB) – v1.0, released 20 June 2011<\/strong><\/p><\/blockquote>\n

Data Processing<\/span><\/strong><\/p>\n

Gawk<\/a> – an open source, multiplatform, programmable command-line tool for processing CSV\/TSV documents; essential for manipulating the datasets produced by our gathering tools.<\/p>\n

We have developed a number of Gawk scripts for processing Twitter<\/em> datasets in Twapperkeeper<\/em> format. Many of the individual scripts are discussed on the blog; the current collection can be downloaded here:<\/p>\n

Gawk-Twitter-scripts-v1.0.zip<\/a> (23.7 kB) – v1.0, released 22 June 2011<\/strong><\/p><\/blockquote>\n

Textual Analysis<\/span><\/strong><\/p>\n

Leximancer<\/a> – commercial, multiplatform textual analysis tool: extracts key concepts from large corpora of text, examines and visualises concept co-occurrence<\/p>\n

WordStat<\/a> – commercial, PC-only textual analysis tool; part of a larger text statistics package: similar to but more powerful than Leximancer<\/em>, and generates concept co-occurrence data that can be exported in standard formats for subsequent visualisation<\/p>\n

Visualisation<\/span><\/strong><\/p>\n

Gephi<\/a> – open source, multiplatform network visualisation tool: wide range of visualisation options, extensible plugin system, exports maps as PDF or SVG<\/p>\n

Wordle<\/a> – simple word cloud visualisation tool<\/p>\n

Seadragon<\/a> – handy tool for embedding large-scale images on a Web page; handles images, PDFs, SVGs, even URLs for Web pages…<\/p>\n

RELATED POSTS<\/strong><\/span><\/p>\n