Public digital media and democracy : constructing instruments for measuring expressions of support for democracy on Twitter

The constant growth in information and communications technology (ICT) broadens the capabilities of researchers to understand and interpret the social world. New multidisciplinary methods of measuring social realities are constantly being developed and improved. This methodological study aims to incorporate novel methods of automated, computerised content- and sentiment analysis software in order to produce a usable instrument for measuring public expressions on democracy from the social network site, Twitter. Adapting methods developed by OÀŸConnor et al. (2010) and using an online platform called Chatterbox Analytics Ltd., this study attempts to complement traditional survey research data on democracy. The creation of this method allows researchers to automatically and without deep programming knowledge, extract and analyse opinionated data from a substantial segment of the population, namely Twitter users. This is the first study, as far as this researcher is aware, that develops automated instruments for the measurement of expressions on democracy from online social networks. The rationale for the development of this instrument lies in the apparent recent rise in negative sentiment on democracy in academic spheres and political realities alike. Throughout history support for democracy has swayed, which in turn placed democracy on a rocky path of development. As negative opinions on democracy became overwhelming this system of governance was forced to adapt by changing its core structure. This could be the case again today. Authors such as Crozier, Huntington and Watunaki (1975) have already warned of a crisis of democracy in the 1970s. More recently authors such as Dalton (2004) and van Beek (2012) expressed opinions indicating that globally citizens are steadily becoming more critical of political parties, politicians, political policies and the whole democratic process. These negative sentiments might be indicative of what van Beek (2012:12) calls “an erosion in support for democracy”. Traditional survey projects examining opinions on democracy, such as the World Values Survey, offer insights into global expressions on democracy, but are time consuming, costly and complicated to conduct. The method developed in this study allows researchers to complement traditional survey data with insights that are automatically gathered and analysed from the influential social media network, Twitter. This introductory study finds that automated analysis of expressions on democracy from Twitter is indeed feasible. In order to express the extent to which the developed method is feasible, this study offers an example case, examining expressions on democracy from Twitter for the period of 1 May to 31 July 2012. Furthermore the study offers a quantitative manual evaluation of the accuracy of the developed measurement instrument. With the present level of content- and sentiment analysis technology this study finds that the accuracy of the results from this method, though informative, is still limited. The study therefore concludes with an advisory section highlighting methods for future studies to improve on the accuracy of this measurement instrument.

Publisher: University of Stellensbosch
Year of Publication: 2013