Post by stoptheworld on Jul 22, 2010 19:05:34 GMT -5
Thought this was interesting: 
Twitter mood maps reveal emotional states of America
www.newscientist.com/article/dn19200-twitter-mood-maps-reveal-emotional-states-of-america.html
America, are you happy? The emotional words contained in hundreds of millions of messages posted to the Twitter website may hold the answer.
Computer scientist Alan Mislove at Northeastern University in Boston and colleagues have found that these "tweets" suggest that the west coast is happier than the east coast, and across the country happiness peaks each Sunday morning, with a trough on Thursday evenings. The team calls their work the "pulse of the nation".
To glean mood from the 140-character-long messages, the researchers analysed all public tweets posted between September 2006 and August 2009. They filtered them to find tweets that contain words included in a psychological word-rating system called Affective Norms for English Words – a low-scoring word on ANEW is considered negative, a high-scoring one positive. They also filtered out tweets from users outside the US, and also from those in the US who did not include their exact location – for example, their city – in their Twitter profile.
That left 300 million tweets, each of which was awarded a mood score based on the number of positive or negative words it contained. For example, "diamond", "love" and "paradise" indicate happiness, whereas "funeral", "rape" and "suicide" are negative. "Dentist" is fairly neutral.
Finally, the researchers calculated the average mood score of all the users living in a state hour by hour and so created a timed series of mood maps. They morphed the maps so that the size of each county reflected the number of Twitter users living there (see maps, right).
Simple or sophisticated?
"The visualisations are amazing and I think it is absolutely fascinating to see the nation's mood vary in near-real time," says Johan Bollen of Indiana University in Bloomington, who was not involved in the work but who is one of several other researchers using Twitter as a tool to track the public mood.
He thinks Twitter and similar sites will spawn "sophisticated systems" for mood tracking – although paradoxically, the maps produced by Mislove's team are made by a remarkably simple method.
For example, Mislove admits that subtleties are lost because the method takes individual words out of context: if someone tweets "I am not happy", the team's method counts the tweet as positive because of the word "happy". "It's a very naive and simple approach," he says.
Nevertheless, he thinks there is good reason to suspect the results reflect real mood swings – at least among Twitter's users. For one thing, the national weekly and daily trends are also seen in individual regions, something you would not expect if the variations were random.
This is particularly marked when the daily mood maps for the west and east coasts are compared: the west coast mood follows the same pattern as the east, with the 3-hour time-zone delay, indicating that each coast experiences the same time-dependent swings.
Data overload
Mislove speculates that a signal shines though because the sheer abundance of data means that occasional misinterpretations are lost in the crowd. Bryan Routledge at Carnegie Mellon University in Pittsburgh, Pennsylvania, agrees. With colleagues, he recently used a similarly simple analysis of words in tweets to determine whether Twitter mirrors conventional opinion polls. "The volume is massive, so the subtle stuff kind of washes out," he says.
Because Twitter data is publicly available, Routledge says mood can be sampled more quickly, simply and cheaply than using traditional polling tools – albeit more crudely.
Steven Gray at University College London, who also crowdsources data through Twitter, agrees. For all of the problems with decoding the data, "Twitter offers researchers a unique, live data set that changes by the minute", he says.
Read more on the Mislove team's project page.
Twitter mood maps reveal emotional states of America
www.newscientist.com/article/dn19200-twitter-mood-maps-reveal-emotional-states-of-america.html
America, are you happy? The emotional words contained in hundreds of millions of messages posted to the Twitter website may hold the answer.
Computer scientist Alan Mislove at Northeastern University in Boston and colleagues have found that these "tweets" suggest that the west coast is happier than the east coast, and across the country happiness peaks each Sunday morning, with a trough on Thursday evenings. The team calls their work the "pulse of the nation".
To glean mood from the 140-character-long messages, the researchers analysed all public tweets posted between September 2006 and August 2009. They filtered them to find tweets that contain words included in a psychological word-rating system called Affective Norms for English Words – a low-scoring word on ANEW is considered negative, a high-scoring one positive. They also filtered out tweets from users outside the US, and also from those in the US who did not include their exact location – for example, their city – in their Twitter profile.
That left 300 million tweets, each of which was awarded a mood score based on the number of positive or negative words it contained. For example, "diamond", "love" and "paradise" indicate happiness, whereas "funeral", "rape" and "suicide" are negative. "Dentist" is fairly neutral.
Finally, the researchers calculated the average mood score of all the users living in a state hour by hour and so created a timed series of mood maps. They morphed the maps so that the size of each county reflected the number of Twitter users living there (see maps, right).
Simple or sophisticated?
"The visualisations are amazing and I think it is absolutely fascinating to see the nation's mood vary in near-real time," says Johan Bollen of Indiana University in Bloomington, who was not involved in the work but who is one of several other researchers using Twitter as a tool to track the public mood.
He thinks Twitter and similar sites will spawn "sophisticated systems" for mood tracking – although paradoxically, the maps produced by Mislove's team are made by a remarkably simple method.
For example, Mislove admits that subtleties are lost because the method takes individual words out of context: if someone tweets "I am not happy", the team's method counts the tweet as positive because of the word "happy". "It's a very naive and simple approach," he says.
Nevertheless, he thinks there is good reason to suspect the results reflect real mood swings – at least among Twitter's users. For one thing, the national weekly and daily trends are also seen in individual regions, something you would not expect if the variations were random.
This is particularly marked when the daily mood maps for the west and east coasts are compared: the west coast mood follows the same pattern as the east, with the 3-hour time-zone delay, indicating that each coast experiences the same time-dependent swings.
Data overload
Mislove speculates that a signal shines though because the sheer abundance of data means that occasional misinterpretations are lost in the crowd. Bryan Routledge at Carnegie Mellon University in Pittsburgh, Pennsylvania, agrees. With colleagues, he recently used a similarly simple analysis of words in tweets to determine whether Twitter mirrors conventional opinion polls. "The volume is massive, so the subtle stuff kind of washes out," he says.
Because Twitter data is publicly available, Routledge says mood can be sampled more quickly, simply and cheaply than using traditional polling tools – albeit more crudely.
Steven Gray at University College London, who also crowdsources data through Twitter, agrees. For all of the problems with decoding the data, "Twitter offers researchers a unique, live data set that changes by the minute", he says.
Read more on the Mislove team's project page.
