Current Issue: Vol. 7-1 (03/09/2009)



Subscribe to the mailing list to receive notification of new surveys and articles.

[more info / unsubscribe]

DRAVEN: HOSTILE ARSENAL`Crusade GUARDIANS PierceTheVeins Fenris Mastermind Vengeance LEGION ELITE Imperial SUPERIOR Descendants REVENGE AllStars CONQUEROR CONQUEST Renegades Celestial Beings Enrage ... [go]

Ashraf Ahmed : real-world context can be inserted into a virtual world, effectively turning the virtual world into a forum for real-world contexts. ... [go]

Roflmaodoodoodadoodoo: I didn't get it from the generator, but I saw it in Arathi Basin and thought it was the best ... [go]

Keesha: In awe of that aneswr! Really cool! ... [go]

Bobbo: This does look promising. I'll keep cmoing back for more. ... [go]



L10 Web Stats Reporter 3.15 LevelTen Hit Counter - Free Web Counters
LevelTen Web Design Company - Website, Flash & Graphic Designers

A Brief Primer on Methods and Critiques

Over the years since I first put out the Norrathian Scrolls, I've read many reactions from the player base to the findings presented. On forums and message boards, some players draw out critiques that they argue invalidates the entire study. While some of these critiques are valid, their severity is often overestimated. More importantly, it may be hard for non-statisticians to understand why a valid critique may in fact not matter for many of the findings presented here at The Daedalus Project. In retrospect, I should have provided a primer to these potential weaknesses long ago, but it's better late than never. I'm going to start with the more simple critiques and move onto critiques that appear harder to resolve.

Small sample size. Some players argue that a survey of 2000 gamers from a player base that numbers in the millions won't show anything, but sampling is inherent to almost all surveys. For example, the Gallup Poll survey less than 1% of the total US population. A small sample size in and of itself doesn't say anything about the representativeness of the findings. Oftentimes, people on forums will say that a sample of 2k is unreliable and then they will go on to expound their own opinion. Please call them out on their sample size of 1.

Players can't possibly be that old. Some balk at the finding that the average age of MMORPG players could possibly be as high as 26 and thus all other results must be wrong. Oftentimes, they claim that the average age must be closer to 18-22 because they always feel like they're interacting with adolescents in the game. But industry reports have shown that the average age of video game players in general is 30, so the MMO average from the surveys is actually lower than the overall average.

>> [Next Page]

Posted on October 17, 2005 | Comments (1)

To speed up load-times on multi-page articles, comments are now only loaded on the last page of an article.

Tribal design by snoopydoo. Crusader graphic by Gravity. All other materials available at The Daedalus Project are copyright 2003-2006 by Nick Yee.