Current Issue: Vol. 7-1 (03/09/2009)



Subscribe to the mailing list to receive notification of new surveys and articles.

[more info / unsubscribe]

DRAVEN: HOSTILE ARSENAL`Crusade GUARDIANS PierceTheVeins Fenris Mastermind Vengeance LEGION ELITE Imperial SUPERIOR Descendants REVENGE AllStars CONQUEROR CONQUEST Renegades Celestial Beings Enrage ... [go]

Ashraf Ahmed : real-world context can be inserted into a virtual world, effectively turning the virtual world into a forum for real-world contexts. ... [go]

Roflmaodoodoodadoodoo: I didn't get it from the generator, but I saw it in Arathi Basin and thought it was the best ... [go]

Keesha: In awe of that aneswr! Really cool! ... [go]

Bobbo: This does look promising. I'll keep cmoing back for more. ... [go]



L10 Web Stats Reporter 3.15 LevelTen Hit Counter - Free Web Counters
LevelTen Web Design Company - Website, Flash & Graphic Designers

A Brief Primer on Methods and Critiques

Match with aggregate WoW census data. Perhaps the most compelling support comes from a data source that isn't based on the survey methodology. The PARC PlayOn data is based on census snapshots from within World of Warcraft. Every 10-15 minutes, an automated script collects information from every single character online. In other words, this data source is almost as perfect as we can get in terms of actual behavioral data.

For example, from the survey data we were able to get the average achievement motivation of players who prefer different classes in WoW. From the PlayOn data, we were able to get the average time it take different character classes to make each level. The classes who score low on the achievement motivation (survey data) are also the ones who level the slowest (census data).

Of course, not every data point from the survey can be supported by the census data. After all, the census data can't track RL age or gender information. Nonetheless, this congruence goes a long ways to showing that the survey data is able to reflect actual behavioral data in a real game.

On the other hand, there are no perfect methodologies. Every methodology comes with its strengths and weaknesses. But the weaknesses of a methodology must be understood in their proper context and scope. Thus, while some argue that the sampling bias invalidates the study, it in fact has very little to do with the bulk of the findings presented at The Daedalus Project. Furthermore, their critiques often miss the important point that there are seldom optimal solutions to many problems. It would be nice if we could survey all MMO players. It would be nice if everyone were willing to fill out surveys. But social science researchers are not omnipotent and the world is not perfect. Thus, sometimes the most practical and sensible way to answer a question isn't perfect. But it would be unfair to judge The Daedalus Project against a perfect world of omnipotent researchers. Finally, there really isn't that much empirical information about MMO players who they are, their preferences, and what they do in the game. And here's what I've always believed and what led to the genesis of the Daedalus Project. Knowing something is better than not knowing anything at all.


Posted on October 17, 2005 | Comments (1)


I couldn't agree more. There definately is some substance to some of the critiques (it wouldn't *hurt* anything attempt a more random sample.) but your methods still hold. In fact, I enjoy seeing the open ended, contextual, and qualitative questions that are often a part of your surveys.

You mentioned once the importance of a context-rich study, and also challenging the many underlying assumptions (about online communities and relations in general) that have been upheld without inspection, and I think what you are doing here is opening the conversation of such things. I'm inspired to do the same other areas of online reasearch, and I think much of what you are beggining to reveal here applies to all sorts of communities.

Posted by: Mike Van Dusen on October 26, 2006 8:34 PM
Post a comment

Note: To decrease potential comment spam, comments with a link element will be moderated and will not appear immediately. Comments with more than one link are junked automatically. With regards to content, comments that contain profanity, slurs, or similar words may be censored or deleted entirely. Also, posts that are simply trolls, flames, or personal attacks have a good chance of being removed. The same applies to posts requesting character trades or asking for game-specific help.


Tribal design by snoopydoo. Crusader graphic by Gravity. All other materials available at The Daedalus Project are copyright 2003-2006 by Nick Yee.