October 18, 2005

Required reading... "Betas should be about testing"

Darniaq has a great blog post up about how beta testing needs to be about testing and how the industry has strayed. From the article;
"However, this can't be the only part of the beta testing. There needs to be a good back end reporting system too. Forums do not cut it. They may work for a few hundred testers, of which maybe 75% of them would read the forums and 50% actually post. However, when the game starts stress testing the servers, the players will generate much more noise than actual signal on the forums. Most of this noise will be rehashing long standing bugs or incomplete features, requiring even other testers to skim posts so much they may miss something relevant."

Update: 10 Nov, 2006 - Edited post and applied labels.