Network Sites: FPSguru.com RTSguru.com UnboundGamer.com
Login:  Password:   Remember?  
Show Quick Gamelist Jump to Random Game
Games:608  Guilds:3,081
Members:1,599,208  Online:0
Guests:0  Posts:4,853,103
BioWare | Official Site
MMORPG | Genre:Sci-Fi | Status:Final  (rel 12/20/11)  | Pub:LucasArts
PVP:Yes | Distribution:Retail | Retail Price:n/a | Pay Type:Subscription
Desktop Client | System Req: PC | Out of date info? Let us know!

Star Wars: The Old Republic Editorial: Thoughts on Game Testing

MMORPG.com Community Manager Michael Bitton has some thoughts about game testing. He offers insight into what it is, what it isn't, how to help when you do and, just maybe, reasons not to participate in game testing or beta testing your most highly-anticipated games.

By Michael Bitton on July 14, 2010

A few weeks ago rumors that Bioware’s Game Testing program for Star Wars: The Old Republic had started began to surface, with screen caps of invite e-mails appearing in the wild and many users freely admitting they had received them. Bioware was curiously silent on the rumors, neither confirming nor denying that testing had begun, with SW:TOR Community Manager Sean “AshenTemper” Dahlberg instead choosing to remind users on the game’s official forums to be mindful of the Game Testing Non-Disclosure Agreement, revealing that players are allowed to admit they were in the program and nothing more .


Last Friday, Bioware announced that the Game Testing program was officially underway, confirming what eager fans had already suspected if not outright knew already. We originally reported that Bioware had begun taking “beta testing” sign ups back in September of last year, along with many other sites, only to be corrected a few days later as Bioware had not opened up sign ups for beta testing but instead were accepting sign ups for “Game Testing.”

What the heck is Game Testing? Bioware has been a bit cryptic on this since the announcement last year, leaving many fans to speculate as to whether or not this was merely a matter of semantics or if there was an actual difference in the program. With many gamers and even members of the press feeling that beta tests have simply become a marketing tool, perhaps the difference in nomenclature was an effort to signify that Bioware was taking their testing of the game more seriously, or perhaps the program was something different altogether. We got a bit more clarification on the program with last Friday’s update, as Bioware elaborated a bit more on what exactly Game Testing would entail:

“Game Testing is an on-going process being rolled out in several phases. These phases began with smaller, more focused tests with community members from North America, and later will expand to other territories.”

Okay. So, Game Testing basically sounds like focus group testing, possibly similar to what the folks at En Masse are doing with TERA. Focus testing, as its name would imply, involves focused tests on specific aspects or portions of the game, differing significantly from a straight up beta test where players often have a more free experience, which in later stages can almost feel like playing the live game.

Fans who camped their inboxes in hopes of finding an invite last year in the days, weeks, and months after sign-ups began are now checking their inboxes with increased fervor as we now know for a fact that people that aren’t in the press or working at Bioware are getting hands-on time with the game. They’re excited, and rightfully so. But I am not, not too much anyway.

Why?

Despite being a self-professed Star Wars geek, and fighting my natural urge to want to get my hands on just about any “beta test” as most gamers often do, I don’t really want to test this one as much. It’s the fact I am a Star Wars geek that makes me averse to full-blown testing this game, for the same reasons I probably wouldn’t have wanted to be there on set when they shot the Star Wars films: spoilers!

Not just story spoilers mind you, but as someone who has been part of a great many beta programs and focus tests, there is something about seeing the “wires” hanging out of a game when it’s still in development that deflates excitement for the game’s launch, killing the mystery if you will. Game development is an iterative process, and often times in tests (especially focus tests) they try all manner of things with the game. What if I like the way something plays or works, but other testers don’t, and they change it? I’ll be stuck on that forever, wondering what could have been. I went through just that process in The Matrix Online, where I spent more time in the beta and focus tests than I did in the actual live game. Most of my best experiences were actually in the six plus months I’d tested the game, and while the developers did a pretty good job of hiding a lot of the major storyline aspects of the game, I’d played the game in many different forms and found it lacking in many ways, more than I would had my first experience with the game been on launch day. I had a point of reference, just like vets of Star Wars Galaxies do for the pre-NGE or pre-CU era. Most live games don’t change as drastically as that one did post-launch, but those sorts of changes can be pretty commonplace in the earlier stages of testing for an upcoming game.

So, would I like to get some more hands-on time with Star Wars: The Old Republic? You bet! But do I want to be part of the earliest of testing groups, possibly returning for many more tests to come and eventually less restricted beta testing? Nope. I think it’d ruin a game that I am otherwise looking forward to. Another example of my issue with being part of a prolonged testing experience was my time in the Age of Conan beta, which for months on end only allowed us to explore the confines of Tortage. By the time Conan launched I was ready to barrel out of Tortage and see the world that awaited me, while my friends were all “Oooh! Aaah!” and wanting me to slow down. What Star Wars geek wants to feel that way about this game?

However, for those of you out there who appreciate the project for more than its lore or don’t care for spoilers and want to actually get into testing (or already are in testing) simply to help Bioware put out the best game they can, I’d like to take this opportunity to offer a few points on how you can do that and do it well.

Bug Reports

Let’s start with bug reports. Angie Webb just penned a column discussing her time in QA on Warhammer Online which is chock full of insight on how QA testers put games through the paces, but she also mentions the testing that goes on while on the other side of the fence, more specifically, the fact that a significant majority of bug reports submitted by players were not actually legitimate reports, but players simply using the report tool to communicate their dislike of a particular aspect or system of the game. So, the very first tip I can give you is – don’t do this! If you want to help QA nail down important issues, keep bug reports to just that – bugs!

When you submit a report, people like Angie go into the game and try to “repro” or reproduce the bug submitted, so it’s important to keep that in mind when filling out a report. Writing a report that simply says “Nem’ro the Hutt won’t talk to me” isn’t as helpful as providing as much information as possible. You want to explain things as if someone were asking you how they could reproduce the bug, and the best way to do this is to try and reproduce it yourself and simply document the steps. The challenge is to also be concise while doing this, as QA go through many reports, you’ll help them more by getting to the point and explaining things in a clear but brief and informative manner. The quicker they can reproduce and document the bugs testers submit, the more bugs can potentially be squashed, which leads to a more polished and less buggy game (I’d wanted to say bug-free, but who am I kidding?).

Feedback

What about feedback? Feedback is also important. Maybe something is “working as intended” but you don’t like it, or something is missing that you think the developers should add. Most game tests will often have forums where you can make your case about your ideas on a particular feature (with the added benefit of allowing other testers to weigh in on it as well), or the Report interface will have a separate feedback section. Like bug reports, you want to explain your thoughts in a concise manner, but it’s also important to be constructive about your feedback. Ideological rants, belligerent language, etc won’t serve your cause all too well. Instead of assuming that the people reading your feedback are already set in stone about something (essentially defeating yourself before you even begin!) simply assume things are malleable and if you make a good case you just might see your feedback incorporated into the game. Why? Because it’s true! I personally got a few things changed during my time in The Matrix Online beta, so I can speak from experience that it is indeed possible. Granted, things need to be kept in perspective. If Star Wars: The Old Republic doesn’t have a full blown space feature two weeks from launch, asking them to add one before launch isn’t exactly realistic.

Information wants to be free, yo!

Finally, as Community Manager here at MMORPG.com, I can’t pen an article on Game Testing without discussing testing leaks. Just like you, we all want to know and see things about the game (and other games). In fact, for many of us, that’s precisely why we got into this line of work. Unfortunately, information and related media gleaned from most game tests are protected by Non-Disclosure Agreements, which means we probably shouldn’t be hosting or linking to said material here at MMORPG.com. The act of doing so is explicitly against our Rules of Conduct, and while we understand your frustration and desire to inform your fellow gamers of the cool things you saw at X Y or Z site, we respectfully ask that you please refrain from posting NDA protected material on our forums.

More Star Wars: The Old Republic Features:

Star Wars: The Old Republic - Update 1.3 and Beyond Interview added on Thursday May 24
Star Wars: The Old Republic - A Bittersweet Week Column added on Wednesday May 23

More Editorial:

The WoW Factor - The War Back in Warcraft Editorial added on Monday April 23
Garrett Fuller - A New Breed of MMORPG? Editorial added on Wednesday February 22
General - Naming Your MMO Baby Editorial added on Tuesday January 31

More Features:

Pandora Saga - Our Official Pandora Saga Review Review added on Wednesday May 30
 
 
 
Leave this field empty
Post Your Comment:
Our Rating
8.7
User Rating: 7.8
Popular Features:
Warhammer Online: Wrath of Heroes : Amenadresh Returns! Interview added on Friday May 25
Warhammer: Wrath of Heroes has been steadily gaining momentum over the past several months. We... Read More
Rift : Conquest - Open World, Three Faction PvP Interview added on Thursday May 24
Trion Worlds and the Rift team introduced a brand new way of playing the game... Read More
The Secret World : Hell Hurts Preview added on Thursday May 24
One of the most anticipated features in Funcom's The Secret World is running through dungeons... Read More
Diablo 3 : Review-in-Progress Part Two General Article added on Friday May 25
After 12 years was Diablo III worth it? That's far too loaded a question to... Read More
The List : 5 Ways MMOs Will Survive Column added on Monday May 28
MMOs these days are having a hard time...some of them anyway. Studios are closing. Developers... Read More
Latest News:
Star Wars: The Old Republic : Will TOR Adopt ‘Mega Servers’? Reported on May 29, 2012
Will Star Wars: The Old Republic go the route of DC Universe Online and implement... Read More
Star Wars: The Old Republic : Update 1.3 and Beyond Reported on May 23, 2012
One of the most compelling features that shipped with the Star Wars: The Old Republic... Read More
Star Wars: The Old Republic : A Bittersweet Week Reported on May 23, 2012
Between the announcement of Update 1.3: Allies and BioWare Austin's 'restructuring,' one might say it's... Read More
Star Wars: The Old Republic : New Video Diary Spotlights 1.3 and Beyond Reported on May 22, 2012
Game Director James Ohlen highlights some of the new content coming up in Game Update... Read More
Star Wars: The Old Republic : Bioware Rocked By Layoffs Reported on May 22, 2012
According to a new forum post on the official Star Wars: The Old Republic site,... Read More

Advertisement