So You Want to be a Video Game Tester: Part Deux

hot-shots-part-deux-fight-bug

This blog post is a continuation of a previous post entitled “So You Want to be a Video Game Tester” Please read that to wet your pallet for your Video Game Tester reading enjoyment.

Well, my previous post generated some positive buzz and I’d like to say thank you to all who read my post! I am ready to dish out more experiences and info about Software QA testing! I collected some valuable feedback from readers (and trolls) on what they wanted to read and will no doubt address those aspects now and in the near future.

In my previous post, I scratched the surface, focusing primarily on preparing to be a tester, writing out a bug with details and the process that occurs during the life of the bug submission. Today I would like to focus on the difference in working as an embedded (developer side) tester vs. publisher side. I have worked in both environments, primarily developer side.

ACT I: PUBLISHER SIDE
My first QA position was at EA Los Angeles. This contract position was located on the main testing floor that basically was endless rows of ultra-small cubicles. How small is this space you ask? Well, imagine having one work computer to the left of your feet, one massive heat exhausting gaming tower to the right, three monitors (two for the main computer and one for testing), an Xbox 360 test kit, PS3 test kit and oodles of wires, KBM/KBM switches, VCR (whua?), controllers, headsets, etc. Now imagine all of this equipment accompanying you on a 4 ft wide desk with the back of your chair banging the tester directly behind you when you rocked back.  It was a tad worse if you had a PS3 dev kit.  Those are the size of web servers!

If you were testing on a console and required video capture, you would need to turn on your archaic VCR and record your segments.  Next you would need to go to the video capture station and convert your video to a digital format to attach to your report.  Luckily for me, I tested primarily on PC where FRAPS was my best friend, but always dreaded having to use the VCR when needed.  This was an ass backwards method of recording, but it was what we had to do at the time.  Even more stupid was the fact that we were unable to capture screenshots for PS3 from Sony’s ProDG Software.  We had a community digital camera to take a picture of our screen until an engineer was able to update our QA tools to capture PS3 images.

Being a floor tester publisher side also meant that you had to deal with varying personalities of your team.  I have made numerous friends, some of which I still keep in touch with, but not everyone clicks with each other. Imagine being in a large classroom where every type of personality is present.  There are the slackers, smelly kids, the socially inept, class clowns, egotistical bastards, “girl” gamer, bad joke teller, elitists, etc.  Couple that carnival with burned out senior testers who originally got the position because of bug count and not managerial skills.  Sounds like a recipe for grumpy cat, but it doesn’t end there. Tack on “crunch time” mandatory overtime for 3 months straight and kiss your already nonexistent social life goodbye. But at the end of the day/project, despite this rag tag group, all of you have a love for video games and that will keep you united… that is until layoffs.

The really crappy part of the job is that it’s a contract position unless you have a brown enough nose to stay on permanently.  Typically your contract is good for 6-12 months.  It doesn’t matter how good you are or how many crash bugs you found, but when you reach your 12 month anniversary, the company by law (maybe just California) has to provide you with benefits.  That just does not happen.  Wave goodbye to your colleagues as security escorts you down the walk of shame.  It is a harsh truth, but there is a glimmer of hope called Funemployement (a future story!)

ACT II: DEVELOPER SIDE (IE:)  EMBEDDED TESTER
A few months into my time testing on Medal of Honor: Airborne, I was promoted to an embedded tester.  They sat me right smack between the Art and AI team.  Being with the devs was like night and day.  For one, you had more physical space to move around and didn’t have people hovering over you.  My bug count did go down a little as I was doing more specific tasks and numerous smoke tests.  Having to come into work an hour earlier kind of sucked, but it was needed to complete the morning smoke for your fellow publisher side testers to have a stable build to work on.

There were some small perks to enjoy such as your security badge upgraded to allow access to the elevator and being able to shoot the shit with the devs during “Beer Fridays.”  You could also sneak in after late “Margarita Wednesday” lunches not worrying about your bosses catching a whiff of you celebrating Cinco de Mayo.

The best part of being an embedded tester was that you were able to experience the entire wheel turning.  You felt more like part of the team as you were involved in daily Scrum meetings, being in the middle of successfully hitting milestones, being seriously heard for suggestions and concerns… that experience alone really opened my eyes to seriously pursuing video games as a career.

Once I was eventually let go from that prestigious tester position, I had interest from Treyarch and Insomniac Games for work.  I chose Treyarch even though Insomniac was closer to my home. I figured they had more upside seeing that I would work on more than just a PS3 and PC SKU.  Plus Treyarch was in Santa Monica and Insomniac was in hot ass Burbank!

Treyarch was very similar to when I was an embedded tester at EA.  My work station was smaller and test lead was an elitist tomboy, but she did fight for us and never fed us to the sharks. If you are curious, Treyarch’s perks were pretty nice.  Fully stocked kitchen including unlimited fountain drinks, beef jerky, trail mix, candy bars, cereal, chips… oh man I’m making myself hungry! Oh and I can’t forget the free catered In-N-Out Truck and Pink’s Hotdogs once a month and mandatory “Beer Friday Team Meetings”.  The “Breakfast for Dinner” OT dinners were also the rare times when I ran to be in the front of the line!  Come late and no bacon for jou!

Food aside, Treyarch is where I was able to excel and lead the team in bug count for a majority of the time.  The dev team listened to my suggestions and implemented many of them including numerous changes to the UI/Shell.  Since I was a graphic designer by trade in my previous endeavors and currently, I was pursuing UI art as a viable career destination.  I even bought a book on UI I glanced over a few times!  I first caught the eye of our executive producer when I created a custom badge sticker for my ID card that had a James Bond silhouette and my name and title along with Treyarch and Activision logos.  He gave me 20 bucks for materials to make him some to pass out to some of the higher ups.  He sported his and always flashed his to me when we walked past each other in a hallway.

My big break came when a temp UI artist position became available where I applied faster than a BMW M8’s 0-60, but that is another story (keep your eyes peeled for that upcoming blog!). Eventually my time at Treyarch came to an end as well, but my career was not over!

testing_with_a_view

I landed back on my feet in the trenches of QA developer side with Pandemic Studios.  This office was plush. For one, there was a bar in the lobby, but even nicer was that you can work with a view as opposed to being shackled in “the Dungeon” of Activision HQ.  I never had the pleasure to work in that cutthroat environment, but was thrilled this location was in beautiful Westwood just a few blocks from UCLA. I was placed on the Saboteur team and was graciously welcomed by an elite squad of testers in our own spacious room to comfortably shoot black and white Nazis and deeply analyze 1940’s digital boobs.

Pandemic felt much like Treyarch, but there was an invisible line between QA and the dev team.  Many of my old colleagues I worked with at EALA were transferred to Pandemic when EA purchased Bioware and Pandemic Studios from U2 Bono’s holding company for $860 million. With that move, they brought the whole “publisher side” mentality to a dev side studio which made for some frustrating moments. I had to get all of my bugs “evaluated” again like I was some n00b. Despite feeling like I was publisher side again, I made sure to keep my voice heard and pushed my way forward, making strides in suggestions for the UI while helping document as many bugs as possible.

One thing to note that was interesting we did was that we had “the Pit.” This is where we would go to play test and reproduce nasty bugs with devs and hear quality jokes from QA Analyst/Stand-Up Comedian Marty Quinn. You should check him out. The Pit was where everything went down and was also in the open room where we held team meetings even though you can’t efficiently fit 120 people in that area.

pandemic_shutdown_QA

Fast forward through crunch time and a week til launch, EA dropped the bomb and decided to shutdown Pandemic Studios forever.  It was interesting to read about a “rumor” on Kotaku about Pandemic being shut down an hour before it happened.  It was a mix of emotions and actions.  Confusion, yelling, crying, nervous laughter, pillaging, denial, the whole bag was present.  We were first split into 2 groups.  One group was contract employees and the other perms.  The perms got presented on their severance packages and benefits while the employees on Visas were up a creek royally. I was contract so I was told that I am being paid till the end of the week and to drop off your badge with security. The next 5 hours were spent getting drunk at the local pub where our ex bosses paid the tab.  Funny because we were in the middle of fixing the PC only bug that made the game super unstable for users playing the game on multi-core processors and Radeon GPUs.  Stay classy EA.

EPILOGUE
Well, that is embedded vs publisher testing as seen through my eyes.  There are other differences I didn’t go over such as the types of bugs you look for as the publisher has their own criteria vs. developers.  That can include Sony’s TRC and Microsoft’s TCR compliance testing and black vs. white box testing.  Generally publisher side tests “Black box” (external testing perspective such as the end user) and embedded works “White box” (internal testing perspective more at a code level), but they both overlap each other somewhat.  Another one is that the publisher side will test off of discs of the build that the embedded testers “approved” via smoke tests.  Their builds will be a day or two behind embedded who don’t generally work off of discs too often.  They sync the most recent game files and compile a build on their comp/console to create a working build to test off of.

I hope you enjoyed this read as I was happy to recall my fond memories of QA.  Look for my next recollection in a blog post near you!

Comments

comments

by Steve Cantu, on August 16, 2013

I work at iBUYPOWER