No beta test or I am completely dumb? - Page 2

crazygambit · 01-05-2011, 03:44 PM

Quote:

Originally Posted by brutalisk

Ok guys, I just needed to make sure that there is no proper way to do this and that I am not a complete dumb that overlook obvious... I will use some workarunds but just wanted to be sure.

Thanks everyone who participated in this talk.

But there IS a proper way to do it, it's called the enterprise program. It essentially lets you bypass the App Store and the need for UDIDs, so you can get the thousands of testers you need. It's $299, though I trust that won't be a problem for you.

As for the rest of us the 100 devices a year seem like enough to conduct thorough tests before release.

Jeremy1026 · 01-05-2011, 03:46 PM

If you have so many complaints about iOS development, then why don't you move on. I'm sure Google or RIM would love to have you.

bignoggins · 01-05-2011, 04:36 PM

Quote:

Originally Posted by crazygambit

But there IS a proper way to do it, it's called the enterprise program. It essentially lets you bypass the App Store and the need for UDIDs, so you can get the thousands of testers you need. It's $299, though I trust that won't be a problem for you.

As for the rest of us the 100 devices a year seem like enough to conduct thorough tests before release.

Exactly. The individual iOS developer program is meant for INDIVIDUALS. We don't have apps complex enough to need more than 100 beta testers.

For the record, I use my 11 year old brother as my one and only QA engineer and he is better than most test engineers I worked with at my day job =)

wally4u · 01-06-2011, 02:07 AM

Quote:

Originally Posted by brutalisk

You will rely on a test run by 10 people before releasing to 100000? To 1000000?

Cmon guys, this is business, not games...

P.S. Guys that are hired to test apps before release called QA, but did you see any online game out jsut relying on QA team, without public beta test?

Are you living under a rock?

Well to answer your first question: Yes. 10 good testers outperform 500 bad ones. If you want to rely on massive numbers you need to harvest the crashlogs to figure out what's going on. Don't count on public beta testers to write extensive bug reports that are actually useful. (i've seen too many "app crashes in lvl 33m, fix it!" bugs)

Based on your first comment regarding not having done a proper beta test in the first place I assumed (assumption is the mother of all f*ckups, I know) that your were a small shop. Sorry.

To answer your second question, I was talking about MAC OS X games, with tier 1 titles, not your average 1.99 game. Games are Big Business.

Since we do not know what kind of application you are building we can only generalize. Personally I do not see the use of a massive Public Beta unless you are building a social app or MMORG.

And no I don't live in a rock, I live in the real word that's not perfect.

PS: by your mom/aunt/etc I meant to describe a typical end user. Not actually your Mom :P

To be frank, I don't think its useful to criticize people here that are trying to help. Heck I even registered just for answering your question.

ziocleto · 01-06-2011, 04:23 AM

Well a couple of points:

- You can have up to 100 devices registered but nothing stops you hiring 1000 testers on a round robin, it's not that every tester must test your app 24h.

- I've worked for many AAA games and at times we didnt have more than 5/10 in-house testers, (those are company like EA/Sony etc...) of course at busy times the whole team (150+) would playtest the game. And for the final push you would probably have more, but nowhere near 100 to test a single game, probably 100 to test all their games (>20 at any given time).

- Testing an MMO game is an all different matter, and that's where you need your beta out like WoW to some thousands to get a proper testing. Unfortunately Apple doesnt have a beta system yet. But that's limited to MMO testing. Any other app can be tested with a combinations of the points above.