How uTest will destroy your Quality Assurance
I just read on TechCrunch an article by Roi Carthy that UTest will allow "Crowd Sourced" QA solutions, where companies pay per bug and get QA done by many anonymous QA people around the web. I'm not sure what scares me more.
let's begin with one comment on this article that reads:
"who would give their unfinished product to strangers before it rolls out ?
do they have hte business knowledge to do so?"
Great question indeed. to which some QA person responded in the comments(bolded by me):
"It happens all the time. QA is not a very high priority in most companies. I work for a company that does outsourced QA for other companies. Most companies provide us with no knowledge about how their product is supposed to work except for the product itself. We do the best we can and help them make a better product, ideally they would provide us with more information, but they don’t want to spend the time and money so we make do with the situation. We test a few hundred software apps a year like this for various companies and are located in the US. Most of the apps are not programmed in the US and have silly errors that you would not have, were they written by an American or someone working on site with the company with the program idea."
So, this is chaos all over again. Not only will uTest not benefit the sate of software quality by lowering the bar for low quality quality assurance, but they will let companies think that this is a good thing!
The problem is most companies think QA is such a problem that can't be solved anyway, they may as well spend even less money on it instead of changing the way they work.
Problems that won't be solved:
- QA will only find minute and superficial bugs.
- Repeating test cases will still be a problem since it will not be automated.
- automation will be a problem because there is no model of "pay per automation" or better yet "pay per bug reproduction automatically"
- Like smoking "lite" cigarettes, companies will find that re-teaching the product to new anonymous QAs every time will actually cost them more instead of getting one solid QA team that knows it
- Communication is something which cannot be thrown away. If it is, companies will find that the product quality level will actually be lower, while quality expectation will be higher.
Note: I have sent a membership request to uTest so that I can explore the things I could do as a company wanting testers, so I can get a fuller picture..
The problem isn't uTest. They will make lots of money of the backs of companies who think testing is something you do at the end of development and costs less than development. The problem is the reality is perpetuates - a reality where testing is shoved aside. Can you imagine a company doing the same anonymous type of outsourcing to its development process? Oh wait, this happens too. The results are quite distressing.
What can you do?
- Get a proper serious QA team (people that also know programming)
- have them be part of the development team (tester per team at least)
- Automate as much as possible
- Every penny you save on your QA is a dollar you lose on quality later on.
- Get some serious Consulting to help you.