Research Finds TDD Boosts Developer Productivity - ISerializable - Roy Osherove's Blog

Research Finds TDD Boosts Developer Productivity

Thanks to Haacked for posting this one.  I haven't yet read it fully, but this IEEE paper shows good results when doing test-first development vs. other methods.

"We found that test-first students on average wrote more tests and, in turn, students who wrote more tests tended to be more productive. We also observed that the minimum quality increased linearly with the number of programmer tests, independent of the development strategy employed."

"The external validity of the results could be limited since the subjects were students. Runeson [21] compared freshmen, graduate, and professional developers and concluded that similar improvement trends persisted among the three groups. Replicated experiments by Porter
and Votta [22] and Höst et al. [23] suggest that students may provide an adequate model of the professional population."

To read a good summary of that paper go to Phil's post and read it to the end.

Update: Jacob rips the report to shreds.

Published Friday, January 25, 2008 8:19 PM by RoyOsherove
Filed under: ,

Comments

Friday, January 25, 2008 11:15 PM by Martin Ecker

# re: Research Finds TDD Boosts Developer Productivity

Here's an interesting analysis of that same study with a bit more scrutiny:

scruffylookingcatherder.com/.../tdd-proven-effective-or-is-it.aspx

Note that I am a big proponent of TDD and actually do TDD at work and in private projects.

What the study seems to miss is that TDD IMHO tends to improve the design and make the resulting code easier to refactor.

Saturday, January 26, 2008 1:30 PM by Isaac Gouy

# re: Research Finds TDD Boosts Developer Productivity

Roy Osherove wrote "To read a good summary of that paper go to Phil's post and read it to the end."

To read a good summary of that paper go to the end of the paper and read the "CONCLUSIONS AND FUTURE WORK" section ;-)

"Test-First programmers did not achieve better quality on average, ... Writing more tests improved the minimum quality achieved and decreased the variation, but this effect does not appear to be specific to Test-First."

Sunday, January 27, 2008 12:04 AM by TDD really works! :: Fat Penguin

# TDD really works! :: Fat Penguin

Pingback from  TDD really works!  ::  Fat Penguin

Monday, January 28, 2008 10:59 AM by Jacob

# re: Research Finds TDD Boosts Developer Productivity

Thanks for updating with my analysis. It's an interesting report with some support for TDD, but also some fascinating data points that I think are troubling as well (that I think should have made it to the abstract).