Agile Teams
Publications - TSP-EF Presentation at TUG 2005 (Third Annual TSPSM Users Group Conference)
"Using a 'TSPSM Evaluation Framework' to Measure TSPSM/PSPSM Compliance"
Authors | Publication History | Related Materials | Background Required | Abstract

This paper was co-authored by Karen Smiley, Jan Höglund, and . See the final slides for acknowledgements and credits to contributors.
Publication History:
This presentation is the second in a series of papers we are writing on TSP-EF as it develops.
  • August 22, 2005: slides submitted to SEI and presented at TUG by Karen on Sept. 19-21, 2005. The TUG 2005 proceedings are no longer available on the SEI website.
Related Materials:
  • The TSP-EF materials
  • A rich text paper () describing the framework development in detail, written in collaboration with and (pending)
Background Required:
This paper assumes good familiarity with the and . It will be most meaningful to experienced TSP practitioners or coaches. No prior knowledge or experience with XP-EF or other Evaluation Frameworks is required.
(After the conference, the abstract will also be available on the ABB Corporate Research Scientific Publications website)
This presentation will describe to conference attendees the evolution and current status of the TSP Evaluation Framework (TSP-EF), an empirical approach being developed to measure how closely a Team Software ProcessSM project team is following all of the TSPSM and PSPSM principles and practices.
First publicly proposed at the 2004 TUG Conference, the TSP-EF supplements (does not replace) existing TSP coaching tools such as the Checkpoint script. It parallels, and builds upon, the three-part Extreme Programming Evaluation Framework (XP-EF) developed by Williams et al. in the agile world for measuring XP practices and results in industrial projects.
In the short term, the TSP-EF can provide a quantitative, consistent method for TSP coaches to measure which practices and principles of the TSP and PSP are actually being applied on their real-world projects, and to what extent.
For the long term, it will establish a basis for future statistical analysis of which specific context and adherence factors are most influential in achieving the high quality and improved predictability which TSP and PSP (properly used) can deliver.
The purpose of this session is to describe updates to the framework based upon feedback from the TSP-EF proposal session at TUG 2004, lessons learned from initial industrial trials of TSP-EF, and the resulting changes made to the framework. Feedback from TUG attendees will be solicited on:
- which context, adherence, and results factors should be included, or excluded, in the framework, based on their experiences;
- what specific measures should be used for various elements of the framework;
- how to make it easy for TSP coaches and team leaders to effectively apply the framework to guide continuous process improvement on their projects.