Abstract
In our work, two pilot studies radically changed the way in which data was to be gathered and interpreted i.e. the pilot studies were strongly rather than weakly formative. We report on these two pilot studies focusing on the key lessons learnt for empirical software engineering which include new ways of thinking about productivity and quality issues.