A “Competence in Practice” (CiPA) self assessment tool was developed initially as a research instrument as part of the Centre for Excellence in Teaching and Learning; Assessment and Learning in Practice Settings. The tool asks a series of questions against which participants self-rate their preparedness for practice. A working group then created software from this that is used as a formative exercise to rate confidence and perceived competence in practice. This freely available package (http://cipa.hud.ac.uk ) responds with feedback to individual users on their self evaluation, facilitating reflection and guided supervision. The development involved an innovative, collaborative partnership with academics and students, who undertook the work as a paid project as well as actively participating in workshops and conferences. Working collaboratively was a powerful experience for all involved. This case study presents the development of the tool, focusing on the collaborative aspects of the work. Working collaboratively with students in this manner enabled many positive outcomes and lessons for the future.