Table 4 Feedback from usability testing (n = 10) and revisions to prototype tool

Clarify target audience and level of knowledge required to use tool

After round 2:

–Clarified target audience on homepage.

–Added link from homepage to glossary to define: “theory”, “model”, “framework” and “implementation practice activities”.

Give users better idea of what to expect when completing tool for first time

After round 1:

–Added link from homepage to information on how to use tool.

–Created overview figure showing number of steps and output for inclusion on homepage, questions page and results page.

After round 3:

–Incorporated numbering and used colour to better link tool questions to overview figure.

After round 4:

–Included case study with scenario and screenshots of tool.

Show user’s response to question 1 (What is the purpose or goal of your implementation project?) on screen while completing tool

After round 1:

–Changed presentation of tool questions from one question per page to accordion-style format with all questions presented on single page.

–Added summary box to results page to display user’s answers to tool questions.

Clarify that users may need to complete tool more than once, depending on needs

After round 1:

–Revised help icon instructions for question 2 (What are you looking for guidance on?).

–Clarified instructions on how to use tool page.

Too many TMFs in results table

After round 2:

–Revised tool algorithm and question 2 (What are you looking for guidance on?) to restrict tool to models and/or evaluation frameworks, with option to download list of theories and determinant frameworks.

–Added three new columns to output table with TMF year, whether TMF is model or framework and target change level.

Provide more guidance to users on what to do with tool output and table functionality

After round 2:

–Clarified instructions on results page and added direct links to glossary and to complementary tools.