Evaluation methodology The evaluation took a methods approach. MCM delivered a range of program components that differed substantially in terms of their reach and level of engagement required on the part of participants, and catered not only for people with disability, their families and carers, but also for service providers and members of the public more generally. This diversity in program components and in the experiences of participants made a mixed methods approach not only appropriate but necessary. Therefore, the evaluation analysed various data sources using quantitative and qualitative methods. Previous stages of the evaluation involved interviews with participants, staff and workshop facilitators, direct observation of program events, and two online surveys. The previous Stage 3 report involved extensive qualitative research with staff members, including a workshop with MCM staff and interviews with MCM and ADHC staff, and MCM presenters involved across the range of MCM activities and supporting activities. This report draws on relevant results from these previous stages as well as several additional data sources. Program data The evaluation analysed several types of administrative data, including: Participant records Internal documentation Reports to the Board Financial statements. In addition, the evaluation considered a range of materials produced for program participants, including: Information sheets Workshop and course booklets Participant (“shared”) stories. These materials were available in hard copy or on the MCM website, which also hosted online courses. MCM staff also maintained an active social media presence. The evaluation reviewed both the content and the accessibility of the online materials. Online surveys SPRC carried out online surveys over the course of the evaluation, the focus of which changed as the evaluation progressed. The survey attempted to reach a broad group, including people who had not heard of MCM, in order to understand the potential audience for the program, and to identify needs within the community. This survey was hosted by the UNSW survey platform; MCM posted the link on its website and distributed it through its social media channels and online forums, as well as the research team’s disability mailing lists. Results from this survey were the subject of an interim report.
Evaluation methodology The evaluation took a methods approach. MCM delivered a range of program components that differed substantially in terms of their reach and level of engagement required on the part of participants, and catered not only for people with disability, their families and carers, but also for service providers and members of the public more generally. This diversity in program components and in the experiences of participants made a mixed methods approach not only appropriate but necessary. Therefore, the evaluation analysed various data sources using quantitative and qualitative methods. Previous stages of the evaluation involved interviews with participants, staff and workshop facilitators, direct observation of program events, and two online surveys. The previous Stage 3 report involved extensive qualitative research with staff members, including a workshop with MCM staff and interviews with MCM and ADHC staff, and MCM presenters involved across the range of MCM activities and supporting activities. This report draws on relevant results from these previous stages as well as several additional data sources. Program data The evaluation analysed several types of administrative data, including: Participant records Internal documentation Reports to the Board Financial statements. In addition, the evaluation considered a range of materials produced for program participants, including: Information sheets Workshop and course booklets Participant (“shared”) stories. These materials were available in hard copy or on the MCM website, which also hosted online courses. MCM staff also maintained an active social media presence. The evaluation reviewed both the content and the accessibility of the online materials. Online surveys SPRC carried out online surveys over the course of the evaluation, the focus of which changed as the evaluation progressed. The survey attempted to reach a broad group, including people who had not heard of MCM, in order to understand the potential audience for the program, and to identify needs within the community. This survey was hosted by the UNSW survey platform; MCM posted the link on its website and distributed it through its social media channels and online forums, as well as the research team’s disability mailing lists. Results from this survey were the subject of an interim report.
My_Choice_Matters_Evaluation_stage_4_and_final_reportd.docx