Co-designing an industry-academic postgraduate professional education framework for emergency nursing

This paper describes an evidence-based co-designed study with clinical-academic stakeholders from hospital and university settings. Hospitals and university providers in Australia invest signicant but separate resources for postgraduate curricula, resulting in duplication of curricula and resources in the health and higher education sectors. Methods Results Outcomes include matrices synchronising professional and regulatory imperatives of postgraduate nursing coursework; mutually-shaped curriculum content, teaching approaches and assessment strategies relevant for postgraduate education; a University-Industry Academic Integration Framework; ve guiding principles of postgraduate curriculum development for university-industry curriculum co-design; and a Graduate Certicate of Emergency Nursing curriculum exemplar.


Methods
Using emergency nursing as an exemplar, we co-designed an industry-academic postgraduate education framework that integrated the needs and resources of the health and higher education sectors to streamline postgraduate students' professional learning.

Results
Outcomes include matrices synchronising professional and regulatory imperatives of postgraduate nursing coursework; mutually-shaped curriculum content, teaching approaches and assessment strategies relevant for postgraduate education; a University-Industry Academic Integration Framework; ve guiding principles of postgraduate curriculum development for university-industry curriculum codesign; and a Graduate Certi cate of Emergency Nursing curriculum exemplar.

Conclusion
Industry-academic co-design can increase the relevance of postgraduate specialist courses in nursing, strengthening the nexus between both entities to advance learning and employability.

Background
In Australia, the health industry and the tertiary sector provide post-registration courses for emergency nurses [1]. These range from practical, competency-based shorter modules to specialty programs to longer courses that are mixed theory and practice, postgraduate degrees. Irrespective of whether a course is delivered by a hospital or a university, education providers have a common goal. That is, to promote students' higher-level learning, arming them with the knowledge and skills to work from a strong evidence base [2]. To serve this end, the Australian Quali cations Framework (AQF) Council operates as an advisory body to regulate all postgraduate offerings across Australia. Despite said aims, the signi cant but separate energies invested by industry and universities in postgraduate course design and delivery often results in the unnecessary duplication of content and resources [3]. Notwithstanding the global demand for postgraduate courses, evidenced for example by 1,700 United States universities offering Masters-level programs [4] and many institutions in the United Kingdom offering Graduate Certi cate and Doctoral Preparation courses [5], there are critical gaps in postgraduate offerings [3] in Australia. Courses offered by higher education providers (HEP) are based on industry need and are developed and delivered with signi cant industry input [6]. For example, in the Australian context postgraduate courses are overseen by course advisory committees with membership comprising of academics, key industry and professional organisation stakeholders [7]. However, these advisory committees are often implemented 'after the fact' -when university stakeholders have already undertaken most of the course design and often delivered it.
This study was a collaboration of academics and educators, clinicians, postgraduate emergency nursing students, administrators and nursing regulators.

Aim
Our aim was to be mutually involved from the beginning of course conceptualisation and design.
Collectively we sought to better harness current collaborations through the development of an industryacademic postgraduate education framework that integrated the goals of both the health industry and higher education sectors. This co-design process would ensure course credibility and relevance while maximising postgraduate students' professional learning.

Design
This evidence-based co-designed study involved three workshops (18 hours in total) offered in June and December 2016 and May 2017. These workshops were supplemented with iterative between-workshop email and personal consultation with participants. The study was informed by the evidence-based codesign approach in which collaborative collective creativity, which recognises diverse expertise, drives the development of purposeful enterprise that seeks to optimise end-user satisfaction and enhance product and process outcomes [8]. Exempli ed by Ogrin et al. [9], the human-centric collaborative approach aims to bring diverse stakeholder skills and contextual knowledge to product (in this case, curriculum) development and delivery through the development of knowledge and generation of mutually-agreed principles [8]. Participants, including stakeholders in leadership capacities as well as product and process consumers, generate insight and are supported by key designers, researchers and leaders in establishing partnerships to effect sustainable educational change.

Participants
Purposive sampling ensured key participants were included. These were the Chair, National College of Emergency Nursing Australasia (CENA) Credentialing Committee, CENA Queensland President and other representatives of CENA; university-based curriculum experts, emergency nursing course coordinators and past and present postgraduate curriculum directors from the two partner universities; past and present postgraduate students of the two partner universities; emergency nursing educators and clinicians from six metropolitan hospitals in Brisbane; the Executive Directors of Nursing from Metro South and North, Directors of Nursing and Directors of Nursing Education from the partner health services; and one credentialing expert from the O ce of the Chief Nursing and Midwifery O cer Queensland.

Setting
The study was conducted at two health services and two university settings. These settings represent two major metropolitan universities providing postgraduate nursing education courses with student enrolments across Australia and two major health services in South East Queensland providing quaternary-level emergency health care services. Emergency nursing was selected to be the focus of the study as emergency postgraduate courses were well enrolled in both university partners. Further, these settings were chosen for the existing close collaborative relationships and partners who showed the initiative to take postgraduate curriculum design to a new level.

Data Collection
This study used co-design method, therefore a range of strategies during and after the workshops were used to generate data. The workshops were part of an iterative process with Workshop 1 informing Workshop 2, which in turn informed Workshop 3.

Within the workshops
The workshops methodically explored topics including enablers and barriers to industry-academic mutual development and delivery of postgraduate curricula; the conditions of postgraduate industry-academic engagement; compulsory content of postgraduate emergency nursing curricula across settings; and relevant teaching, learning, assessment and quality assurance approaches. Proactive partnerships were promoted in the workshops by focusing on the participants' common goals. We aimed for reciprocal and co-operative communication processes. In each workshop we used these strategies to establish a common identity as an educational 'community of practice' for postgraduate emergency nursing students -a community that aimed to negotiate a pathway for the joint development and potential delivery of a postgraduate emergency nursing course.
Consistent with evidence-based co-design approaches we explored the interface between students, regulatory bodies, universities and health services that customarily have different (but not mutually exclusive) educational goals and tend to operate under different (but not mutually exclusive) norms and performance indicators. Each workshop was led by one Chief Investigator; other Chief Investigators were embedded with participants to organise and summarise group outputs.
The rst workshop, exempli ed by Step 1 of the guiding principles for postgraduate curriculum transformation model (Fig. 1), established the agreed evidence for development of the University-Industry Integration Framework (Fig. 2) and envisaged a mutual understanding of the conceptual goal: "What sort of postgraduate nursing clinician do we want to produce?" In workshop two (December 2016), matrices (Tables 1 and 2) were mutually developed that described synchronisation of professional and regulatory imperatives. This included partnerships and collaborative enterprise across the health and university sectors informed by a feasible business model that met student, industry and professional needs. In the nal workshop (May 2017), the Framework (Fig. 2), guided by distributed leadership with mutuallydetermined, fully-articulated, t-for-purpose roles for each stakeholder, was nalised.   Data collection activities included evidence-based co-design techniques such as ice-breaking sessions, small and large group brainstorming, group generation of themes using post-it notes and buzz groups. With the agreement of participants, written outputs of group work, such as mind maps, were retained and intensive eld noting of verbal outputs based on informal interviews was undertaken by a Chief Investigator during each workshop. Other research team members made eld notes while facilitating break-out groups and also provided group-approved summaries of key points, which were included in the analysis. Due to the highly interactive nature of workshops and number of participants, it was not useful to audio-record the proceedings.

Post-Workshop
Post-workshop emails were sent to all participants requesting feedback and input on workshop summaries, materials and outcomes, including questions with reference to the literature. Five current students provided feedback on materials that were developed from the three workshops between May and June 2017. Past students also contributed to Workshops 1 and 3. After the workshops, two focus groups were conducted with ve students from two different universities, who were enrolled as internal and external students. Two students met with one researcher individually for a 35-minute interview.

Data analysis
The workshops, follow-up consultations, focus groups and interviews generated qualitative data.
Analysis of these data was iterative, moving from initial codes to researcher-created ideas and the formation of themes. The analysis moved from descriptive to abstract analytical concepts and culminated in two main themes [10]. The process was led by two experienced qualitative researchers and involved ongoing dialogue with all researchers with an awareness of testing validity through the interpretations generated [10].

Results
The number of participants able to attend all or part of each workshop was in uenced by clinical demands at the time and ranged from nine (Workshop 3), to 16 (Workshop 2) and 21 (Workshop 1).
The data formed eight categories that fell within two main themes. These two themes are summarised in the two matrices presented in Tables 1 and 2 (Table 2) systematically articulates the remaining six categories. These cover the principles and processes that should be thought-out when developing and delivering emergency nursing curricula. These include good practice principles of professional learning; types of professional learning; stakeholder terms of engagement; scaffolding of teaching and learning; harnessing the diverse contexts of learning; and assuring course quality. The data were also drawn on to develop an interim framework (Fig. 2). The categorised data were also provided to participants for review and feedback.
The two matrices aligned the postgraduate emergency nursing education goals and curriculum development processes of the local health care industry, national health care regulators and national higher education bodies, as well as the professional learning and credentialing needs of students and their employers. A robust thread running through both themes was the importance of work-integrated learning to prepare postgraduate students for practice. The culmination was mutual agreement of an operational framework to optimise learning of emergency nursing based on an academic-industrystudent collaborative approach (Fig. 2) as well as the creation of a graduate certi cate in emergency nursing curriculum exemplar. This led to establishment of principles to guide future curriculum development, implementation and evaluation.
Five guiding principles (Fig. 1) of curriculum development, implementation and evaluation were then established to inform the processes subsequently used in the study. Bene cial in the establishment, maintenance and development of a co-curricular distributed leadership partnership, the principles demarcate and represent the evolutionary steps involved in moving through design and creation phases to achieving capability with tangible outcomes and future direction. Emerging from curriculum development milestones and processes undertaken during the workshop series, the principles articulate the architecture of collaborative, linear and iterative scaffolded processes through which participants can transition while designing and constructing sustainable and suitable curricula. As such, a key outcome of Workshop 3 was the nalisation of a clinical-academic integration strategy and framework construction. This resulted out of a consortium approach of distributed leadership and jointly-determined, fullyarticulated, t-for-purpose roles for industry, university and student roles -the third principle.
However, to achieve capability, it was determined that respectful relationships between industry and academe must be maintained, and that a liations that embedded joint mentoring and capacity building processes must be established. This would ensure a viable longer-term teaching and learning community of practice. To ensure robust development and delivery, successful postgraduate curriculum transformation also relies on health sector engagement in appropriately-resourced academic activity. These were the nal two guiding principles, delineated with the intention of providing future recommendations. The adoption of ve guiding principles potentially supports the sustainable implementation of co-curricular partnerships.
Matrix 2 ( Table 2) captures expectations of the various stakeholders with respect to learning and teaching quality and enhancing student employability. The participants considered it essential that all stakeholders understand and articulate the good practice principles of nursing curriculum development and delivery before they determine teaching and learning processes. Participant summaries generated through workshops are represented in Table 2 and Figs. 1 and 2.
Process issues were also important for participants, as summarised in Matrix 2. They encouraged stakeholders to formulate agreed terms of engagement from the outset. For example, explicit discussions occurred about who should be involved in the professional learning agenda, how to identify and resolve health service, university, credentialing and regulatory issues, articulation of enablers, barriers and solutions to engagement, the most desirable timing and format of joint communications, and how best to enact distributed leadership taking place before course development. It was also considered important to tease out technical issues, such as how best to scaffold learning. Participants further identi ed that workable cross-institutional ways of ensuring learning and teaching standards and undertaking mutual peer review and moderation were essential to ensure courses met student needs. While resolution of these issues was beyond the scope of this particular study, these notions certainly warrant further research as to how they might be achieved.

Graduate Certi cate Of Emergency Nursing Curriculum Exemplar
In harmonisation with the principles and objectives that transpired through creation of a framework, an exemplar Graduate Certi cate of Emergency Nursing was developed. Key facets were also delineated as part of the second matrix. It is positioned as a course outline that can be used by any health service or university, an instrument that guides the development of learning and teaching strategies and curriculum content [11].

A Fit-for-purpose University-industry Integration Framework
An important issue identi ed during workshops was the need to harmonise regulatory and other imperatives, while ensuring that course content and level of learning are congruent with the student's target level of nursing practice. In essence, the course should overtly and systematically prepare the nurse for either specialty emergency practice, advanced emergency nursing practice or for a nurse practitioner position. Participants further identi ed that postgraduate education is often undertaken to enhance employability. Hence, successfully-completed courses should readily help students to progress through the levels of practice embodied in the nursing career structure. Workshop consensus was that to ensure harmonisation and to assist career progression, a unifying model of nursing practice that accurately re ects the target practice pro le and maps to the career pathway is needed. This would underpin all postgraduate courses, irrespective of whether they are offered by universities or health services. Subsequently, a university-industry integration framework (Fig. 2) was developed, to represent the structures, processes and outcomes required in developing and delivering postgraduate nursing courses that are co-created in university-industry partnerships.

Discussion
The most important nding arising from this study was the overwhelming desire for industry to be involved in all aspects of university postgraduate emergency course development and for universities to likewise be involved in courses developed and delivered by industry (Fig. 2). Traditionally stakeholder involvement in course advisory committees provides a controlled environment for engagement, yet in this project, co-design enabled a more equal playing eld of all stakeholder contributions. The emphasis all participants placed on mutual involvement was signi cant, but deliberations indicated that currently, it is not well-operationalised. This is despite the fact that tertiary education in Australia is regulated by the Tertiary Education Quality Standards Agency (TEQSA) [12] stipulate that universities engage regularly with course advisory committees comprising industry stakeholders to ensure the relevance and currency of their curricula. Similarly, health services often seek university advice to ensure the congruence of their professional development offerings with AQF Level 8 courses to provide a postgraduate articulation pathway for their emergency nursing students. Graduate Transition Programs offered in Queensland, Australia are good examples. These hospital-based programs deliver an entry to specialty program to newly-graduated/employed registered nurses, which can often be credited towards university study [7].
However, discussions during workshops clearly indicated that while both universities and hospitals do seek input from the other, this tends to occur when courses are already conceptualised and largely developed. In contrast, Henderson and Creedy [13] argue that the best student learning experiences occur when clinical content, context and teaching approaches are negotiated from the beginning of course development.
Consistent with the literature [14], [15], [16], [17] the data indicated that it was important to have a range of professional learning experiences and related assessment methodologies (e.g., industry case studies, simulation, industry mentoring, industry placements) within curricula and adapted to context. Workintegrated learning and assessment for a rural emergency nurse, for example, might be made most relevant if metropolitan placements, or video-conferenced simulations, are embedded. As presented in Matrix 1, the educational value of learning-in-place warrants explicit acknowledgment within university postgraduate nursing curricula [18]; however, workplaces should also understand both what students bring to work-integrated learning placements and what they need from the workplace to maximise their learning [19].
The risk of universities providing sub-standard learning experiences for nurses without deep industry engagement was also highlighted in this study. This is corroborated by Australian research in the higher degree context, which clearly demonstrated the ill-preparedness of graduate and postgraduate students for the 'world of work' [16], [20]. Substantial evidence from multiple practice disciplines further indicates that deep learning can only occur if industry and disciplinary bodies are explicitly engaged in university course development and delivery [6]. Mutually determined work-integrated learning approaches appear to be the best way to enable authentic learning environments [16], [6], [21]. Hence, Matrix 2 is anchored in principles such as ensuring industry referencing throughout course development and delivery; initiating and sustaining collegial relationships; properly resourcing industry involvement in curricula; fully understanding the students' learning needs by involving them in course development; and ensuring that curriculum currency is maintained.
The ve guiding principles created from this study are starting points for those looking to co-design and implement a postgraduate curriculum in partnership. Our experiences of industry and academe working respectfully and collectively culminated in shared outcomes grounded in these principles. Further, the value that all participants placed on integrating workplace-based learning into university courses targeting domain-speci c and advanced practice nurses [22], as well as nurse practitioners [23], warrants consideration. Sociocultural theories of workplace learning propose that optimal learning outcomes are the result of students' active participation in clinical activities during their study, coupled with their 'reallife' learning interactions with the complex and dynamic clinical work environment [19], [14], [24]. Hence, alignment of the industry-academic agenda through well-designed work-integrated learning and assessment experiences increases the relevance of postgraduate courses in emergency nursing ( Table 2).
The co-designed Graduate Certi cate of Emergency Nursing exemplar developed during this study encompasses the requirements of industry and aims to provide students with quality learning and useable course outcomes. It embraces the imperatives and mutual goals of both industry and universities, while harmonising diverse pedagogical approaches. Devised as a means of strengthening industry-university collaboration, it serves to bridge the current gap between practical capabilities and theoretical scaffolding of learning (re ective of AQF compliance), while meeting the regulatory requirements of the Nursing and Midwifery Board of Australia [22], [25]. This study has highlighted the potential of an industry-academic agenda increasing the relevance of postgraduate specialist courses in health, reinforcing the connection between industry and higher education to promote postgraduate learning and employability. It is one of the few studies to do so. In the future, we hope to test the Framework formally, along with its emergency nursing exemplar. The aim is to ensure the transparency of the Framework, promote sustainability of the embedded principles, develop and operationalise joint governance processes and support continuing development of such educational partnerships.

Limitations Of The Study
We acknowledge the lack of generalisability of this study's ndings, namely that the ndings are contextspeci c to health services and universities involved. However, given the depth of participants' background, from clinical care to professional organisation and academic representatives, we suggest that our framework is considered, it can be adapted to other postgraduate nursing contexts.

Conclusions
This study presented a joint exploration of strategies to design nursing curricula, with the objective of producing work-ready postgraduates who bene t from a thoughtful blend of clinical and university learning experiences. We also illuminated the role of local hospitals and universities in preparing registered nurses for specialist employment and explored how to embed these ideas within curricula using the exemplar of postgraduate emergency nursing. Consensus from the workshops indicates that in the ideal scenario, the framework could be used by local health services and universities to guide their joint development of courses, where work-integrated university-level teaching and learning are embedded.
The framework exempli es a spirit of consultation and collaboration, valuing student voice that could usefully guide future joint curriculum development and delivery in other postgraduate nursing specialities.  Guiding principles for postgranduate curriculum transformation