recommendation 2 of the february 2012 report engage to excel from the president s council of advisors on science and technology ( pcast , 2012 ) urges the science , technology , engineering , and mathematics ( stem ) education community and funding agencies to  advocate and provide support for replacing standard laboratory courses with discovery - based research courses . 
the report justifies this recommendation as follows : traditional introductory laboratory courses at the undergraduate level generally do not capture the creativity of stem disciplines .
they often involve repeating classical experiments to reproduce known results , rather than engaging students in experiments with the possibility of true discovery .  engineering curricula in the first two years
recently , research courses in stem subjects have been implemented at diverse institutions , including universities with large introductory course enrollments .
these courses make individual ownership of projects and discovery feasible in a classroom setting , engaging students in authentic stem experiences and enhancing learning and , therefore , they provide models for what should be more widely implemented .
v ) traditional introductory laboratory courses at the undergraduate level generally do not capture the creativity of stem disciplines .
they often involve repeating classical experiments to reproduce known results , rather than engaging students in experiments with the possibility of true discovery .
 engineering curricula in the first two years have long made use of design courses that engage student creativity .
recently , research courses in stem subjects have been implemented at diverse institutions , including universities with large introductory course enrollments .
these courses make individual ownership of projects and discovery feasible in a classroom setting , engaging students in authentic stem experiences and enhancing learning and , therefore , they provide models for what should be more widely implemented .
v ) this recommendation has engendered wide discussion and motivated formation of a committee at the national academies of sciences , engineering , and medicine to organize a convocation to explore opportunities and challenges of developing , implementing , and sustaining course - based undergraduate research experiences ( cures ) , one mechanism for reaching large numbers of undergraduates .
this column reviews the considerations leading up to the may 2015 convocation and summarizes the report that emerged ( national academies of sciences , engineering , and medicine , 2015 ) . emerging evidence ( cited in the pcast report and elsewhere )
indicates that engaging students in research as early as possible during their undergraduate years is one of the best strategies for supporting and retaining undergraduates in stem . until recently ,
undergraduates have primarily participated in research through apprenticeships , wherein an individual faculty member ( or one of their graduate students or postdoctoral fellows ) supervises the work of one or several students .
apprenticeships can be beneficial and even life and career changing for many students , yet their one - on - one design inherently limits the number of students who can participate . providing all beginning stem students with an individualized mentored research experience in an apprentice - style program is not possible , given the large numbers of students .
faculty members ( and other potential mentors from industry or elsewhere ) have limited time , space , and resources to support undergraduates in their research activities .
most institutions have allocated only enough human and financial resources to involve a small fraction of their undergraduates in such experiences ( pcast , 2012 ) .
students who seek out such positions are generally those who are already interested in research .
competition for a limited number of slots excludes many students , including students who have little knowledge of science career structures or who may not have performed well in traditional academic studies but who are capable of engaging in a research experience . for all of these reasons ,
students from populations historically underrepresented in stem fields may especially be precluded from gaining an apprentice - style research experience ( e.g. , national research council 2007 , 2011 ; locks and gregerman , 2008 ; national academies of sciences , engineering , and medicine , 2016 ) .
the pcast report urges that access to a research experience during the undergraduate years should be seen as a pedagogical necessity for all students rather than a privilege for a small number of undergraduates . acting on this recommendation ,
many undergraduate stem educators have been experimenting with different strategies for engaging more students in research experiences .
there are now a number of different tested and emerging models available , and their successes suggest that this broad goal can be achieved through cures .
these are occurring both in laboratories associated with lecture courses and in stand - alone laboratory courses , using on - campus , off - campus , and online resources .
a cure allows undergraduates to engage in research either collectively or individually as part of a regularly scheduled course .
recent efforts have been aided by the web , which can provide access to large data sets in topics from genomics to environmental monitoring , remote access to research - grade instruments , access to the scientific literature , and the means to build project consortia and to link student and faculty researchers at dispersed sites .
if appropriately constructed , managed , and mentored , cures may be able to provide students with many of the same benefits acquired from summer apprentice - style research experiences ( e.g. , shaffer et  al . ,
2014 ) . but cures also may provide additional advantages : 
 by exposing more students to research and the nature of science earlier in their academic career , they can encourage students to explore the nature of various stem topics and careers not otherwise considered.course-based approaches may be a more effective and accessible starting point for many students , including minority , low - income , and first - generation college students ( bangera and brownell , 2014).faculty members may be able to undertake research that would otherwise be difficult or impossible ( e.g. , leung et  al .
, 2015 ; pope et  al . , 2015).cures can provide all participating students with a greater ability to use scientific thinking in other aspects of their lives . by exposing more students to research and the nature of science earlier in their academic career
, they can encourage students to explore the nature of various stem topics and careers not otherwise considered .
course - based approaches may be a more effective and accessible starting point for many students , including minority , low - income , and first - generation college students ( bangera and brownell , 2014 ) . faculty members may be able to undertake research that would otherwise be difficult or impossible ( e.g. , leung et  al . , 2015 ; pope et  al . , 2015 ) .
cures can provide all participating students with a greater ability to use scientific thinking in other aspects of their lives .
however , large - scale undergraduate research , especially for first- or second - year students , is not yet the norm on most campuses , particularly at those institutions with more traditional views of classroom teaching and reward and incentive systems or those with little or no on - site research . to make this recommendation from pcast a reality , faculty and administrators need to be convinced of the feasibility , efficacy , cost efficiency , student benefits , and overall value of the approach .
because so many questions remain to be addressed regarding cures , the board on life sciences , in collaboration with the board on science education of the national academies of sciences , engineering , and medicine received support from three private foundations ( see acknowledgments ) to develop an initiative that could further explore and elucidate the opportunities , barriers , and realities of cures as a potentially integral component of undergraduate stem education . in response ,
a two - day national convocation was organized by a committee appointed by the national academies and was held in washington , dc , from may 11 to 13 , 2015 .
participants explored the following questions : what models have been developed to engage larger numbers of undergraduates in research using an academic year course - based format ?
is this general strategy viable for all stem disciplines and all class levels , from freshman to senior ?
are minority - serving institutions participating , and are these models effective in reaching underrepresented students?is the evidence base currently robust enough to identify best practices for implementation , considering different goals and different approaches ?
what are the most important challenges?can these best practices serve as drivers of institutional cultural change , tackling some of the present barriers to access , and are there examples where they have done so?is it possible to scale up to all students , without losing essential elements of the research experience?how do we promote and insure access and equity for all students in such initiatives?can we recommend best practices for dissemination , for  start - up  support ?
what are the most cost - effective strategies?can a shared research agenda help resolve some of these questions ? what models have been developed to engage larger numbers of undergraduates in research using an academic year course - based format ?
is this general strategy viable for all stem disciplines and all class levels , from freshman to senior ?
are minority - serving institutions participating , and are these models effective in reaching underrepresented students ?
is the evidence base currently robust enough to identify best practices for implementation , considering different goals and different approaches ?
what are the most important challenges ? can these best practices serve as drivers of institutional cultural change , tackling some of the present barriers to access , and are there examples where they have done so ?
is it possible to scale up to all students , without losing essential elements of the research experience ? how do we promote and insure access and equity for all students in such initiatives ?
can we recommend best practices for dissemination , for  start - up  support ?
a common theme  equity and access issues for all students , with an emphasis on students from those populations that historically have been underrepresented in stem  was emphasized throughout the convocation .
the presentations and discussions that occurred at this convocation resulted in a summary report ( figure 1 ) .
the organizing committee selected 12 existing cures , presented as case studies , and others were described during the panel discussions ( table 1 ) ; these provide insights into the use of this strategy in a variety of settings , highlighting opportunities and challenges encountered .
david lopatto , grinnell college , which focuses on assessment issues and is included as an appendix in the report .
all participants also were invited to display posters of their work on course - based research opportunities , and the posters remained available throughout the event .
thus , the convocation created a rich compendium of reference materials on cures brought together in the report and on the website , both of which are freely available .
case studies presented in the report by name , discipline , focus , and reach ( individual faculty vs. national partnerships ) in this feature , the authors describe activities at the national academies aimed at understanding models and mechanisms for engaging undergraduates in research at scale and identifying the current state of knowledge and practice related to undergraduate research .
we hope that the convocation report will stimulate broader conversations about the role of undergraduate research experiences for all students in undergraduate stem education .
accordingly , the three foundations that supported the convocation also have provided financial support for follow - up dialogue through workshops at meetings of various scientific societies , including the american society for cell biology and the genetics society of america .
the convocation , publication , and follow - up dialogue are all helping to inform a larger , more in - depth national academies consensus study on undergraduate research experiences , including all mechanisms  cures , apprentice models , internships , and others .
that study is being supported by the national science foundation s division of undergraduate education .
multiple themes emerged during the convocation , including those laid out by the committee ( see bullet points above ) and others raised by other participants . an important topic throughout the convocation was the critical characteristics of cures .
dr . david asai from the howard hughes medical institute proposed that students should know that they are engaged in working on a real scientific problem , that their work matters to the community , and how their discoveries are contributing to the field . according to asai
, cures should permit students to encounter and confront problems that are important and timely ; their work should contribute to advancing or refining knowledge , rather than simply repeating or 
rediscovering  something that is already known . how to structure cures that can help students advance to this level of discovery , particularly students who enroll in cures early in their undergraduate careers and
may have only a single exposure to this kind of experience , engendered a great deal of discussion . in his address as the keynote speaker at the convocation , dr .
james gates , professor of physics at the university of maryland , college park , a member of the national academy of sciences and cochair of the committee that authored engage to excel ( pcast , 2012 ) , provided a historical perspective of the relationship of research in science and technology to the nation s economy and well - being ( chap . 2 of convocation report ) . during the latter half of the 19th century and most of the 20th century , average educational levels in the united states were higher than in other countries , which he argued fueled the economic engine of this country .
educational levels of people in the united states are now lower than those in most other developed countries , and median household income has fallen , especially during the past 30 yr . given the increase in available information and changes in the nature of work , gates argued that today s workers will need to continually relearn and retool their skills over their working lifetimes .
he emphasized and provided details about how emerging approaches to education , including efforts to allow larger numbers of students to engage in discovery - based research , can help meet the expanding need for workers trained in stem fields .
a plenary session focused on what emerging research indicates about the efficacy of cures on several levels .
student and faculty enthusiasm for cures is , at present , largely based on student reports of learning gains and satisfaction with the experience ( auchincloss et  al . , 2014 ;
corwin et  al . , 2015 ; linn et  al . , 2015 )
however , there are some well - documented studies showing that research experiences improve retention in the sciences ( e.g. , locks and gregerman , 2008 ; estrada et  al . , 2011 ; schultz et  al . , 2011 ;
eagan et  al . , 2013 ; summarized in corwin et  al . , 2015 ) , and
cure assessments that use multiple indicators of student learning and program efficacy can provide greater insights concerning achievement of desired learning goals and affective behaviors of students and can offer guidance when starting new courses ( corwin et  al .
, 2015 ; linn et  al . , 2015 ) ; more research of this type is needed .
many cures are designed by individual faculty to align with their own research interests , an approach that has many benefits but results in assessments that are idiosyncratic and difficult to compare ( lopatto , 2010 ; linn et  al . , 2015 ) .
in contrast , a group of coordinated national efforts ( table 1 ) have attempted to address these issues by using common assessments , and some positive results have been reported ( jordan et  al .
speakers pointed out that collaborative projects and/or cooperatives of schools with common program goals and common sets of activities can develop a common set of metrics , providing unique opportunities for assessing their efforts .
moreover , speakers noted the potential for partnerships among state systems of higher education and public and private consortia for fostering the acceptance and institutionalization of research - based courses .
a great deal of discussion at the convocation centered on issues of resources and costs of cures compared with more traditional teaching laboratories or apprentice - based models of research participation .
there are surprisingly few data available on relative costs , and where available , most of the information is incomplete ; for example , faculty are often not compensated for mentoring students under the apprenticeship model , so this cost is not recorded , but will be compensated for teaching a cure .
if cures can be demonstrated to increase retention of students , either in stem or more broadly at the institution , the money from those students tuition can financially justify the strategy .
several presenters noted that research - based courses were powerful recruiting and retention tools for the departments or colleges that offer them .
several presenters reported that costs for running cures , even if slightly more expensive than traditional labs , could be borne by students through a small increase in lab fees .
however , undergraduates who participated in the convocation pointed out that even a small increase in fees can be a much larger amount if included in high - interest student loans and could make a difference in their decision to enroll in a discovery - based lab course versus a more traditional one .
some people claimed that the cures they designed were less expensive ; techniques such as dna barcoding and synthetic biology open up many avenues at modest cost .
several presenters emphasized that costs for cures can be reduced by taking advantage of local resources and partnerships .
further , every campus needs to collect and analyze data on the operation of their physical plant , on the use of services , and so on , and students can be engaged in the effort .
for example , california state university s recent initiative ,  the campus as a living laboratory ,  and student research undertaken with the university of wisconsin s food services to better understand food use and waste by students were both described .
some of the costs recovered can be directed back into the student research program ( cathy middlecamp , university of wisconsin  madison , personal observation ) .
the convocation provided many examples of how to restructure a given course as a cure , but we have little experience in  scaling up  these efforts . expanding such efforts to all sections of a course or most courses within a department may seem desirable , but the logistics and infrastructure required to do so may seem prohibitive . a great deal of discussion during the convocation thus focused on issues of scaling up of cures . because appropriate mentoring is hard to provide for large numbers , it was pointed out by david shaffer ( university of wisconsin  madison ) that virtual internships ( online challenges that prompt students to take action on a complex problem , reflect on their action , and develop ways of thinking about real - world practice ) can enable many more students to participate , reaching more students than would be possible through internships in which students must be at the site of the internship to participate .
however , several universities ( e.g. , university of minnesota  twin cities , university of texas  austin ; table 1 ) are expanding wet - bench cures by organizing multiple research 
streams ,  among which a student can choose , using a hierarchical mentoring system .
a parallel in engineering is the vertically integrated projects program , described by edward coyle ( georgia tech ) , in which senior students contribute to mentoring beginning students ( table 1 ) .
several convocation speakers indicated that research - based courses can help a broad range of students decide whether they would like to pursue additional research opportunities , arguing that at least one such course should be mandatory for all students .
mandatory participation ensures that students who may lack the confidence to pursue such pathways on their own are able to do so ( bangera and brownell , 2014 ) .
however , requiring a research experience also means that some students may feel that they are being forced into something they do not want ; the undergraduates present at the convocation noted that students who are working hard to maintain or increase their grade point average may be wary of a process in which the probability of failure may be high and course grades are not based on the usual criteria . hence , for some students , an effort must be made to show them how a research experience will benefit them . in a panel on institutional strategies , goldie byrd ( north carolina a&t state university ) pointed out that department chairs , deans , and other administrators can support cures by actively promoting faculty professional development in teaching and mentoring and by supporting faculty time used to develop a cure .
the construction of new instructional spaces or the reconfiguration of existing spaces for cures also offers opportunities to change the culture of teaching and learning , as seen in the new interdisciplinary science learning laboratories at the university of delaware and described by john jungck .
efforts toward the establishment of endowments and special funds can send powerful signals to faculty , students , regents , and parents about the value of this kind of work .
for those campuses undertaking or contemplating major curricular reforms , open consideration of investing in cures may provide opportunities to rethink the integration of research into undergraduate education and to retool the reward system for faculty , a major change strategy utilized by the city university of hong kong and described by arthur ellis .
closing remarks stressed that the creation of new knowledge is a major function of universities . by welcoming students into this effort
, we make them our partners and provide a sense of belonging in this field . as robin wright said in describing the freshman program at the university of minnesota , 
we re talking to them as if they are emerging professional biologists , and we treat them as colleagues . 
teaching stem by having students do research can be viewed as an active - learning strategy  and there is considerable evidence that active - learning strategies work ( e.g. , freeman et  al . , 2014 ) .
the convocation closed with enthusiasm for using cures to expand research opportunities to all students .
jim gentile , now at the university of arizona , concluded that  undergraduate research is quality education . 
collectively , the speakers and discussions engendered enthusiasm for several elements related to cures , and we hope that this report will be useful for those faculty and schools thinking about or planning to expand the use of cures in their curriculum .
a plenary session focused on what emerging research indicates about the efficacy of cures on several levels .
student and faculty enthusiasm for cures is , at present , largely based on student reports of learning gains and satisfaction with the experience ( auchincloss et  al . , 2014 ;
corwin et  al . , 2015 ; linn et  al . , 2015 )
. however , there are some well - documented studies showing that research experiences improve retention in the sciences ( e.g. , locks and gregerman , 2008 ; estrada et  al . , 2011 ;
schultz et  al . , 2011 ; eagan et  al . , 2013 ;
summarized in corwin et  al . , 2015 ) , and several case studies presented at the convocation reported positive impacts .
cure assessments that use multiple indicators of student learning and program efficacy can provide greater insights concerning achievement of desired learning goals and affective behaviors of students and can offer guidance when starting new courses ( corwin et  al .
, 2015 ; linn et  al . , 2015 ) ; more research of this type is needed .
many cures are designed by individual faculty to align with their own research interests , an approach that has many benefits but results in assessments that are idiosyncratic and difficult to compare ( lopatto , 2010 ; linn et  al . , 2015 ) .
in contrast , a group of coordinated national efforts ( table 1 ) have attempted to address these issues by using common assessments , and some positive results have been reported ( jordan et  al . , 2014 ; shaffer et  al . , 2014 ) .
speakers pointed out that collaborative projects and/or cooperatives of schools with common program goals and common sets of activities can develop a common set of metrics , providing unique opportunities for assessing their efforts .
moreover , speakers noted the potential for partnerships among state systems of higher education and public and private consortia for fostering the acceptance and institutionalization of research - based courses .
a great deal of discussion at the convocation centered on issues of resources and costs of cures compared with more traditional teaching laboratories or apprentice - based models of research participation .
there are surprisingly few data available on relative costs , and where available , most of the information is incomplete ; for example , faculty are often not compensated for mentoring students under the apprenticeship model , so this cost is not recorded , but will be compensated for teaching a cure .
benefits are also difficult to monetize . however , if cures can be demonstrated to increase retention of students , either in stem or more broadly at the institution , the money from those students tuition can financially justify the strategy .
several presenters noted that research - based courses were powerful recruiting and retention tools for the departments or colleges that offer them .
several presenters reported that costs for running cures , even if slightly more expensive than traditional labs , could be borne by students through a small increase in lab fees .
however , undergraduates who participated in the convocation pointed out that even a small increase in fees can be a much larger amount if included in high - interest student loans and could make a difference in their decision to enroll in a discovery - based lab course versus a more traditional one .
some people claimed that the cures they designed were less expensive ; techniques such as dna barcoding and synthetic biology open up many avenues at modest cost .
several presenters emphasized that costs for cures can be reduced by taking advantage of local resources and partnerships .
further , every campus needs to collect and analyze data on the operation of their physical plant , on the use of services , and so on , and students can be engaged in the effort .
for example , california state university s recent initiative ,  the campus as a living laboratory ,  and student research undertaken with the university of wisconsin s food services to better understand food use and waste by students were both described .
some of the costs recovered can be directed back into the student research program ( cathy middlecamp , university of wisconsin  madison , personal observation ) .
the convocation provided many examples of how to restructure a given course as a cure , but we have little experience in  scaling up  these efforts . expanding such efforts to all sections of a course or most courses within a department may seem desirable , but the logistics and infrastructure required to do so may seem prohibitive . a great deal of discussion during
because appropriate mentoring is hard to provide for large numbers , it was pointed out by david shaffer ( university of wisconsin  madison ) that virtual internships ( online challenges that prompt students to take action on a complex problem , reflect on their action , and develop ways of thinking about real - world practice ) can enable many more students to participate , reaching more students than would be possible through internships in which students must be at the site of the internship to participate .
however , several universities ( e.g. , university of minnesota  twin cities , university of texas  austin ; table 1 ) are expanding wet - bench cures by organizing multiple research  streams ,  among which a student can choose , using a hierarchical mentoring system .
a parallel in engineering is the vertically integrated projects program , described by edward coyle ( georgia tech ) , in which senior students contribute to mentoring beginning students ( table 1 ) .
several convocation speakers indicated that research - based courses can help a broad range of students decide whether they would like to pursue additional research opportunities , arguing that at least one such course should be mandatory for all students .
mandatory participation ensures that students who may lack the confidence to pursue such pathways on their own are able to do so ( bangera and brownell , 2014 ) .
however , requiring a research experience also means that some students may feel that they are being forced into something they do not want ; the undergraduates present at the convocation noted that students who are working hard to maintain or increase their grade point average may be wary of a process in which the probability of failure may be high and course grades are not based on the usual criteria . hence , for some students , an effort must be made to show them how a research experience will benefit them . in a panel on institutional strategies , goldie byrd
( north carolina a&t state university ) pointed out that department chairs , deans , and other administrators can support cures by actively promoting faculty professional development in teaching and mentoring and by supporting faculty time used to develop a cure .
the construction of new instructional spaces or the reconfiguration of existing spaces for cures also offers opportunities to change the culture of teaching and learning , as seen in the new interdisciplinary science learning laboratories at the university of delaware and described by john jungck .
efforts toward the establishment of endowments and special funds can send powerful signals to faculty , students , regents , and parents about the value of this kind of work . for those campuses undertaking or contemplating major curricular reforms , open consideration of investing in cures may provide opportunities to rethink the integration of research into undergraduate education and to retool the reward system for faculty , a major change strategy utilized by the city university of hong kong and described by arthur ellis .
closing remarks stressed that the creation of new knowledge is a major function of universities . by welcoming students into this effort
, we make them our partners and provide a sense of belonging in this field . as robin wright said in describing the freshman program at the university of minnesota , 
we re talking to them as if they are emerging professional biologists , and we treat them as colleagues .
 teaching stem by having students do research can be viewed as an active - learning strategy  and there is considerable evidence that active - learning strategies work ( e.g. , freeman et  al . , 2014 ) . the convocation closed with enthusiasm for using cures to expand research opportunities to all students .
jim gentile , now at the university of arizona , concluded that  undergraduate research is quality education . 
collectively , the speakers and discussions engendered enthusiasm for several elements related to cures , and we hope that this report will be useful for those faculty and schools thinking about or planning to expand the use of cures in their curriculum .
 the national academies of sciences , engineering , and medicine organized a convocation in 2015 to explore and elucidate opportunities , barriers , and realities of course - based undergraduate research experiences , known as cures , as a potentially integral component of undergraduate science , technology , engineering , and mathematics education . 
 this paper summarizes the convocation and resulting report . 
INTRODUCTION
OVERVIEW OF CONVOCATION THEMES
Assessment and Evaluation of CUREs
Leveraging Resources to Provide More Students with Opportunities for Research
Opportunities and Challenges to Scaling CUREs