For several years, the evidence-based approach has been used in the crime prevention domain to support programs that have demonstrated their effectiveness in reducing crime and improving community safety. The evidence-based approach, which relates to program effectiveness, is based on high scientific standards from results on program effectiveness that come from rigorous evaluation studies. Registries/databases, available to the public, widely disseminate evidence-based programs. The notion of "evidence" is operationalized (i.e., to materialize) through a continuum of program effectiveness: this is why there are different categories of programs, from "model programs", to "promising programs", to "ineffective programs". The evidence-based approach thus needs to be well understood by local authorities and applied appropriately through the programs and practices that will be implemented in local communities.
From this conceptualization multiple questions arise, some of which go unaddressed. For example, among all crime prevention programs supported by evidence, how do you select the most appropriate program that will meet the demands of funders, the needs of the population, and the organizational capacities of the lead organization? Where can information on programs and practices supported by evidence be found? How do we ensure that effective strategies and potential challenges will be considered?
This report has been developed to provide some answers to questions on the use of evidence-based programs by practitioners and policy makers. Evidence-based crime prevention programs can get better results than traditional programs, but to achieve the expected results, it is necessary that the right program is selected for the right clientele and that it is implemented using effective strategies. This report, without being exhaustive, provides practical guidance to help individuals better understand the evidence-based approach in crime prevention, proposes a step-by-step framework to guide them during program selection and implementation, and also suggests key elements for sustainability. This guide is an updated and more detailed version of a publication previously posted on Public Safety Canada's website (Guide to Select Promising and Model Crime Prevention Programs; 2012).
Crime prevention, with its vast scope, can be defined as the proactive strategies and measures that seek to intervene and modify risk factors among individuals, families, and/or in the environment in order to reduce the propensity to offend or re-offend, and/or the likelihood that criminal acts will be committedNote 1. Whether the focus is preventing youth violence, youth gang involvement or recidivism, the selection of the most appropriate crime prevention program(s) and/or practice(s)Note 2 is important and this decision should be based on certain key factors. There are many prevention and intervention options available and it can sometimes be difficult to determine what should be done. As there are literally hundreds of different crime prevention programs available (both in number and in type), it is important to take stock of and to identify key elements to assist in the selection of the most appropriate program.
The decision-making process to select a crime prevention program is complex, requires a significant investment of time and commitment and relies on various factors, including: the local context of crime and safety issues; the organizational resources and capacities of the lead organization; and the suitability and alignment of the program (for example, with the targeted clientele, risk factors and organizational capacities). For example, to identify local safety issues, communities will classify all possible approaches and strategies but since not everything can be done, a limited number of specific program(s)/intervention(s)/initiative(s) will be put forward to advance the agenda on crime prevention. But what program(s) should be chosen and based on what criteria? In addition, the question of program continuity after the initial funding (or in other words, program sustainability) should be addressed in the early stages and should be considered as another important factor in the program's decision-making process. In other words, potential programs for implementation should be compared in order to identify those with the highest probability of continuation. Indeed, it seems logical to choose a program whose continuity can be more easily assured.
While it is increasingly recognized that projects based on rigorous evidenceNote 3 obtain better results, there has been relatively little investigation into the local context in which the process of selecting a program occurs and/or on the criteria that should influence or orient this decision. Until now, and especially in Canada, no "comprehensive road map" has provided clear guidance on using the evidence-based approach both by policy makers as well as by local communities. Research and evaluation studies have largely focused on presenting outcomes and impacts of programs (e.g., in terms of crime reduction) and only a few have investigated the process of choosing a program and explained the rationale for selection.
This report has been written to fill these gaps and to better understand the decision-making process. Although not exhaustive, it presents a step-by-step framework and provides key considerations and questions designed to help stakeholders and communities make the most informed decisions possible when selecting a program for implementation in their community.
As a tool to help future local program implementers choose the most appropriate program(s), this document is intended for anyone interested in the process of selecting an evidence-based program in the field of crime prevention, or in a related field, and in learning more about best practices and strategies for successful program selection, implementation and sustainability.
Individuals who may benefit from this guide include members of an organization working collaboratively to identify, select and implement a program that meets the needs of their local population, as well as funders, and the community.
This document proposes a step-by-step framework and its central objective is to facilitate and guide the selection of an evidence-based program that best matches local needs as well as to provide advice for program implementation and sustainability. As its title suggests, this document should be used as a guide and reference document from the early stages of the decision making process.
An evidence-based approach refers to programs and practices that are proven to be effective through strong research and evaluation methodology and have produced consistently positive patterns of resultsNote 4. Identifying "what works" and applying the evidence-based knowledge to program development is critically important to ensure the use of best practices in several fields: crime prevention and corrections, health and mental health services, and education.
The Evidence-Based Approach to Crime Prevention: What is it?
It is well demonstrated and recognized that the more rigorous a study's evaluation design, (e.g., randomized controlled trials, quasi-experimental designs), the more compelling the research evidence. During the past years, the advancement of the evidence-based approach has been facilitated by methodological developments (for example, with systematic reviews and meta-analyses) and by technological advancements in the form of public evidence-based registries/databases such as Blueprints for Healthy Youth Development and Crime Solutions. Appendix 1 presents examples of these registries as well as the definitions used to describe the different types of programs (e.g., model, promising and ineffective programs)Note 5.
Applying an evidence-based approach also means applying well-supported principles. For example, when working with offenders and youth at-risk of violence and delinquency, using validated screening and assessment tools to determine risks and needsNote 6, applying the risk-need-responsivity framework when matching participants to interventions (dosage and intensity of individualized interventions), and obtaining the buy-in of multiple agencies are some examples of evidence-based principlesNote 7.
An evidence-based program is not an "all or nothing" static notion but rather reflects a concept that operates on a continuum of effectivenessNote 8. This continuum of effectiveness is a tool to determine where a crime prevention program falls on the evidence-based continuum. At one end of the continuum, there are the best programs which were rigorously evaluated and achieved statistically significant results. On the other end of the continuum, there are ineffective programs which were also rigorously evaluated but for which the results demonstrated that they had no effects or, more problematically, had harmful effects for the participants. Finally, along the continuum (between the best and ineffective programs) are promising programs that have achieved encouraging results but for which other replications and strong evaluation studies are still needed.
In order to judge the degree of effectiveness, a strong evaluation design is needed and results must be supported by evidence. Knowing what doesn't work is just as important as knowing what works best. Supporting ineffective programs costs billions of dollars to taxpayers and some programs may cause harmful effects for the participants. There is an enormous cost (social and financial) of pursuing and supporting programs and policies that are not rationally basedNote 9. Evidence-based policymaking should use the best available research and information on program results to guide decisions at all stages of the policy processNote 10.
In Canada, the fact remains that a large number of crime prevention programs are not supported by the evidence-based approach. An unpublished preliminary inventory of crime prevention programs in CanadaNote 11 indicates that nearly 60%Note 12 of the sampled programs have never been evaluated in the Canadian context. In other words, no results from evaluation studies support these programs, and in the absence of evidence, it is impossible to know the effectiveness of these programs (e.g., where do these programs fall on the continuum of effectiveness). An outcome evaluation helps to answer questions such as "is this program working?" and aims to find evidence of changes in clients/participants' behaviours and if changes result from their experience in the programNote 13. Without these studies and strong performance monitoring systemsNote 14 in place, the development of knowledge regarding effective programs in crime prevention in Canada is hindered.
The evidence-based approach is also associated with cost-effectiveness and cost-saving perspectives. Regardless of the area of expertise, it makes the most sense to invest in a service or program that has already demonstrated its effectiveness. The scientific evidence on what programs work in addressing risk factors in at-risk populations should be used to inform the development of projects as well as in funding decisions.
Investments in proven, tested, research-based programs not only lead to improved outcomes but are also associated with significant cost savings in taxpayer dollars. Appendix 2 provides additional detail about cost-effectiveness and cost-benefit analysis. One of the greatest social benefits for implementing evidence-based programs for at-risk youth is the cost-savings provided to taxpayersNote 15. Investing in evidence-based programs is the key to reducing victimization and increasing public safety while simultaneously managing correction costsNote 16. More specifically, cost-benefit analysis provides a tool for analysts and policymakers to evaluate crime prevention and criminal justice programs from an economic perspective in order to guide decisions regarding whether to modify, expand or terminate projectsNote 17.
In the United States, the Washington State Institute for Public Policy (WSIPP)Note 18 has provided credible evidence that for each dollar spent on evidenced-based prevention programs, more than a dollar's worth of benefits will be generated (i.e., the benefits exceed the costs). This organization has undertaken numerous cost-benefit analyses and systematic comparisons of crime prevention programs to inform policy decisions.
Evidence-based programs are based on rigorous studies, and are proven to be effective and produce positive results.
If implemented properly, with technical assistance and strict adherence, these programs can result in significant improvements and can significantly reduce crime. In addition, evidence-based programs are sound investments.
These programs have proven to be successful in even the most challenging cases, providing meaningful change for thousands of at-risk and vulnerable families and communities.
Step 1. Assessing the Local Situation: What are the crime and safety issues and links with other issues in the community? What segment(s) of the population needs to be reached? What are the main characteristics of this population? What are the local resources and initiatives in crime prevention? This component addresses the local context and suggests the importance of conducting a local needs assessment.
Step 2. Selecting an Effective Crime Prevention Program: What program works for the identified priorities and issues? Which program will best match the characteristics and needs of the identified population? This component addresses responses to the local assessment and identifies current best practices and programs in "What Works" clearinghousesNote 21. At this step, the final decision concerning the program to be implemented will be made.
Step 3. Implementing an Effective Crime Prevention Program: What are the factors for successful implementation? This component addresses the implementation drivers and conditions that may positively affect the program implementation process. Not all programs lead to successful implementation in the same way. This component takes into account the lessons learned from other implementation experiences and is based on the key elements of successful replication.
Step 4. Building Program Sustainability: What elements encourage the continuity of a program? This component addresses the sustainability factors and keys to success. Not all programs, even those that are successful, have the same probability of being incorporated into existing systems or receiving sustainable long-term funding. During the selection process, it is important to take these elements into consideration. In fact, even if this step appears to be a logical continuation once a program ends, sustainability must be assessed early in the program selection process. Moreover, even if nothing is guaranteed, it makes more sense to choose a program whose activities and services could be maintained by the lead organization after the initial funding ends.
Figure 1, a basic radial chart with four boxes radiating from a central box, shows the four steps in the evidence-based crime prevention approach to select the most appropriate program.
While greater effort may be required to implement an evidence-based program, the benefits for the participants as well as for the local communities are also greater. Well-planned programs can prevent crime and victimization, and promote community safety. But in order to be effective and generate positive outcomes, it is important to select the most appropriate evidence-based program that will best fit the needs of the local communities and populations and will be aligned with organizational capacities.
Analysis of the Local Situation: What Is It?
The portrait of the local situation provides an overview of the issues in the community, emerging and current risk behaviours or problem situations for specific populations, risk factors and the context in which they occur. Even more important is the fact that this assessment should indicate what appears to influence people to make the decision to adopt risky behaviours. The portrait must also provide an inventory of resources and programs in place in the community.
The first step is the development of a local portrait/diagnostic, also called an environmental scan or a strategic needs assessment, using a variety of data collection methodsNote 22. This portrait should provide an overview of the local reality, the nature and trends of existing and emerging crime and safety issues, the characteristics of the populations involved, the contributing factors, the services already in place, and the resources available in the community.
The importance of the local analysis cannot be underestimated. A lack of understanding of the local crime and safety issues and context can result in the selection of the wrong type of prevention program for implementation. If the nature, characteristics and extent of the issues are not properly defined and established, the selected program might not target the most appropriate client population, and could lead to the selection of inappropriate interventions. Not only would the program then fail to generate the expected results, it could have counter-productive outcomes. Research on correctional interventions in communities has demonstrated that intervening with people who do not need support (for example, low-risk offenders) can have negative repercussionsNote 23.
According to a research project on the analysis of process evaluations from a sample of crime prevention projectsNote 24, it appears that 23% of the projects carried out a local needs assessment before the implementation of their project, 20% did not, and for 58% of the projects, this information was not availableNote 25.
Conducting an analysis of the local community context is critical. There are several sources of information that can be consulted (such as police, health and social services, educational system, and socio-economic reports and data) and it is important that the information and data used are up-to-date, as objective as possible, and based on valid data collection methods.
What is the nature and extent of crime and safety issues?
Are there times and/or specific areas where the problematic behaviours occur more often?
What are the characteristics of the population associated with the problem?
What are the risk factors (proximal and distal)?
What services (direct or related) are currently available to address the problem?
Once the main priority issue(s) has been identified, gathering information to develop a full understanding of the nature and characteristics of the people and circumstances involved is the next step. Knowledge of characteristics such as the age, gender and ethnicity of the individuals involved in the situation is critical to program selection. For example, knowing key characteristics of youth involved in violent behaviour would help to select an appropriate program specific for them. Similarly, knowing where youth spend their time, when violent behaviour takes place, and any other factors related to incidences of violence will help to select a program that has the best chance of addressing crime and violence in this specific context.
Before making a decision on the program, it is also important to know what programs and services are currently available in the community. An inventory of existing resources is valuable from a number of perspectives. It can help to identify gaps in services, reduce duplication of work, and help to identify potential partners for a new initiative in the community. Every crime prevention program requires specific resources and it is only with a thorough understanding of what is currently available that an informed decision can be made about what programs are most relevant in a given local community context.
Some key questions to help guide the development of a local portrait/diagnostic are provided in the box above. Comparing the information collected and the program chosen ensures that the program is a good fit for the selected group and the community, and provides the rationale to support the implementation of the selected program.
Having the final report on the analysis of the local situation in hand, the second step is to identify and select potential program(s) that will be implemented to reduce/prevent situations/problem behaviours. When selecting a program, the evidence-based crime prevention approach ensures that the best available evidence is considered. For example, it is at this stage that the registries on effective programs are very useful to consult to gather information on the effectiveness of programs and to better understand their operational requirements. Since there are literally hundreds of programs in crime prevention, the box to the right provides key questions to ask to determine the type of research and evidence that exist to support and demonstrate the effectiveness of selected program(s).
What evidence and research are available to support the program?
Is the program rated in any registries/databases?
What is the level of effectiveness?
How many impact evaluation studies have been conducted?
Is the program ready for dissemination?
The alignment of the selected program with the capacities of the lead organization, the main risk factors, and participant characteristics are the most important variables affecting the level of suitabilityNote 26.
The more the program corresponds to the values and objectives of the lead organization; the more the program is aligned with the risk factors identified in the needs assessment; and the more appropriate the program is to address the characteristics of the selected group, the higher the level of program suitability. The higher the level of suitability, the greater the chances that the program is the best fit. The analysis of the degree of suitability of potential program(s) is a significant variable to consider when making a final decision. For example, even if the program is classified among the best, if its suitability is low, difficulties in implementation are possible which will negatively affect the achievement of results. The following items related to the suitability and alignment of the program should influence the final choice of the program to be selected.
How do the goals and objectives of the program reflect those of the organization?
How does the program complement other programs and services provided by the organization and by others in the community?
Are the program duration and intensity appropriate for the potential participants?
Do the potential participants have the time to fully participate in the program?
Are the location and time of the program activities appropriate for the potential participants?
Does the program need to be adapted in order to meet some specific characteristics of the population?
Although it seems obvious, the selected program's alignment with the mission of the lead organization is often neglectedNote 27. The more the program is in line with the organization's philosophy and organizational values, the better the chances that the program will be accepted by staff and others in the community. Similarly, the more the program is targeted to reach a clientele already known to the organization, the better the chances are that the right clientele will be reached.
Another factor to consider is how the program will complement other programs already provided by the lead organization, or by other organizations in the community. New programs implemented in a community should address gaps and provide services to reach needs that are not being met. This will help in the development of a comprehensive approach, which, in the long term, could lead to interventions that are more effective and enduring.
The second alignment component looks at how well a program addresses the level and complexity of the risk factors of the intended participants. A key consideration is the duration and intensity of the program. Reducing the impact of certain risk factors (e.g., substance abuse or impulsivity) requires interventions with a duration long enough to change participant behaviours. Understanding the main risk factors present and what types of interventions are suitable to address them are important elements for the selection of an appropriate program.
The last component related to suitability and alignment is the fit with the characteristics of the selected population/group. Every program is developed and designed to work in certain settings and with specific populations; interventions working with youth in schools will be different than those working with street youth. It is important to increase the likelihood that those targeted will participate for the entire length of the program as required to achieve the expected changes. In other words, the degree of effort required to fully participate in the program for the required amount of time must correspond to the effort that the selected group is able to put in. For example, what are the chances that vulnerable youth will participate in a long-term program with regular meetings? It is also important to ask whether the time and location of meetings suit the appropriate audience.
Organizational resources and capacities represent the other type of factors that must be considered when selecting an evidence-based program.
Are there staff within the organization capable of implementing this program?
What qualifications are recommended or required?
How many employees are needed? What is the recommended ratio of staff to participants in the program?
Can the program be implemented in the time allotted?
Is the infrastructure to collect and monitor data in place and adequate?
What are the costs associated with the implementation of the program, training, and purchase of the documents/license?
The analysis of organizational resources and capacities is too often a missing piece. Evidence-based programs vary in their complexity and in the level and type of effort and resources they require for implementation. Not all programs can be implemented everywhere, and it is important to consider organizational resources and capacities.
Implementing an evidence-based program requires investments with respect to money, material, time, and human resources. Even if the program has a high degree of suitability and alignment, if the lead organization and its partners lack the necessary resources and capacities, the chances of obtaining the expected results are limited.
Sound and effective partnerships and networks in the community.
The degree of program adaptation is a major factor to consider when selecting a program. Some programs are designed to be more flexible and can be adapted without affecting key components or compromising the expected results. Conversely, other programs are more rigid and should not be subject to adaptations, as these changes are likely to affect the achievement of results. Depending on the context in which the program will be implemented, the opportunities to tailor the program to suit the characteristics or special circumstances must be considered during the selection process.
Beyond the degree of flexibility of the program, studies have also shown that some adaptations are acceptable, while others are risky. Table 1 below presents examples of these adaptations.
Before any adaptations are made, it is essential to understand the program's rationale as not to lead to unexpected or involuntary results. Failure to respect the core program components could lead to what is referred to as "program drift" and the expected results of the evidence-based program may not be achieved. Modifying a program, even when program adaptations are needed, requires additional resources (personnel, time, and funds) and additional planning and evaluation to monitor the adaptations and evaluate the outcomes.
For example, to adapt a given program to better reflect the culture and values of the selected population, precautions need to be taken. Except for a few culturally-sensitive programs, the majority of evaluated preventive interventions have not been developed based on ethno-cultural dimensions. Additionally, when culturally appropriate programs have been evaluated, few used rigorous evaluation standards. In many cases, if a community wishes to add cultural modifications to the program, adaptations must be introduced with the consent, and under the supervision of, the program developers. Adaptations should always be indicated and monitored through performance data and evaluations.
By this step, the selection of the program should be almost complete and emphasis should now be placed on how the selected program will be implemented by the organization.
Program Implementation: What is it?
It has been well established that the quality of the implementation of crime prevention programs affects the achievement of the expected resultsNote 28. Implementation science has shown that negative or mixed results from a program's impact evaluation may be linked to a poor quality implementation and do not necessarily mean that its framework is not workingNote 29. For example, a promising program that is implemented effectively has a greater chance of producing positive results than a model program where implementation is constrained by multiple gaps and limitations. In other words, even the most effectively designed interventions can produce poor results when improperly implementedNote 30. Additionally, another example to demonstrate the importance of implementation: a program evaluated as having neutral effects can be replicated under different conditions and can obtain positive results.
When thinking about implementation, two sets of activities and outcomes must be distinguished: the program-level activities from which the program outcomes emerge and the implementation-level activities from which the implementation outcomes emerge. Implementation outcomes need to be identified and assessed, distinct from the program outcomes. In other words, when programs are unsuccessful, it is important to ask if failure is due to services or treatments that did not work (program activity failure) or if it is due to services or treatments that were not implemented properly (implementation failure)Note 31.
Meta-analyses examining the implementation process have shown the requirement to adopt a multi-level approach in order to take into consideration all of the factors that can positively or negatively influence the program implementation (program characteristics, practitioners, and communities; organizational capacity; training and technical assistance are some examples of factors that can affect the implementation process)Note 32. Appendix 3 presents several factors that should be considered when implementing a program as well as implementation drivers that should be in placeNote 33.
How will participants be reached and engaged in the program?
Does a referral form need to be developed and used? By whom? Based on what eligibility criteria?
Is management from the lead organization engaged and flexible?
Is there a mandatory risk assessment tool to use with participants? Are specific qualifications required to use it?
Do incentive strategies need to be developed? What types? How much money should be allocated (budget planning)?
Which partners must be involved? Are protocols/memorandums of understanding already in place? Are the roles and responsibilities of each partner clearly articulated?
Not all programs have the same degree of complexity, and their implementation will therefore be affected. Implementation conditions must be considered as a key element in whether or not results are achieved. Effective program implementation strategies increase the likelihood of success and lead to better results for participants. Moreover, a dynamic, committed and open context that is amenable to change will facilitate a program's integration.
In order to build a body of Canadian knowledge on effective crime prevention programs and efficient implementation strategies, strong process and impact evaluations should be conducted together in a more systematic manner. In addition, to ensure adequate implementation, strong monitoring systems should be established. This monitoring should ensure that evidence-based programs are carried out with fidelity to their design and incorporate the elements that are critical to their effectiveness (for example, having training and technical assistance and conducting regular meetings on data performance are some examples of key strategies to support effective program implementationNote 34).
Program Sustainability: What is it?
Sustainability is about ensuring that organizations implement strategies that contribute to long-term success. While it may seem surprising, sustainability is an aspect that needs to be considered when selecting a program for implementation.
Not all successful programs have the same likelihood of being incorporated into or combined with existing systems and/or of receiving sustainable funding. When a program is selected, consideration needs to be given to whether it could be maintained and included in the organization's structure once the initial funding ends. Some programs may fit into organizational structures more easily than others; this is why the alignment and suitability of the program with the organizational structure is an important factor that should not be minimized.
Identifying strategies for continuing to deliver effective programs and services before funding cycles draw to a close is often cited as a significant challenge. The cost of the program, while not the only variable, is an important factor since it seems that programs requiring a major financial investment are more likely to be discontinued after the funding runs out. But sustainability is not only a matter of funding; it also entails creating and maintaining the momentum by reorganizing and optimizing resources. Sustainability is leveraging partnerships and resources to continue programs, services, and/or strategic activities.
Sharing positive outcomes to encourage local buy-in and provide high-quality services.
Each organization should develop its own sustainability plan to meet their vision for sustainability and to respond to the unique needs of their organization and programs. There is no "one size fits all" sustainability strategy.
Must all or certain project activities be continued? Which ones? Why?
What does the institutionalization of this program entail?
What resources are available and what resources are needed to maintain the program?
Who are the stakeholders that we can count on to enable program sustainability?
Could resources be pooled with some partners?
What mix of potential solutions is needed to maintain the level of resources required to carry on the activities?
What potential challenges can already be envisioned, and what are potential solutions?
Are there any precedents that could provide inspiration for sustaining this program?
Does the sustainability plan meet the needs of the organization?
Sustainability planning should be as tangible as implementation planning. Similar to implementing programs, planning for sustainability is not a single event or a linear process. Rather, it is a continuous and dynamic process where many activities will occur simultaneouslyNote 36. Sustainability planning must be flexible and specifically tailored to local needs and the environment within which each organization operates. Appendix 4 presents some of the key factors that influence whether a service, program, or activities will be sustained over time. Finally, one of the most important parts of the process of planning for sustainability is to keep the sustainability plan active. The plan should be seen as a living document, and should not be put aside once completed. The plan should be continually reviewed and revised to reflect the changing conditions in which the program operates.
Contemporary crime prevention programs are based on a scientific approach from which tangible and quantifiable results exist. Evidence is available to demonstrate effectiveness in preventing and reducing crime. However, the evidence-based approach also requires that the selection and implementation of the program be directed by key program elements. The first step is to ensure that the selected program is aligned with the needs identified in the local assessment and with the capacities of the lead organization. These two aspects seem obvious but are often not well established during the selection process. Neglecting these variables can affect the implementation and consequently, can affect the final results to be achieved by the program.
By questioning the suitability and alignment of a program with: the realities and needs of the potential participants, objectives and resources of the lead organization; organizational and social context in which the new prevention program is to be integrated; and the level at which the program can be adapted to address specific situations and characteristics, are all factors that should influence and guide the decision-making process for the final selection of the right program to be implemented. Understanding how to identify an evidence-based crime prevention program, how to ensure it's a good fit with the specific population and the organization, how to implement it, and how to sustain it, are critical elements for practitioners as well as for policymakers.
In the crime prevention domain, a wide variety of resources exist, such as registries/databases, guides, checklists, etc. that provide user-friendly tools and promote the use of prevention programs that have been rigorously tested in local communities. In Canada, comprehensive tools that are addressed to practitioners and policymakers that explain the evidence-based approach are limited; this is one reason why this guide was developed. However, recognizing the ever-changing nature of the field, this report should not be considered as a static document.
The way in which the program is implemented has a significant impact on how well a program is able, or not able, to achieve the expected results. The importance of the implementation process in order to achieve program outcomes is increasingly recognized and the attention of experts is now more focused on "how" and "the context" in which effective programs are implemented. Mixed results are not automatically due to a poorly designed program but can be caused by implementation challenges. To ensure that implementation follows a proper path, data on specific implementation indicators should be collected and monitored on a frequent basis.
In all areas of social science, including in the prevention of crime and delinquency, the evidence-based approach requires development and accumulation of new knowledge as well as the transfer and application of this knowledge. Without having diffusion mechanisms and the promotion of effective programs to practitioners and policymakers, these programs would not be integrated into public policies or even replicated in local communities. While it is central to keep updated databases on evidence-based programs and to conduct rigorous outcome evaluations, it is also vital to disseminate and especially promote the implementation of these evidence-based programs into real contexts. This is needed in order to address problematic situations and even to prevent the future development or aggravation of certain risk behaviours. Gathering evidence is important, but it is what is done with that evidence that matters most.
This appendix presents the most recognized classification systems of evidence-based crime prevention/delinquency programsNote 37. Table 2 provides an overview of the rating guidelines employed by each of the classification systems of evidence-based crime prevention programs discussed below.
The Blueprints for Healthy Youth Development is a research project within the Center for the Study and Prevention of Violence, at the University of Colorado Boulder. The Blueprints mission is to identify evidence-based prevention and intervention programs that are effective in reducing antisocial behaviour and promoting a healthy course of youth development.
Each Blueprints program has been reviewed by an independent panel of evaluation experts and determined to meet a clear set of scientific standards. Programs meeting this standard have demonstrated at least some effectiveness for changing targeted behaviour and developmental outcomes.
The Office of Justice Programs' CrimeSolutions.gov and the Office of Juvenile Justice and Delinquency Prevention's (OJJDP's) Model Programs Guide (MPG) share a common database and use rigorous research to inform practitioners and policy makers about what works in criminal justice, juvenile justice, and crime victim services.
The two sites provide research on the effectiveness of programs and practices as reviewed and rated by study reviewers and provide easily understandable ratings based on the evidence that indicates whether a program or practice achieves its goals.
The Coalition for Evidence-Based Policy seeks to increase government effectiveness through the use of rigorous evidence about what works. Rigorous studies have identified a few highly-effective program models and strategies. The Coalition advocates many types of research to identify the most promising social interventions.
The Coalition for Evidence-Based Policy also administers the Top Tier Evidence Initiative. The goal of this initiative is to identify social programs that are backed by strong evidence of important impacts on people's lives. Through a systematic review effort launched in 2008, the initiative's expert panel identifies interventions meeting "Top Tier" or "Near Top Tier" classification.
The National Registry of Evidence-based Programs and Practices (NREPP) is a database of more than 330 mental health and substance abuse interventions. All interventions in the registry have met NREPP's minimum requirements for review and have been independently assessed and rated for quality of research and readiness for dissemination.
The purpose of NREPP is to help practitioners learn more about available evidence-based programs and practices and determine which of these may best meet the needs. NREPP is one way that SAMHSA is working to improve access to information on evaluated interventions and reduce the lag time between the creation of scientific knowledge and its practical application in the field.
A minimum of (a) two high quality randomized control trials or (b) one high quality randomized control trial plus one high quality quasi-experimental evaluation.
Positive intervention impact is sustained for a minimum of 12 months after the program intervention ends.
The evaluation trials produce valid and reliable findings. This requires a minimum of (a) one high quality randomized control trial or (b) two high quality quasi-experimental evaluations.
Programs have strong evidence indicating they achieved their intended outcomes when implemented with fidelity.
Programs have some evidence indicating they achieved their intended outcomes. Additional research is recommended.
Programs have strong evidence indicating that they did not achieve their intended outcomes when implemented with fidelity.
Interventions shown in well-designed and implemented randomized controlled trials, preferably conducted in typical community settings, to produce sizable, sustained benefits to participants and/or society.
Interventions shown to meet almost all elements of the Top Tier standard, and which only need one additional step to qualify. This category includes, for example, interventions that meet all elements of the standard in a single site, and just need a replication trial to confirm the initial findings and establish that they generalize to other sites.
Reviewers use a scale of 0.0 to 4.0, with 4.0 being the highest rating given for two main dimensions: quality of research and the readiness for dissemination.
Figure 2, a top-to-bottom flowchart with six boxes, describes the standard procedures for conducting an economic analysis.
A cost-effectiveness analysis typically involves Steps 1 to 4 (top 4 boxes), whereas a benefit-cost analysis involves all six steps.
A cost-effectiveness analysis (CEA) calculates the total costs of a program, then compares these costs to the program's impact or effectiveness, for example, change in the number of police arrests. The resulting cost-effectiveness ratio provides a cost per unit of program outcome, for example, $5,000 in program costs has to be invested to prevent one incident of police arrest.
In taking the economic analysis perspective a step further to assess the ultimate value of the program, a cost-benefit analysis (CBA) may be utilized. A CBA assesses, in financial terms, how much society saves from the impact of a program by attaching a monetary value to potential benefits, and then comparing this to the program costs. This equation results in a unit-independent benefit-cost ratio (BCR), for example, societal savings of $10 per $1 of program cost. The cost-benefit analysis is a tool that enables a comparison of the advantages and disadvantages of undertaking a particular program or policy as opposed to another course of action, including doing nothing at all, and applying monetary values to these advantages and disadvantagesNote 40.
A benefit-cost ratio greater than 1.0 means that the benefits of the program outweigh the costs, and thus, produce a positive "rate of return". The higher the BCR, the greater the return on investment. Conversely, BCRs of less than 1.0 indicate that program costs surpass the benefits that are gained.
As an example of economic analysis, a study has recently been published on the monetary benefits and costs of the program Stop Now And Plan-Under 12 Outreach Project (SNAP-ORP), a cognitive–behavioural skills training and self-control program, in preventing later offending by boysNote 41. The total cost for an "average" boy participating in SNAP was $4,641 CDN (the total cost of the SNAP-ORP program was $1,729 CDN for low risk cases, $4,166 CDN for moderate risk cases, and $8,503 CDN for high risk cases). Results of this study indicate that based on convictions between $2.05 CDN and $3.75 CDN are saved for every $1 CDN spent on the program. Scaling up to undetected offenses, between $17.33 CDN and $31.77 CDN are saved for every $1 CDN spent on the program.
Practitioners and researchers in crime prevention increasingly face a common challenge: the successful, effective implementation of evidence-based practices. The emergence of this interest in implementation-related issues coincides with the realization that merely selecting an effective program is not enough and that, even with the development of best practice guides, various experiences in the field have shown that effective programs have not delivered the expected results. Merely selecting a model program is not a guarantee to achieving expected results. An effective program must be combined with a high quality implementation in order to increase the likelihood of achieving positive results among the clients servedNote 42.
To disseminate practical knowledge that can be used as guidelines, an implementation guide has been recently publishedNote 43. This guide provides checklists of activities related to implementation stages, which are useful for evaluating, planning and monitoring implementation activities across each stage of the process. As the goal here is not to repeat the information already presented in the guide, only the most important information that must be considered during the selection of a crime prevention program is presented in this report.
As demonstrated in Figure 3, research has shown that the implementation process is essentially composed of four stages. These stages do not follow a linear process, but instead they represent one that is dynamic and iterative. These stages are also interconnected and affected by various internal and external organizational factors, and challenges addressed (or not addressed) in one stage will impact the entire implementation process (for example, high staff turnover could require an organization to go back to a previous stage of implementation).
During the program selection process, it is important to consider a number of factors that may affect the implementation of the program. Having a comprehensive picture of the factors associated with the social context, the organization, the practitioners, and the program will allow for a better understanding of the nature of these factors and how they can positively (as facilitators) or negatively (as barriers) influence the implementation process. For example, in one study on the implementation of a mental health program in schools, Kam et al. (2003) observed a significant correlation between management's support for the program and the fidelity of the implementation by teachers. When these two factors were high, significant positive results were noted among the students; however, when management's support was weak, negative changes were seen among the students.
* Factors with an asterisk (*) indicate that they are considered as the implementation drivers.
Figure 4, a block cycle chart with three boxes shows the different implementation drivers and their components in a circular flow.
Sustainability is a challenge not only for crime prevention programs, but for the vast majority of programs that serve children, youth and families. Program sustainability is a critical component affecting long-term change in behaviours, but many programs and services face numerous challenges. Many programs that demonstrate great results eventually fade away because they are unable to secure adequate resources to continue. Among the programs that do flourish, there are several common elements that contribute to their success.
For example, the Office of Adolescent Health (OAH)Note 45, through informal conversations with grantees, highlights several barriers to achieving sustainability, including securing funding; providing services to special populations; strategic planning and prioritizing sustainability planning; achieving local buy-in; creating and maintaining partnerships; and securing local political support. On the other hand, successes in these areas include being able to diversify funding streams; adapt services to special populations; use assessments to prioritize services; secure community supports; and enhance collaboration with local networks. These challenges and successes are in line with adolescent health programs but many similarities can be drawn with crime prevention programs.
Through extensive research and with input from OAH grantees, a sustainability framework and guide were developed. Table 4 presents eight sustainability factors that should be considered and the keys to success for each of them.
Andrews, D. A., & Bonta, J. (2010). The psychology of criminal conduct (5th ed.). New York, NY: Routledge.
Aos, S., et al. (2001). The comparative costs and benefits of programs to reduce crime (version 4.0). Olympia, WA: Washington State Institute for Public Policy.
Bania, M., & Kandalaft, A. (2013). Striving for sustainability: Six key strategies to guide your efforts. Ottawa, ON: YOUCAN Mentoring Program.
Baum, K., Blakeslee, M., Lloyd, J., & Petrosine, A. (2013). Violence prevention: Moving from evidence to implementation. Discussion paper. Washington, DC: National Academy of Sciences.
Blandford, A., & Osher, F. (2012). A checklist for implementing evidence-based practices and programs (EBPs) for justice-involved adults with behavioral health disorders. Delmar, NY: SAMHSA's GAINS Center for Behavioral Health and Justice Transformation.
Blase, K., & Fixen, D. (2013). ImpleMap: Exploring the implementation landscape. Chapel Hill, NC: National Implementation Research Network. Frank Porter Graham Child Development Institute, University of North Carolina Chapel Hill.
Blase, K., & Fixsen, D. (2013). Stages of implementation analysis: Where are we? Chapel Hill, NC: University of North Carolina at Chapel Hill.
Cohen, M. A. (2000). Measuring the costs and benefits of crime and justice. In G. LaFree (Ed.), Measurement and analysis of crime and justice. Washington, DC: National Institute of Justice, US Department of Justice.
Crosse, S., et al. (2011). Prevalence and implementation fidelity of research-based prevention programs in public schools - Final report. Prepared for US Department of Education, Office of Planning, Evaluation and Policy Development Policy and Program Studies Service. Rockville, MD: Westat.
Dhiri, S., & Brand, S. (1999). Analysis of costs and benefits: Guidance to evaluators. Crime Reduction Programme Guidance Note 1. London, UK: Home Office.
Farrington, D. P., & Koegl, J. (2014). Monetary benefits and costs of the Stop Now And Plan program for boys aged 6–11, based on the prevention of later offending. Journal of Quantitative Criminology (online fist) DOI: 10.1007/s10940-014-9240-7.
Federal Provincial Territorial Working Group on Crime Prevention (2014a). Framing paper – Advancing evidence-based crime prevention and sustainability. Unpublished report. Ottawa, ON: Public Safety Canada.
Federal Provincial Territorial Working Group on Crime Prevention (2014b). Inventory of evidence-based crime prevention programs in Canada. Unpublished report. Ottawa, ON: Public Safety Canada.
Fixsen, D., & Blase, K. (2006). "What works" for implementing "what works" to achieve consumer benefits. Tampa, FL: National Implementation Research Network, University of South Florida, Louis de la Parte Florida Mental Health Institute.
Fixsen, D., et al. (2005). Implementation research: A synthesis of the literature. Tampa, FL: National Implementation Research Network, University of South Florida, Louis de la Parta Florida Mental Health Institute.
Fixsen, D., et al. (2009). Core implementation components. Research on Social Work Practice, 19(5), 531-540.
Fixsen, D., et al. (2013). Implementation drivers: Assessing best practices. Tampa, FL: National Implementation Research Network, University of South Florida, Louis de la Parte Florida Mental Health Institute.
Fratello, J., et al. (2013). Measuring success: A guide to becoming an evidence-based practice. Models for Change – Systems Reform in Juvenile Justice. New York, NY: Vera Institute of Justice.
Gabor, T. (2011). Evidence-based crime prevention programs: A literature review. Submitted to the Palm Beach County Board of County, Commissioners and Criminal Justice Commission.
Gray, M., et al. (2012). Implementing evidence-based practice: A review of the empirical research literature. Research on Social Work Practice, 23(2), 257-266.
Greenwood, P. W., & Welsh, B. C. (2012). Promoting evidence-based practice in delinquency prevention at the state level. Criminology & Public Policy, 11(3), 493-513.
Henggeler, S., & Schoenwald, S. (2011). Evidence-based interventions for juvenile offenders and juvenile justice policies that support them. Social Policy Report, 25(1), 1-28.
Institute for Educational Leadership (no date). Building sustainability in demonstration projects for children, youth and families. Toolkit Number 2 – Systems Improvement Training and Technical Assistance Project. Washington, DC: OJJDP.
McIntosh, C., & Li, J. (2012). An introduction to economic analysis in crime prevention: The why, how & so what. Ottawa, ON: National Crime Prevention Centre, Public Safety Canada.
Metz, A. (2007). A 10-step guide to adopting and sustaining evidence-based practices in out-of-school time programs. Brief Research-to-Results, Child Trends, Part 2 in a Series on Fostering the Adoption of Evidence-Based Practices in Out-Of-School Time Programs. Washington, DC: Child Trends.
Metz, A., Blase, K., & Bowie, L. (2007). Implementing evidence-based practices: Six "drivers" of success. Brief Research-to-Results, Child Trends, Part 3 in a Series on Fostering the Adoption of Evidence-Based Practices in Out-Of-School Time Programs. Washington, DC: Child Trends.
Metz, A., Bowie, L., & Blase, K. (2007). Seven activities for enhancing the replicability of evidence-based practices. Brief Research-to-Results, Child Trends, Part 4 in a Series on Fostering the Adoption of Evidence-Based Practices in Out-Of-School Time Programs. Washington, DC: Child Trends.
Mihalic, S., et al. (2004a). Successful program implementation: Lessons from Blueprints. Juvenile Justice Bulletin. Washington, DC: US Department of Justice, Office of Justice Programs, Office of Juvenile Justice and Delinquency Prevention.
Mihalic, S., et al. (2004b). The importance of implementation fidelity. Emotional & Behavioral Disorders in Youth, 4(4), 83-105.
Morgan, A., et al. (no date). Effective crime prevention interventions for implementation by local government. Reports Research and Public Policy Series. Project no. 209. Canberra, Australia: Australian Institute of Criminology (AIC).
O'Connor, C., Small, S. A., & Cooney, S. M. (2007). Program fidelity and adaptation: Meeting local needs without compromising program effectiveness. What Works, Wisconsin – Research to Practice Series, 4. Madison, WI: University of Wisconsin–Madison/Extension.
Proctor, E., (2011, August). Implementation outcomes. Center for Mental Health Services Research Washington University in St. Louis. Presentation at the 2011 National Child Welfare Evaluation Summit. Washington, DC.
Proctor, E., et al. (2010). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration of Policy Mental Health. 38, 65-76.
Promise Neighborhoods Institute (no date). Evidence-based practice: A primer for promise neighborhoods. Commissioned by the Promise Neighborhoods Institute at PolicyLink by Nilofer Ahsan at the Center for the Study of Social Policy.
Przybylski, R. (2008). What works. Effective recidivism reduction and risk-focused prevention programs. A compendium of evidence-based options for preventing new and persistent criminal behavior. Denver, CO: RKC Group.
Puddy, R. W., & Wilkins, N. (2011). Understanding evidence part 1: Best available research evidence. A guide to the continuum of evidence of effectiveness. Atlanta, GA: Centers for Disease Control and Prevention.
Rempel, M. (2014). Evidence-based strategies for working with offenders. Washington, DC: Center for Court Innovation, Bureau of Justice Assistance, US Department of Justice.
Savignac, J., & Dunbar, L. (2014). Guide on the implementation of evidence-based programs: What do we know so far? Ottawa, ON: Public Safety Canada.
Sherman, L., et al. (1997). Preventing crime: What works, what doesn't, what's promising. A report to the United States Congress prepared for the National Institute of Justice.
Small, S. (2009). Evidence-informed program improvement: Using principles of effectiveness to enhance the quality and impact of youth and family programs. Presented at the Iowa State Webinar, University of Wisconsin-Madison/Extension. Madison, WI.
Small, S. A., et al. (2007). Guidelines for selecting an evidence‐based program: Balancing community needs, program quality, and organizational resources. What Works, Wisconsin – Research to Practice Series, 3. Madison, WI: University of Wisconsin–Madison/Extension.
Society for Prevention Research (no date). Standards of evidence - Criteria for efficacy, effectiveness and dissemination. Falls Church, VA: Author.
Stephenson, R., et al. (2014). Model program guide – Implementation guides: Background and user perspectives on implementing evidence-based programs. Development Services Group Inc. (DGS). Submitted to the Office of Juvenile Justice and Delinquency Prevention.
The Pew-MacArthur (2013). The Pew-MacArthur results first initiative, states' use of cost-benefit analysis: Improving results for taxpayers. Washington, DC: The Pew Charitable Trusts and MacArthur Foundation.
The Pew-MacArthur (2014). Evidence-based policymaking – A guide for effective government. Washington, DC: The Pew Charitable Trusts and MacArthur Foundation.
US Department of Health and Human Services, Office of Adolescent Health. (2014a). Building sustainable programs: The framework. Washington, DC: Child Trends.
US Department of Health and Human Services, Office of Adolescent Health. (2014b). Building sustainable programs: The resource guide. Washington, DC: Child Trends.
Vincent, G., Guy, L., & Grisso, T. (2012). Risk assessment in juvenile justice: A guidebook for implementation. National Youth Screening & Assessment Project. Washington, DC: MacArthur Foundation and Models for Change – Systems Reform in Juvenile Justice.
Wandersman, A., et al. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41, 171-181.
Welsh, B. (2007). Evidence-based crime prevention: Scientific basis, trends, results and implications for Canada. Ottawa, ON: National Crime Prevention Centre, Public Safety Canada.
Welsh, B. C., & Farrington, D. P. (2001). Monetary value of preventing crime. In B. Welsh, D. Farrington, & L. Sherman (Eds.), Costs and benefits of preventing crime. Boulder, CO: Westview Press.
Wiseman, S., et al. (2007). Getting to outcomes: 10 steps for achieving results-based accountability. RAND Health, supported by the Centers for Disease Control and Prevention.
The National Institute of Justice's Crime Solutions website provides separate definitions for "program" and "practice". Programs are a set of specific activities implemented in accordance with guidelines in order to achieve specific results. Practices are a general class of programs, strategies or procedures that share similar characteristics (http://www.crimesolutions.gov/default.aspx). In this report, "program" will be used as a generic expression that encompasses both definitions.
For more information, see Coalition for Evidence-Based Policy Working Group (2006); Gabor (2011); Society for Prevention Research (no date); Welsh (2007).
Classification systems presented in Appendix 1 are all developed in the United States. In Canada, such a classification system for crime prevention programs does not exist. Due to this limitation, it should be acknowledged that a gap may exist between the literature and the existence of other crime prevention programs in local communities.
For more information about using and implementing risk assessment tools, see Vincent et al. (2012), Risk Assessment in Juvenile Justice: A Guidebook for Implementation. The primary purpose of this Guide is to provide a structure for juvenile probation striving to implement risk assessment or to improve their current risk assessment practices. Risk assessment in this Guide refers to the practice of using a structured tool that combines information about youth to classify them as being low, moderate or high risk for reoffending or continued delinquent activity, as well as identifying factors that might reduce that risk on an individual basis.
The Centers for Disease Control and Prevention (CDC, US) has developed a tool The Continuum of Evidence of Effectiveness to facilitate a common understanding of what the best available research evidence means in the field of violence prevention. This Continuum also serves to provide a common language for researchers, practitioners, and policy-makers in discussing evidence-based decision making. For more information, see Puddy & Wilkins (2011).
In total, 82 crime prevention programs were analyzed in order to identify to what extent they could be considered as evidence-based programs in the Canadian context (Federal Provincial Territorial Working Group on Crime Prevention, 2014b).
Of these programs, 15% are currently evaluated or a impact evaluation study is anticipated to start in the near future.
For more information about targeted evaluation and outcome monitoring as key components in the evidence-based policymaking framework, see The Pew-MacArthur (2014). The Pew-MacArthur (2014) in their Guide for Effective Government, proposes an evidence-based policymaking framework composed by five key components: (1) program assessment: systematically review the effectiveness of public programs; (2) budget development: incorporate evidence of program effectiveness into budget and policy decisions, giving funding priority to those that deliver a high return on investment of public funds; (3) implementation oversight: ensure that programs are effectively delivered and are faithful to their intended design; (4) outcome monitoring: routinely measure and report outcome data to determine whether programs are achieving desired results; and (5) targeted evaluation: conduct rigorous evaluation of new and untested programs to ensure that they warrant continued funding.
As an example, in 2012 the Iowa Department of Corrections (US) issued a report highlighting the costs and benefits of various criminal justice programs over a 10-year period. The analysis showed that among prison-based programs, cognitive behavioural therapy programs were inexpensive to operate and highly effective in reducing recidivism, returning $37.70 in benefits for every dollar spent. In contrast, correctional educational programs, although also effective, only returned $2.91 in benefits per dollar invested. As a result, the department is considering expanding its cognitive behavioral therapy programs and plans to reduce other, less effective activities proportionally (Iowa Department of Corrections (2012), Return on Investment. Evidence-Based Options to Improve Outcomes in The Pew-MacArthur (2014)).
Since the 1990s, the Washington State legislature has directed WSIPP to identify evidence-based policies. The goal is to provide Washington policymakers and budget writers with a list of well-researched public policies that can, with a high degree of certainty, lead to better statewide outcomes coupled with a more efficient use of taxpayer dollars. For more information, visit their website at: http://www.wsipp.wa.gov.
Embedded into a more detailed framework, RAND's Getting to Outcomes manual (Wiseman, 2007) presents a 10- step process that empowers prevention practitioners to plan, implement, and evaluate their own prevention programs. Steps 1 to 6 - Planning (1. Identify needs and resources in your community; 2. Identify goals and desired outcomes; 3. Find programs that help achieve your goals; 4. Review program choices for best fit; 5. Determine the capacities needed for implementation; 6. Make a plan for implementation) and Steps 7 to 10 - Evaluating and Improving (7. Evaluate the implementation process; 8. Evaluate outcomes of the program; 9. Improve the program with continuous quality improvement; and 10. Plan for program sustainability).
See Appendix 1 for examples of classification systems of evidence-based crime prevention programs.
Depending on the context, this step can be named and conducted in many ways. For example, consult the Guide Book on Local Safety Audits at http://efus.eu/en/topics/tools-and-methods/audits-and-evaluation/efus/654/ (bilingual site); the Community Tool Box developed by KU Work Group for Community Health and Development at http://ctb.ku.edu/en/table-of-contents (English only); the Community Action Guide to Comprehensive Community Needs Assessments report produced by the National Association for State Community Services Programs (2011) at: http://www.nascsp.org/data/files/CSBG_Resources/Train_Tech_Assistance/ Needs_Assessment_FINAL_-_8.22_print_to_pdf.pdf (English only) and the Safety Diagnosis Tool Kit for Local Communities developed by the Centre Québécois de ressources en promotion de la sécurité et en prévention de la criminalité at http://www.crpspc.qc.ca/default_an.asp?fichier=accueil_an.htm (bilingual site). Finally, some provincial government departments have also developed guides for local community needs assessments.
This research project was aimed to analyze effective implementation strategies and implementation challenges for 71 crime prevention projects funded between 2007-2013 by the National Crime Prevention Centre, Public Safety Canada. Data was drawn from the final process evaluation reports.
This result is presented for information purposes only and should be interpreted with caution: the question of whether a local needs assessment was conducted before the implementation of the project was not required by evaluators in their process evaluation plan.
Examples of questions presented in this section are based on the report prepared by Small et al. (2007).
There is also the What Works in Reentry Clearinghouse: http://whatworks.csgjusticecenter.org/. This registry is a "one-stop shop" for research on the effectiveness of a wide variety of reentry programs and practices.
Bania & Kandalaft (2013). Striving for Sustainability: Six Key Strategies to Guide your Efforts.
Institute for Educational Leadership (no date). Building Sustainability in Demonstration Projects for Children, Youth and Families.
The Finance Project (2002). Sustaining Comprehensive Community Initiative – Key Elements for Success.


text:
Home > News and events > Announcements > Green friendly hospital reducing electricity costs
Green friendly hospital reducing electricity costs
NEW solar panels at a hospital will soon be in operation – helping reduce the site's electricity costs by around 10%.
The 250kw panels at the University Hospital of North Tees will generate renewable energy which can go back into powering the whole building.
Half of the planned solar panels – 480 in total – are already in place and in operation on the hospital's podium roof.
The other 125kW of panels will be installed on the new energy centre roof this summer, at the rear of the hospital site.
The work forms part of a large scale development by contractor NG Bailey to build a new energy centre on site and replace the electrical infrastructure of the site.
Peter Mitchell, director of estates and facilities at North Tees and Hartlepool NHS Foundation Trust, said: "This is a really exciting development for the trust.
"As we plan for the future, it's important that we look at developing ways of being as energy efficient and environmentally friendly as we can be.
"By the summer we will have a state of the art energy centre which will ensure we are able to continue to provide the very best and safest care to our patients."
Solar panels capture the sun's energy and don't need direct sunlight to work – they can still generate some electricity on a cloudy day.

redpajama_set_name: RedPajamaCommonCrawl


text:
From Mozart's concertos to Jethro Tull's "Aqualung," the flute has served as a versatile tool for conveying the spectrum of human emotion. On AERO, flutist Dieter Flury puts decades of study and a handmade golden flute by Yamaha to work to breathe life into works by contemporary composers and spark the imaginations of listeners. John Bilotta's Capricci gives the flute a virtuosic encore with three contrasting sections full of syncopation and off-beat gestures. Mari Kotskyy's Colors offers a cheerful musical landscape filled with conversational harmonies between flute, piano, and clarinet. Three Lais by Allen Brings envisions a poet, alone in a world of sand and stone, reading texts in an ancient tongue. The flute's delicate side is highlighted by Romance for Flute and Piano by Marvin J. Carlton, a gentle dance that pleases the ear. Ondine's Flute by Kenneth Eggert depicts a mermaid atop a rock, waves crashing around her as she plays her song. Andrew Lewinter's Waltz for Flute and Cello brings the two instruments together with a tonal, three-part structure, and Charles Savage's Mad Rush to the End shows off the power of two flutes with a drive that creates a unified "super-flute." Carl Vollrath's The Glass of Absinthe showcases the instrument's ability to illustrate by capturing the mood of Degas' painting of the same name. Over his storied career, Flury has served as Principal Flute of the Vienna Philharmonic Orchestra, soloist with orchestras the world over, and recording artist for a slew of albums from Baroque to contemporary. Behind the scenes, he's also served as Artistic Director and General Manager of Vienna Philharmonic and a professor at the University of Music and Performing Arts in Graz.
Label: NAVONA
Artist: Dieter Flury
1. Capricci
3. The Glass Of Absinthe
4. Romance For Flute & Piano
5. Waltz For Flute & Cello
6. 3 Lais: No. 1, -
9. Ondine's Flute
10. Mad Rush To The End (Arr. For Flute Duet)


text:
iOS 16 may automatically detect car crashes
The rumor: A future software update for iPhones could enable "crash detection," according to the WSJ (80% accurate).
These are the details…
"Crash detection uses data from sensors built into Apple devices including the accelerometer to detect car accidents as they occur, for instance by measuring a sudden spike in gravity, or "g," forces on impact" the report says
This data could then be utilized to automatically dial 911 if an accident is detected
Apple could roll this feature out to iPhones as early as 2022, either as an update to iOS 15 or as part of the larger iOS 16 release
Our take: This sounds really helpful, and reminds me of how Apple used the accelerometer on Apple Watch Series 4 and newer to make fall detection work. Automatic crash detection would be really helpful and potentially life-saving.
Upcoming 27-inch iMac to come in new colors, launch in Spring 2022
There might not be a SIM card slot on the 2023 iPhones


text:
Fictional feminist shout-out
The refreshingly feminist heroines of 'Into the Woods'
Tina Wargo
Mail Email Print iphone Send Text Message
Once upon a time, in a village far, far away, there lived a fiercely feminist musical that would change everything you thought you knew about the leading ladies of the fairy tale game. The damsels would become heroes, the princes would become tiresome, and the fairy tale sexism would make like a carriage after midnight and disappear into thin air. Luckily, that once upon a time is now, and the village is your closest movie theater playing Into the Woods.
Stephen Sondheim's freshly feminist twists on old characters (Cinderella isn't just a shoe-diva anymore!) completely reverse the tired stereotypes we're all sick of seeing and highlight strong, female characters as heroines, rather than victims, of their stories. Each of his leading heroines represent different kinds of strong-willed feminist badassery—AND they do it all while singing! Here's a breakdown:
Little Red Riding Hood: Sondheim's youngest revamped heroine, a character most often recognized for her famous run-in with a big, bad wolf, is DONE getting cat-called by strangers in the woods! Into the Woods' Little Red, though still, at first, seemingly young and naïve, wastes no time getting her revenge on her manipulative predator, and let's just say the fur coat she ends up walking away with is this year's DIY masterpiece.
As Little Red (played by Lilla Crawford) discovers more about herself as a woman, she also starts to understand where she fits into the wild world around her. Her awakening, and subsequent wisdom, make her much more than just a little girl with a penchant for capes. She becomes a fiercely spirited symbol of strength in self-knowledge, and embodies the power that comes with choosing to accept sudden womanhood as a badge of honor, not a source of shame.
Cinderella: Our old friend (played by Anna Kendrick), whose original life goal hardly extends past midnight, yearns for far more in Sondheim's tale. Her self-driven pursuit of happiness no longer has to do with (completely impractical!) shoes. Cinderella finds the nerve to leave what's comfortable and expected of a woman her age, in order to determine what's right for HER. Spoiler alert: it's not a carriage, or a godmother, or unusually articulate birds—and it's definitely not a Prince.
The Baker's Wife: Sondheim's original character (played by Emily Blunt) represents the many generic fairy tale wives we've come to expect, but The Baker's Wife is arguably the most surprisingly unconventional woman of them all. Superficially, the married woman appears to be loyal, loving, doting, simple. However, her uncompromising bravery and sexual desires emerge as the musical progresses.
Torn between the desire to have a fun romance with a Prince (which Blunt fought to keep in movie) and the responsibilities and comfort of the husband and child she has waiting for her at home, The Baker's Wife represents some of the conflicts modern women face in society and as individuals. She also kicks butt when it comes to playing hero to her husband. She is fiercely independent and through her journey, she questions societal expectations all while chasing a giant and battling a witch. Yeah, she's pretty cool.
Though there are still some facets of the story that lean on old sexist beliefs (namely, the witch's desire to be young again), Into the Woods' succeeds in reframing women's desires thanks to its female heroines.
Stephen Sondheim's musical isn't, by any means, a new addition to our culture, but its fresh film adaptation promises to kick-start its popularity amongst crowds other than us theater nerds who've been worshipping it for years. And that's amazing news for anyone who appreciates not only a good movie-musical, but for all of us movie-goers and feminists who long to see strong, fearless, ladies continue to take over the big screen. All the better to empower you with, my dear.
By Tina Wargo
Popular in Fictional feminist shout-out
Feminist Passport: Your travel guide to Tel Aviv, Israel
What happens when a bunch of male celebs are asked if they're feminists
Feminist Passport: Your travel guide to Richmond, Virginia
Chris Hemsworth just announced his feminist upbringing, we love him even more
In praise of pop culture anti-heroines
Feminist icon Jane Fonda thinks we need more feminist emojis
If you have $10 in your wallet, then you can definitely buy Meghan Markle's favorite drugstore mascara
Answers to all those 'Into the Woods' questions you didn't know you had
Feminist Passport: Your travel guide to Dubai
Female authors who are just as badass as their fictional heroines
Feminist Emojis are finally here!
Jameela Jamil explained why she calls herself a "feminist-in-progress"
Kat Stratford showed me it was okay to be an angry feminist
Two Roads Diverged in a Sugary Wood
The awesomely feminist reason why Anna Jarvis invented Mother's Day
We're madly in love with this feminist coloring book. Yes, a feminist coloring book.
Why Elaine Benes from 'Seinfeld' is my feminist role model
15 feminist films you can stream for free during Women's History Month
Leighton Meester might be coming back to TV as a time-traveling heroine
I taught Emma Kenney, who plays Harris Conner Healy in the "Roseanne" reboot, how to Skip-It
All Topics in Fictional feminist shout-out


This week: the 'Change the Date' debate. We discuss what seems to have been the most controversial Australia Day yet. Plus, divine intervention? As the Chilean government turns up the heat, why would the Pope push the Mapuche to turn the other cheek? And: bison on the brink? It's an animal many still revere—now, a scientist raises fresh concerns about its future.
Joining host Rick Harp this week are Kim TallBear, associate professor of Native Studies at the University of Alberta, and Candis Callison, Associate Professor at UBC's Graduate School of Journalism.


text:
Cropredy set for huge 40th birthday bonanza
June 26, 2019 Sarah Spencer What's On
Cropredy stage view. PHOTO: BEN NICHOLSON
FAIRPORT'S Cropredy Convention three-day open-air music festival will celebrate its 40th anniversary this year.
The event will take place August 8, 9 and 10 in picturesque watermeadows alongside the River Cherwell at Cropredy, in Oxfordshire, four miles north of Banbury.
The famous village beside the Oxford Canal will welcome up to 20,000 fans, who will enjoy more than 30 hours of live music over three days.
Many of the festival-goers arrive by narrowboat.
Headline acts for 2019 include The Waterboys (Thursday), Frank Turner (Friday) and host band Fairport Convention (Saturday).
Other major acts include Gogol Bordello (Thursday), Seth Lakeman (Friday) and Richard Thompson (Friday).
The line-up encompasses soaring harmonies from female ensembles Wildwood Kin and Daphne's Flight, instrumental virtuosity from Will Pound (harmonica), Eddy Jay (accordion) and Martin Simpson (guitar), and classic rock from Martin Barre and prog legends Caravan.
Lil Jim, Tors, The 4 of Us, Wilson & Wakeman, Richard Digance, Tide Lines and Zal Cleminson's Sin Dogs complete the line-up.
Festival founders and star performers Airport Convention.
One-day, two-day and three-day tickets are exclusively available from Fairport's website
www.fairportconvention.com/ticketsand by phone0844 581 1396.
Prices for tickets purchased between June 1 and July 31 are: Three-day (Thurs, Fri, Sat) ticket £145, two-day (Fri and Sat) ticket £130, Saturday-only ticket £80.
Prices for tickets purchased after July 31 (including at the festival gates) are: Three-day ticket £150, two-day ticket £135, Saturday-only ticket £85.
Children under 12 are admitted free provided they are accompanied by an adult ticket holder.
The festival's roots go back to the mid-1970s when Fairport Convention members Dave Pegg and Dave Swarbrick moved to Cropredy.
In 1976, Fairport Convention played an impromptu concert to support the village fete's fundraising. The event took place in the garden of Prescote Manor, owned by Dick Crossman (a Labour cabinet minister) and his wife Anne. The event was successful and was repeated in 1977 and 1978 (when nearly 2,000 people turned up).
After Fairport Convention lost its record deal in 1979, the band decided to stop touring and staged a farewell concert in the open air at Cropredy. The all-day event featured guest performers including Ralph McTell, Steve Ashley, Chris Leslie and Earl Okin.
The next year, Fairport decided to stage a one-day reunion concert. This 1980 reunion is generally regarded as the first 'proper' Cropredy festival and this time 7,000 people turned up.
In 1981, the second reunion took place at Broughton Castle, south of Banbury. This was Fairport's first two-day festival and also the only time 'Cropredy' has been staged away from its home village. The festival returned to Cropredy the following year.
From 2000 onwards, the festival was extended from two to three days.
In 2007, for the first time in the event's history, all the tickets were sold before the gates opened. This happened again in 2014 and was repeated in 2017.
Fairport's Cropredy Convention is aimed at all ages with an emphasis on families and has developed a reputation as a particularly friendly and safe festival.
The event is renowned for its real ale bar which is used by the public and performers alike (there is no back-stage bar) making Cropredy one of the few major events where festival-goers mingle with the musicians.
Previous Post:Boat owners' survey results published
Next Post:Admire the beauty on heritage walk