text:
Feasibility of an implementation strategy for the integration of health promotion in routine primary care: a quantitative process evaluation
Alvaro Sanchez1,
Gonzalo Grandes ORCID: orcid.org/0000-0002-5217-66281,
Josep M. Cortada2,
Haizea Pombo1,
Catalina Martinez1,
Mary Helen Corrales3,
Enrique de la Peña4,
Justo Mugica5,
Esther Gorostiza6 &
on behalf of the PVS group
Process evaluation is recommended to improve the understanding of underlying mechanisms related to clinicians, patients, context and intervention delivery that may impact on trial or program results, feasibility and transferability to practice. The aim of this study was to assess the feasibility of the Prescribe Healthy Life (PVS from the Spanish "Prescribe Vida Saludable") implementation strategy for enhancing the adoption and implementation of an evidence-based health promotion intervention in primary health care.
A descriptive study of 2-year implementation indicators for the PVS clinical intervention was conducted in four primary health care centers. A multifaceted collaborative modeling implementation strategy was developed to enhance the integration of a clinical intervention to promote healthy lifestyles into clinical practice. Process indicators were assessed for intervention reach, adoption, implementation, sustainability and their variability at center, practice, and patient levels.
Mean rates of adoption by means of active collaboration among the three main professional categories (family physicians, nurses and administrative personnel) were 75% in all centers. Just over half of the patients that attended (n = 11650; 51.9%) were reached in terms of having their lifestyle habits assessed, while more than a third (33.7%; n = 7433) and almost 10% (n = 2175) received advice or a printed prescription for at least one lifestyle change, respectively. Only 3.7% of the target population received a repeat prescription. These process indicators significantly (p < 0.001) varied by center, lifestyle habit and patient characteristics. Sustainability of intervention components changed thorough the implementation period within centers.
The implementation strategy used showed moderate-to-good performance on process indicators related to adoption, reach, and implementation of the evidence-based healthy lifestyle promotion intervention in the context of routine primary care.
Sources of heterogeneity and instability in these indicators may improve our understanding of factors required to attain adequate program adoption and implementation through improved implementation strategies.
In the growing field of implementation research, the process of implementation of interventions is considered important in determining how to enhance their effectiveness, feasibility and sustainability [1, 2]. Further, the development, implementation and evaluation of complex health interventions all require careful consideration not only of outcomes obtained but also of the processes involved [3]. Process evaluations within trials explore the implementation, receipt and setting of an intervention, and help interpret the outcome results and ascertain the true implications of interventions in real practice [4, 5]. Further, this type of evaluation is particularly important in multisite trials, where the "same" intervention may be implemented and received in different ways, and consequently, may make it possible to assess fidelity and to monitor tolerable intervention doses and their variability. A better understanding of program implementation may also reveal opportunities for refining intervention content and delivery [6]. Lastly, process evaluation of intervention trials may inform future implementation and roll-out of the intervention in other contexts and settings, and indicate how interventions could move from research to practice [3, 5, 6].
The Prescribe Healthy Life (PVS from the Spanish "Prescribe Vida Saludable") strategy aims to optimize health promotion practice in primary and community care through implementation research [7]. Though no clinical intervention has a greater potential impact on public health than the promotion of healthy lifestyles, it remains far from being an integrated element of clinical practice, and hence, health promotion in primary care is an excellent example of the so-called "translational gap".
PVS follows a stepwise framework, appropriate for the design, evaluation and translation of complex interventions in clinical settings [3, 8]. In 2006, a preclinical phase was carried out to characterize the problem of health promotion integration, analyzing the causes of and barriers to change as well as the theoretical basis for developing solutions [7]. Then, in 2008, we conducted the phase I or modeling phase, in which four primary health care (PHC) centers, following an implementation strategy based on a collaborative and facilitated process [9], planned and designed intervention programs adapted to their specific contexts and resources, and identified strategies for change and mechanisms through which interventions should operate. This was done collaboratively among health care professionals, researchers, health service management, community workers and public health professionals. In the present paper, we describe the phase II pilot study conducted in the same four PHC centers with the goal of piloting and optimizing the previously designed intervention programs and their assessment procedures, and exploring the adoption, implementation, sustainability, acceptance and potential effectiveness and efficiency of the intervention programs.
The aim of the process evaluation reported in this paper was to assess the feasibility of the PVS implementation strategy for integrating healthy lifestyle promotion in PHC. Within the present study, feasibility concerns to the extent, likelihood, and manner in which an evidence-based health promotion intervention has been implemented as a direct result of performing an implementation strategy aimed at enhancing the adoption of the intervention [10]. Specifically, we describe PHC population-based indicators of the reach, adoption, implementation and sustainability of a healthy lifestyle promotion intervention in the context of routine primary care, and their variability at center, practice, and patient levels. We also identify socio-demographic and clinical characteristics associated with exposure to the intervention.
Study design and setting
A descriptive study of 2-year implementation indicators for the PVS clinical intervention was conducted in four PHC centers. The study protocol was approved by the Primary Care Research Committee of the Basque Health Service, Osakidetza, and by the Basque Country Clinical Research Ethics Committee (Ref: 6/2009). Our health service provides universal coverage that is free at the point of use, apart from co-payment for drugs, funded through regional general taxation. Each resident is included on the list of one practice under the care of a family physician or a pediatrician and a primary care nurse, who offer comprehensive primary care and access to hospital services. Primary care professionals work in full-time PHC teams at local centers providing health care for users in a defined geographical area.
The PVS implementation strategy has two main targets:
PHC centers and their staff, as the initiative seeks to improve health promotion practice through the mutual adaptation of evidence-based interventions and the center's organization; and
primary care patients attending these health centers that fail to adhere to at least one of the following lifestyle recommendations: regular physical activity, healthy diet and abstinence from smoking.
PHC centers
Eligible centers were identified through the Medical Directors of the seven primary care organizations into which PHC is structured in the Basque Health System. Of the seven organizations, four agreed to collaborate and each selected one PHC center with the following eligibility criteria: (i) previous involvement in innovative health promotion programs or preventive practice optimization initiatives, (ii) the existence of community health promotion initiatives in their geographical area of influence, (iii) the presence of a positive attitude and cooperation among professionals, and (iv) the possibility of making changes in the organization of services. After explaining the study objectives and work plan in a meeting in each candidate center, we requested individual written commitment by a majority plus one of the staff in each of professional category (administrative personnel, nurses, family physicians, pediatricians, and others). The minimum required number of staff was obtained for all categories in all four centers. Health care professionals that committed to participate also gave written consent for the anonymous management and publication of data pertaining both to patients assigned to their practices and indicators related to their health care delivery activity.
PHC users
As public health programs, the PVS intervention programs aim to have an impact at the whole population level. Hence, their target population was all PHC users aged 10 to 65 years old registered with any of the collaborating PHC clinicians in any of the collaborating centers that attended the center during the program implementation period (from September 2011 to September 2013). We excluded patients who moved, those diagnosed with psychotic disorders, neurological degenerative diseases, or severe mental retardation, and those in residential care or with terminal illnesses.
Clinical intervention
The PVS clinical intervention targets three key aspects of a healthy lifestyle, namely, regular physical activity, a healthy diet and abstinence from smoking. The intervention is grounded in evidence-based theoretical models explaining behavior change: the Health Belief Model, the Theory of Planned Behaviour, the Transtheoretical model and Social-Cognitive Theory [7]. The multiple active intervention components and strategies are structured following the 5 A's (Ask, Advise, Agree, Assist, and Arrange follow-up) intervention framework [11], as it encompasses most of the evidence-based behavior modification techniques used to promote changes in the targeted lifestyles. It is considered that this strategy is useful in primary care for its simplicity, and low requirements for training and time, as well as for the scientific evidence supporting its effectiveness [7,12,13,14,, 11–15].
Implementation strategy
The PVS implementation strategy worked at multiple levels: bottom-up primary care organizational change, top-down support from managers, community involvement, and the development of innovative e-health information and communication technologies [9]. Among the multiple specific implementation strategies used, three are directly related to the present study.
First, with the aim of adapting the clinical intervention to the context of each center where it was to be implemented and to redesign the health promotion delivery system, an action research-based collaborative modeling process was conducted in each of the centers with the active participation of PHC professionals and managers as well as researchers. Through a bottom-up decision making process based on discussion and consensus meetings among a multi-professional primary care team and community members guided by an external facilitator, staff in each center modeled and adapted the clinical intervention to their specific contexts and resources, and identified strategies for change, and mechanisms through which the interventions would operate. Between 10 and 13 working sessions were needed involving most of the primary care staff and at least one community-based organization. The process yielded multiple tailored healthy lifestyle intervention programs, varying between centers in the agents involved in each of the intervention actions as well as in the resources for their implementation and execution. Generally, within the collaborating PHC centers, administrative assistants, nurses and physicians were all involved in the PVS program but to different degrees. All professional categories were somewhat involved in the Assess step (A1), with considerable participation of administrative staff in order to perform the assessment before the medical consultation. Outside the center, individuals were themselves able to perform the assessment of healthy lifestyles through the PVS web questionnaire or a paper-based version of the same questionnaire delivered at community resources (e.g., company occupational health departments). The Advice and Agree steps (A2 and A3) were mainly delivered by family physicians, while the Assist step (A4) was mainly performed by nurses. All participants inside and outside the centers were involved in the Arrange follow-up (A5) process with particular involvement of administrative assistants and nurses. Based on reports by a sample of 32 professionals over 3 months of intervention piloting, the estimated mean time dedicated to each intervention component was 3, 7.84 and 13.67 min for assessing patient lifestyle (A1), and advising on (A2) and prescribing (A4) lifestyle change, respectively.
Second, an information and communication tool integrated in the electronic health record was developed in order to help and guide practitioners' clinical decision making related to diagnosis and therapeutic interventions in promoting healthy lifestyles. The functions of this software are the following: a) to identify people whose lifestyle habits have not been assessed and recorded; b) to assess patients' physical activity levels, diet, and smoking habits, complemented by paper-based questionnaires and a self-assessment website, c) to flag those not adhering to the recommendations; d) to identify high-priority populations for intervention based on data recorded in the electronic health records, e.g., age, motivation to change behavior, and chronic diseases; e) to guide health professionals in providing personalized and tailored advice based on effective communication of risks and benefits associated with lifestyle; f) to facilitate the prescription of plans for lifestyle modification, providing algorithms, evidence-based guidance and recommendations, warnings, timetables and information about community resources; f) to facilitate patient monitoring thorough the follow-up; and g) to integrate all the information and make it available to all staff of the center, thereby making it easier to track patients.
And lastly, there were audit and feedback strategies in the form of monthly tracking of process indicators related to patient reach and extent of implementation of intervention components. This auditing and feedback sought to maintain fidelity and intensity once initial implementation had been achieved.
Process indicators pertaining to program execution and user socio-demographic (age, sex, socioeconomic status) and clinical (chronic health problems) characteristics were calculated from routine data extracted from the electronic health records of Osakidetza. The Primary Care Research Unit of Bizkaia (UIAPB) in conjunction with the Informatics Department of Osakidetza were responsible for the coordination and quality control of the process and execution of the study. This research unit is expressly authorized to retrieve and use data from the electronic health records for research by the owner thereof, namely, the Governing Board of Osakidetza. The data were kept confidential, anonymized, encrypted and managed centrally, in accordance with the Spanish laws on data protection and patient autonomy.
Specifically, within the program, healthy lifestyles were assessed with the 10-item PVS-Healthy Lifestyle Screening questionnaire. Briefly, content validity of this screening questionnaire was supported by an expert panel. Further, we conducted a pilot concurrent validity study in a sample of 126 patients. Firstly, we found that the physical activity screening items were acceptably correlated with total activity counts (r = 0.46; p < 0.001) and minutes of moderate-to-vigorous activity (r = 0.34; p < 0.001) measured with an ActiGraph GT3X accelerometer. Secondly, the two items used to screen fruit and vegetable consumption were well correlated with the total (r = 0.50; p < 0.001) score on a modified version of the Mediterranean Diet Adherence Screener used in the PREDIMED study [16] and with the specific items regarding fruit and vegetable consumption (r = 0.54; p < 0.001) on the PREDIMED Food Frequency Questionnaire [17]. Thirdly, the responses obtained in the tobacco use sub-scale showed a strong correlation with the level of carbon monoxide in exhaled air (CO in ppm) measured with a breath CO monitor (r = 0.69, p < 0.001) (data not published).
Using data extracted from health records for a 4-year period, we assessed whether each of the patients had any of nine groups of chronic diseases and also checked a list of 52 conditions and specific criteria defined for each condition to consider it active, based on the work of Orueta et al. [18]. For the purposes of this study, multimorbidity was defined as the coexistence of more than one health problem in the same patient considering these 52 conditions.
A Deprivation Index (DI), defined by census tract, developed and published in 2008 [19] was used as a socioeconomic status indicator. This index is an ordinal variable, categorized into five levels (DI quintiles), providing a measure of the socioeconomic characteristics of the population of census tracts. Its design allows the estimation of socioeconomic and environmental inequalities among inhabitants by census tract in Spain. The calculation takes into account the percentages of residents in a tract who are manual workers, unemployed, temporary employees, or have an poor level of educational attainment, overall and also specifically among young people, according to the most recent census data available (2001).
To assess the effectiveness of the PVS programs in terms of public health significance we used the RE-AIM (Reach, Efficacy, Adoption, Implementation, Maintenance) framework [20]. This framework underlines that to have a public health impact programs require more than efficacy. They must reach a diverse and representative sample of the at-risk population. Their adoption in specific practice/clinical settings must be realistic. Further, programs must be able to be implemented as intended. Lastly, they must also be maintained over time in a sustainable way by the individual and the practice/clinical setting. These dimensions together determine the overall impact of a program at the population level. Specifically, the process indicators assessed within the RE-AIM dimensions are:
Reach (Patient level)
Exposure of patients to the program at each center in terms of the percentage of the target population (patients 10 to 65 years old who attended the center at least once during the program implementation period) who had their lifestyle habits assessed, and consequently were exposed to the program.
Adoption (Practice/Center level)
Professional participation in the program: the percentage of professionals by professional category and percentage of practices (multidisciplinary health care professionals with an assigned list of patients, e.g., family physician plus nurse) in each center participating in the program who had performed at least one intervention component.
Implementation (Practice/Center level)
The percentage of practices that assessed at least 50% of their target population, gave advice to 25% and prescribed lifestyle change with a personalized plan to 10%.
Implementation (Patient level)
Reception of intervention components as intended in terms of the percentage of target patients whose lifestyle habits were assessed and included because they failed to adhere to at least one healthy lifestyle recommendation (I1: Included); the percentages of target patients (I2a: Advised-target) and included patients (I2b: Advised-included) who received advice; the percentages of target patients (I3a: Assisted-target), included patients (I3b: Assisted-included), and advised patients (I3c: Assisted-advised) who received a prescription for lifestyle change; and the percentages of target patients (I4a: Arranged-target), included patients (I4b: Arranged-included), and prescribed patients (I4c: Arranged-prescribed) who received a repeat prescription related to the same aspect of their lifestyle.
Sustainability of intervention program components over time in terms of the monthly rates of the aforementioned process indicators over 2 years.
Lastly, we also explored the association of patient socio-demographic and clinical characteristics with the likelihood of being assessed, advised or prescribed lifestyle changes.
Data analysis was performed with SAS software. Frequencies and proportions were used to describe professional, practice and patient characteristics for continuous and categorical variables, respectively. Process indicators for each collaborating center and in total regarding adoption, reach and implementation were expressed as frequencies and percentages along with their corresponding 95% confidence intervals (CIs). Survival analysis was used to describe sustainability and compare the incidence of exposure to the intervention components (time until exposure to lifestyle assessment, advice, and prescription for lifestyle change) between the different centers. For univariate analysis of the association of time until exposure to the different intervention components with the comparison centers, cumulative survival probabilities over 24 months were estimated and compared using Kaplan-Meier curves along with the log-rank and Wilcoxon tests (SAS PROC LIFETEST, version 9.2, SAS Institute; 2008). Time to event or censoring was defined as the time between study entry (date of baseline interview) and date of exposure to the specific intervention component, or possible censoring at the end of the study (September 19, 2013), respectively.
Adjusted hazard ratios (AHRs) and 95% CIs describing relations between patient characteristics and the exposure to the intervention components were estimated using Cox proportional hazards models [21]. These models included health care center, sex, age, recorded chronic diseases, and the deprivation index as independent factors. The proportional hazard assumption was tested, introducing the interaction of each of the variables with time in the models. In the case of covariates for which the proportional hazard assumption was not satisfied, the Cox model was extended with time-dependent variables allowing hazard ratios to change over time.
Practitioner team level (Center/professional level)
Adoption, Implementation & Maintenance
Table 1 describes the size and composition of the four collaborating PHC centers. Briefly, center size ranged from 14 to 36 staff mainly consisting of family physicians (range: 4 to 13), practice nurses (range: 5 to 13), pediatricians (range: 1 to 2) and administrative personnel (range: 4 to 6). Other professional categories included midwives, dentists and family planning physicians. Overall, 68 out of a total of 90 staff (75%) across professional categories (administrative personnel, nurses, family physicians, pediatricians, and others) initially committed in writing to participate in the study. This initial collaboration rate varied between centers ranging from 68 to 100% (p < 0.01). Within the centers, family physicians followed by nurses and administrative personnel were the most strongly represented categories, while pediatricians and especially midwives had the lowest rates of collaboration. As final unit of observation at center/professional level, we considered practices: the initial collaboration within centers ranged from 63 to 100% of practices with an overall participation of 84% from a total of 32.
Table 1 Professional and practice level participation, and patient demographic and clinical characteristics, by center
Implementation of program components also varied between practices and centers. Specifically, rates of participation of practices in the execution of program components were not similar, except in one of the centers in which all teams collaborated and worked equally well. Overall, only 48% of practices assessed the lifestyles of 50% of all target patients that attended the center at least once during the program implementation period. Within centers, this rate of assessment was achieved by half or more than half of practices in three of the centers. However, only in two of the centers did half or more than half of collaborating practices reach levels of 25% or 10% of target patients being advised or prescribed lifestyle changes, respectively.
Patient level
Reach, Implementation & Maintenance
A total sample of 22459 target patients aged 10 to 65 years old assigned to collaborating practices attended their PHC center at least once during program implementation period. As presented in Table 1, overall, half of the target patients were male (50.6%) and more than a half (55.2%) were young adults 20 to 45 years of age, with 37.9% and 7% of target patients being adults and adolescents, respectively. Approximately 40% of target patients had at least one chronic condition. The most prevalent diagnosed chronic health problems were mental health problems (16.2%) followed by cardiovascular (12.8%) and metabolism- related (7.8%) diseases.
Within centers, a higher percentage of women were present in the sample in center 2, and the age distribution of primary care users was slightly older in center 1. The most distinct characteristic of the populations was socioeconomic status (Table 1), with one of the centers having the vast majority of users in the lowest status (86.5%), while in two other centers users were mostly included in the three highest categories, and in the fourth center users were mostly in the second (59%) and lowest (29%) socioeconomic status categories.
Of the total sample of patients who attended the centers, 11650 (51.9%) had their lifestyle habits assessed (Table 2). The percentage of target patients reached ranged from 36.6 to 82.8% in collaborating centers. Among patients whose lifestyles were assessed, 10505 (90.2% of those assessed) did not adhere to at least one of the three healthy lifestyle recommendations considered and were therefore included in the intervention program (I1; see Table 1). Specifically, 32.1% of patients assessed and found to be eligible for the intervention were smokers, 74.7% did not consume five servings of fruits and vegetables a day, and 60.6% did not meet the recommended levels of aerobic physical activity (moderate intensity physical activity for ≥30 min 5 day/week or vigorous intensity activity for ≥20 min 3 day/week, or a combination of the two). The other 1145 (9.8%) adhered to recommendations on all three healthy lifestyles and were excluded from receiving the intervention. Among the collaborating centers, center 2 had the highest cumulative prevalence of unhealthy lifestyles.
Table 2 Implementation indicators at target and included patient population levels, by center and lifestyle habit
Advice on change in at least one of the lifestyle habits was provided to a third (33.7%; n = 7433) of all target patients (I2a) and to 70.7% of included patients found not to adhere to at least one lifestyle recommendation when assessed (I2b) (Table 2). Regarding the areas in which advice was given, diet was the lifestyle on which the highest percentage of patients received advice (24.2% of target patients; 67.4% of those not eating five servings of fruits and vegetables a day). Advice for increasing physical activity was provided to 16.5% of target patients and 56.7% of those not reaching recommended physical activity levels, while advice on smoking cessation was given the least in terms of reaching target patients (10.6% of target patients; 65.1% of those identified as smokers at inclusion).
Regarding lifestyle prescription, 9.7% (n = 2175) of all target patients collaboratively designed and then received a printed prescription for at least one healthy lifestyle change (I3a), diet being the lifestyle most frequently addressed (6.4% of all target patients) followed by physical activity and smoking cessation (3.5% and 1.25% of all target patients, respectively). From those included in the program with unhealthy lifestyles, 20.7% received a prescription for at least one lifestyle change (I3b), while 29.3% of those who received advice regarding lifestyle changes finally ended up designing and receiving a personalized lifestyle change plan (I3c). Further, of those who received dietary advice, 26.5% were also prescribed dietary changes, while prescriptions regarding increasing physical activity and smoking cessation were provided to 21.4% and 11.1% of those advised, respectively.
Only 3.7% of the target population received repeat prescriptions and consequently the full 5 A's intervention over the course of the program (I4a), again with diet being the lifestyle addressed in most cases (2.6% for diet; 1% for physical activity and 0.4% for smoking cessation). The percentage of patients with a repeat prescriptions rose to 7.8% and 37.9% in included patients' (I4b) and in those with a previous prescription (I4c), respectively. Multiple-lifestyle intervention indicators were as follows: 4.7% of the target population (n = 1057) received advice on all three lifestyles considered and 12.7% (n = 2861) received it on two. This corresponded to only 35 patients who attended the centers (0.15%) receiving a prescription to change physical activity, diet and smoking habits, while in 609 (2.7%) modifications in two aspects of patient lifestyles were planned and prescribed.
Figure 1 illustrates the cumulative exposure of patients to the main intervention components in the four collaborating centers over the 2-year program implementation period. There was a significant between-center difference in the monthly rate for assessment (A1), advice (A2) and prescription of a healthy lifestyle change (A4) (Log-rank test of equality for survival distributions < 0.001). Furthermore, 'center' did not satisfy the proportionality assumption (P < 0.001 for the interaction between center and time) and hence was included in an extended Cox model as a time-dependent variable (Table 3). As an example, during the first 3 months, compared to the reference center (center 1), exposure to assessment was 3.42, 8 and 6 times more likely in centers 2, 3 and 4, respectively. Patients of these three centers were more than 4 times more likely than those in center 1 to be exposed to advice, and 2 to 4.22 times more likely to receive a prescription for lifestyle change.
Cumulative exposure of patients to the main intervention components in the four collaborating centers over the 2-year program implementation period
Table 3 Characteristics of target population associated with exposure to the main intervention components: Assessment of lifestyles (A1), Advice on lifestyle change (A2), and Prescription of lifestyle change (A4)
With respect to the other variables included in the model, most patient personal and clinical characteristics where also associated with the implementation of the different intervention components (Table 3). Specifically, the hazard ratio for exposure to components of the healthy lifestyle promotion intervention was higher in women than in men (AHR of being assessed in men: 0.83; 95% CI: 0.80–0.86) and increased with patient age, 1.05-fold for every 5 years of age. Some of the chronic conditions were also related to exposure to intervention components. The hazard ratio for exposure to assessment, advice and prescription for lifestyle change was significantly higher in those with cardiovascular, musculoskeletal, respiratory, digestive, and metabolism-related diseases, among other conditions, than in patients without these conditions. Among these chronic health problems, cardiovascular diseases had the strongest association with being assessed (AHR: 1.41; 95% CI: 1.33 to 1.49), advised (HR: 1.51; 95% CI: 1.42 to 1.62), and receiving a prescription for lifestyle change (AHR: 1.87; 95% CI: 1.67 to 2.09).
Results of this pilot study showed that the PVS implementation strategy was feasible and achieved modest-to-good improvement in clinical practice regarding adoption, reach, and implementation of an evidence-based healthy lifestyle promotion intervention in the context of routine primary care. The main contribution of this study is the description of the significant heterogeneity observed in the assessed process indicators associated with lifestyle habits, patient characteristics, settings and implementation timeframe.
Overall, rates of adoption within centers were high in the three main professional categories considered, family physicians, nurses and administrative personnel. During the 2-year period of program implementation, more than the half of all the primary care users aged 10 to 65 years old were reached in the four centers in terms of having their lifestyles assessed. This level of reach should be considered notably high, given that the program has been implemented in "real world" conditions in primary care, among those attending routine appointments, and thus represents general and unselected sample of the primary care population for the groups covered. Other studies evaluating the feasibility of lifestyle screening in routine context have attained reach rates ranging from 49.6 to 86.7%, though these figures have been attained in shorter exposure periods or/and with limited sample sizes [22,23,24].
Research on healthy lifestyle promotion in clinical settings has established that intensive counseling in the form of advice and the use of behavioral change techniques are some of the active components that help individuals initiate and maintain health-related behavior change [7]. The PVS implementation strategy aimed to enhance the integration and feasibility of the execution of these effective intervention components [9]. PVS centers have been able to provide advice on change in at least one of the lifestyles considered to a third of patients who attended the centers and almost 10% of these patients have collaboratively designed and then received a printed prescription for at least one lifestyle change. Other implementation trials aiming to improve the promotion of healthy lifestyles have also shown positive results in terms of increasing screening and intervention rates [25,26,27,28,29]. However, as observed in other studies [30, 31], a full 5 A's intervention is rarely performed, only 4% of patients receiving all components in relation to at least one aspect of their lifestyle.
These process and performance indicators regarding adoption, reach and implementation varied between lifestyle habits, patient characteristics and centers. First, regarding lifestyle habits, higher percentages of patients received advice and a prescription for change in the case of physical activity and diet once these had been assessed, while smoking habits has been the lifestyle most commonly assessed but with the lowest rates of advice and prescription. This variability in the priority given to the healthy lifestyles was a result of the implementation strategy used, which sought to help collaborating centers adapt the intervention program to their actual context and resources in order to enhance its integration in routine service delivery in PHC. In this adaptation process, they were instructed to prioritize both the lifestyles to be addressed and strategies to re-organize the delivery of preventive actions within centers. Considering that 90% of patients assessed in this study failed to adhere to at least one of the lifestyle recommendations considered, it seems reasonable to apply some sort of prioritization strategy to deal with work overload and maximize feasibility of a population-level healthy lifestyle promotion program in the context of routine primary care. Further research is warranted as to identify what are the best cut-off points for attaining the optimal balance between feasibility and workload when identifying individuals in need of a healthy lifestyle promotion intervention.
Second, the delivery of health promotion actions has been found to be associated with various personal and clinical characteristics of the targeted population. Regarding patients' intra-personal characteristics, the likelihood of being assessed, receiving advice and being prescribed lifestyle changes increased with age and was higher in women than men. Those with chronic health conditions (e.g., cardiovascular disease) were also more likely to receive each of the intervention components. A possible explanation for these associations is that health care providers have targeted and prioritized their healthy lifestyle promotion actions to those more likely to face fewer obstacles to changing their lifestyle, such as, older patients who may have more free time (as they are working less or retired completely and have fewer obligations); or to those that would potentially benefit the most, such as those with a chronic health problem. Indeed, selective and targeted counseling of patients prioritizing among other factors patient with known health risks or readiness for change has been documented [32] and is currently recommended in order to maximize their impact [33, 34].
Moreover, factors beyond personal characteristics, such as socioeconomic status also influenced the implementation of intervention components. Specifically, each of the main intervention components were more likely to be received by those with higher socioeconomic status. Therefore, it seems that intra- and extra-personal characteristics of target populations may also explain variability in the integration and implementation of healthy lifestyle promotion and the feasibility of this type of intervention [32, 35].
Third, PHC center has been observed to be a great source of variability in program adoption, reach and implementation indicators. Overall, relatively high rates of adoption by staff have been attained in all the centers. This is not surprising given that written commitment from the majority of staff within the different categories was a requirement for study participation. However, actual rates of involvement and contribution differed: while in one of the centers all staff committed to participate and did so, in other centers complete participation was not attained. These rates of adoption may have a direct impact on both the actual reach of the program and the implementation of intervention components as could be observed in the present study. On the one hand, in the center in which all staff participated, more than 80% of the target population was reached in terms of the identification of at least one healthy lifestyle, and almost 60% received advice on lifestyle changes, as well as the highest percentage of target users (comparing with other centers) received a prescription of a lifestyle change plan. Additionally, within collaborating professionals, all of them actually showed good performance in terms of indicators of implementation. On the other hand, the center with the lowest rates of adoption obtained the poorest rates of implementation of intervention components at practices and patient levels (e.g., 37% of target patients assessed and only 2 out of 11 collaborating practices assessed at least 50% of target users seen during the program implementation period).
Furthermore, rates of adoption by staff and reach at the patient level may have contributed substantially to the observed variability in implementation rates at the center level. Specifically, the likelihood of being exposed to intervention components of advice and prescription for lifestyle change was 4 times more likely in the center with the highest rates of adoption and reach than the center with the lowest rates of adoption and reach. The likelihood of exposure to the intervention program in the other two centers with intermediate rates of adoption and reach was also significantly higher than in the center with the lowest rates. In this sense, based on the actual adoption and implementation of intervention components across collaborating health centers, we may distinguish three levels of implementation performance: high, medium and low.
Variability in program adoption by professionals, program reach and implementation indicators between different sites has also been reported in other implementation trials [24, 36]. Centers each have different contexts and thus implementation strategies must be targeted and adapted to those specific contexts. Even after a hypothetical adaptation, results and products would be context specific. That is, context is crucial, meaning that interventions may be implemented in different ways in different settings and thus outcomes may also vary [37,38,39].
And finally, another important finding of the present study is that the sustainability or the extent of exposure to intervention components over time differed between centers and varied thorough the implementation period within centers, probably reflecting intermittent efforts and continuous adaptation to the multiple unstable contextual and organizational factors in the centers, to the innovation itself, the providers, the processes involved and the interaction of all of these factors [40,41,42]. We should recognize that in the present implementation study competition with other initiatives, in particular those imposed by health system management, structural changes and staff movements, lack of ongoing training of staff, and technical problems with the information and communication tool may all have hindered ideal implementation of intervention components throughout the implementation period [see accompanying paper by Martinez et al.].
The present study has several limitations. First, the process evaluation refers to a prospective cohort study performed in four selected centers and the observational nature of the study together with the absence of a comparison group mean that it is not possible to attribute the results obtained to the implementation strategy alone. Although collaborating centers are apparently diverse, they may not be representative of all PHC centers in our health service. In addition, though we have described some characteristics regarding representativeness (in terms of PHC size and composition, socioeconomic status of catchment populations, and so on), missed information regarding other specific characteristics of the context may hinder interpretation of results. Though the external validity of the study may be questioned, implementation trials aim to conduct a broad evaluation of the translation of proven-efficacy interventions into routine care, assessing results in heterogeneous, unselected populations and real-life clinical settings [43, 44]. Another limitation relates to difficulties interpreting the results obtained, especially those concerning variability between centers/settings and the nature of changes or reasons for intermittent sustainability. Consequently, a qualitative inquiry study has also been performed to explore staff perceptions of the program implementation and its results [see accompanying paper by Martinez et al.].
The main strengths of the study are that it has been conducted at the population level and the quality of data assessed, as these were recorded in and subsequently retrieved from an established electronic health record.
Implementation research must be the priority in order to first transform our health systems into continuously learning organizations and consequently enact the final step of translating scientific knowledge to real-life clinical settings in an effort to close the translational gap. In doing so, engagement of all stakeholders is crucial, especially of those who interact with patients and are the actual providers of health care. However, contexts are heterogeneous and unstable and an adequate program adoption and implementation may not always be achieved. Identifying the factors behind implementation heterogeneity may help us to tailor implementation strategies, but comparative effectiveness research is needed to determine the best theoretically grounded and operationalized implementation strategies to improve clinical practice.
5 A's:
Ask, Advise, Agree, Assist, and Arrange follow-up
Assessment of healthy lifestyles
Advice on healthy lifestyle change
Prescription of a healthy lifestyle change
AHR:
Adjusted hazard ratio
CI:
I1:
Included: percentage of target patients whose lifestyle habits were assessed and included because they failed to adhere to at least one healthy lifestyle recommendation
I2a:
The percentage of target patients who received advice
I2b:
The percentage of included patients who received advice
The percentage of target patients who received a prescription for lifestyle change
The percentage of included patients who received a prescription for lifestyle change
I3c:
The percentage of advised patients who received a prescription for lifestyle change
The percentage of target patients who received a repeat prescription related to the same aspect of their lifestyle
The percentage of included patients who received a repeat prescription related to the same aspect of their lifestyle.
The percentage of prescribed patients who received a repeat prescription related to the same aspect of their lifestyle.
PHC:
PREDIMED:
Prevención con Dieta Mediterranea study
PVS:
Prescribe Vida Saludable study
RE-AIM:
Reach, Efficacy, Adoption, Implementation, Maintenance framework
UIAPB:
The Primary Care Research Unit of Bizkaia
Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what it is and how to do it. BMJ. 2013;347:f6753.
Neta G, Glasgow RE, Carpenter CR, Grimshaw JM, Rabin BA, Fernandez ME, Brownson RC. A Framework for Enhancing the Value of Research for Dissemination and Implementation. Am J Public Health. 2015;105(1):49–57.
Medical Research Council. Developing and evaluating complex interventions: new guidance. London: Medical Research Council; 2008.
Saunders RP, Evans MH, Joshi P. Developing a process-evaluation plan for assessing health promotion program implementation: a how-to guide. Health Promot Pract. 2005;6(2):134–47.
Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14:15.
Steckler A, Linnan L. Process Evaluation for Public Health Interventions and Research. San Francisco: Jossey-Bass; 2002.
Grandes G, Sánchez A, Cortada JM, Balague L, Calderon C, Arrazola A, Vergara I, Millan E. For the "Prescribe Vida Saludable" group, Is integration of healthy lifestyle promotion into primary care feasible? Discussion and consensus sessions between clinicians and researchers. BMC Health Serv Res. 2008;8:213.
Medical Research Council. A framework for development and evaluation of complex interventions to improve health. London: Medical Research Council; 2000.
Sanchez A, Grandes G, Cortada JM, Pombo H, Balague L, Calderon C. Modelling innovative interventions for optimising healthy lifestyle promotion in primary health care: 'Prescribe Vida Saludable' phase I research protocol. BMC Health Serv Res. 2009;9:103.
Bowen DJ, Kreuter M, Spring B, Cofta-Woerpel L, Linnan L, Weiner D, Bakken S, Kaplan CP, Squiers L, Fabrizio C, Fernandez M. How we design feasibility studies. Am J Prev Med. 2009;36(5):452–7.
Goldstein MG, Whitlock EP, DePue J. Planning Committee of the Addressing Multiple Behavioral Risk Factors in Primary Care Project. Multiple behavioral risk factor interventions in primary care. Summary of research evidence. Am J Prev Med. 2004;27:61–79.
Sanchez A, Bully P, Martinez C, Grandes G. Effectiveness of physical activity promotion interventions in primary care: A review of reviews. Prev Med. 2015;76(Suppl):S56–67.
Richards J, Hillsdon M, Thorogood M, Foster C. Face-to-face interventions for promoting physical activity. Cochrane Database Syst Rev. 2013;9, CD010392.
Bhattarai N, Prevost AT, Wright AJ, Charlton J, Rudisill C, Gulliford MC. Effectiveness of interventions to promote healthy diet inprimary care: systematic review and meta-analysis of randomised controlled trials. BMC Public Health. 2013;13:1203.
Stead LF, Buitrago D, Preciado N, Sanchez G, Hartmann-Boyce J, Lancaster T. Physician advice for smoking cessation. Cochrane Database Syst Rev. 2013;5, CD000165.
Schröder H, Fitó M, Estruch R, Martínez-González MA, et al. A short screener is valid for assessing Mediterranean diet adherence among older Spanish men and women. J Nutr. 2011;141(6):1140–5.
de la Fuente-Arrillaga C, Vázquez-Ruiz Z, Bes-Rastrollo M, et al. Reproducibility of a food frequency questionnaire (FFQ) validated in Spain. Public Health Nutr. 2010;13:1364–72.
Orueta JF, García-Álvarez A, García-Goñi M, Paolucci F, Nuño-Solinís R. Prevalence and costs of multimorbidity by deprivation levels in the Basque country: a population based study using health administrative databases. PLoS ONE. 2014;9(2):e89787.
Domínguez-Berjón MF, Borrell C, Cano-Serral G, Esnaola S, Nolasco A, et al. Constructing a deprivation index based on census data in large Spanish cities (the MEDEA project). Gac Sanit. 2008;22:179–87.
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.
Cox DR. 1972) Regression models and life tables (with discussion. J R Stat Soc. 1972;34:187–220.
Krist AH, Phillips SM, Sabo RT, Balasubramanian BA, Heurtin-Roberts S, Ory MG, Johnson SB, Sheinfeld-Gorin SN, Estabrooks PA, Ritzwoller DP, Glasgow RE, MOHR Study Group. Adoption, reach, implementation, and maintenance of a behavioral and mental health assessment in primary care. Ann Fam Med. 2014;12(6):525–33.
Krist AH, Woolf SH, Frazier CO, Johnson RE, Rothemich SF, Wilson DB, Devers KJ, Kerns JW. An electronic linkage system for health behavior counseling effect on delivery of the 5A's. Am J Prev Med. 2008;35(5):S350–8.
Rodriguez HP, Glenn BA, Olmos TT, Krist AH, Shimada SL, Kessler R, Heurtin-Roberts S, Bastani R. Real-world implementation and outcomes of health behavior and mental health assessment. J Am Board Fam Med. 2014;27(3):356–66.
Aspy CB, Mold JW, Thompson DM, Blondell RD, Landers PS, Reilly KE, Wright-Eakers L. Integrating screening and interventions for unhealthy behaviors into primary care practices. Am J Prev Med. 2008;35(5 Suppl):S373–80.
Goodwin MA, Zyzanski SJ, Zronek S, Ruhe M, Weyer SM, Konrad N, Esola D, Stange KC. A clinical trial of tailored office systems for preventive service delivery. The Study to Enhance Prevention by Understanding Practice (STEP-UP). Am J Prev Med. 2001;21(1):20–8.
Hogg W, Lemelin J, Moroz I, Soto E, Russell G. Improving prevention in primary care: Evaluating the sustainability of outreach facilitation. Can Fam Physician. 2008;54(5):712–20.
Grunfeld E, Manca D, Moineddin R, Thorpe KE, Hoch JS, Campbell-Scherer D, Meaney C, Rogers J, Beca J, Krueger P, Mamdani M, BETTER Trial Investigators. Improving chronic disease prevention and screening in primary care: results of the BETTER pragmatic cluster randomized controlled trial. BMC Fam Pract. 2013;14:175.
Harris MF, Chan BC, Laws RA, Williams AM, Davies GP, Jayasinghe UW, Fanaian M, Orr N, Milat A, CN SNAP Project Team. The impact of a brief lifestyle intervention delivered by generalist community nurses (CN SNAP trial). BMC Public Health. 2013;13:375.
Carroll JK, Antognoli E, Flocke SA. Evaluation of physical activity counselling in primary care using direct observation of the 5As. Ann Fam Med. 2011;9(5):416–22.
Sherson EA, Yakes Jimenez E, Katalanos N. A review of the use of the 5 A's model for weight loss counselling: differences between physician practice and patient demand. Fam Pract. 2014;31(4):389–98.
Bock C, Diehl K, Schneider S, Diehm C, Litaker D. Behavioral counseling for cardiovascular disease prevention in primary care settings: a systematic review of practice and associated factors. Med Care Res Rev. 2012;69(5):495–518.
Lin JS, O'Connor E, Whitlock EP, Beil TL. Behavioral counseling to promote physical activity and a healthful diet to prevent cardiovascular disease in adults: a systematic review for the U.S. Preventive Services Task Force. Ann Intern Med. 2010;153:736–50.
Grandes G, Sánchez A, Torcal J, Sánchez-Pinilla RO, Lizarraga K, Serra J, PEPAF Group. Targeting physical activity promotion in general practice: characteristics of inactive patients and willingness to change. BMC Public Health. 2008;8:172.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.
Wilcox S, Parra-Medina D, Felton GM, Poston MB, McClain A. Adoption and implementation of physical activity and dietary counseling by community health center providers and nurses. J Phys Act Health. 2010;7(5):602–12.
Dickinson LM, Dickinson WP, Nutting PA, Fisher L, Harbrecht M, Crabtree BF, Glasgow RE, West DR. Practice context affects efforts to improve diabetes care for primary care patients: a pragmatic cluster randomized trial. J Gen Intern Med. 2015;30(4):476–82.
Hawe P, Shiell A, Riley T. Complex interventions: how "out of control" can a randomised controlled trial be? BMJ. 2004;328(7455):1561–3.
Datta J, Petticrew M. Challenges to evaluating complex interventions: a content analysis of published papers. BMC Public Health. 2013;13:568.
Wiltsey Stirman S, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7:17.
Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50.
Greenhalgh T, Macfarlane F, Barton-Sweeney C, Woodard F. "If we build it, will it stay?" A case study of the sustainability of whole-system change in London. Milbank Q. 2012;90(3):516–47.
Glasgow RE, Lichtenstein E, Marcus AC. Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003;93:1261–7.
Pinnock H, Epiphaniou E, Taylor SJ. Phase IV implementation studies. The forgotten finale to the complex intervention methodology framework. Ann Am Thorac Soc. 2014;11(2):S118–22.
We gratefully acknowledge all the PVS participants who contributed to the focus groups and the representatives of the public health department who accompanied the facilitator in the interviews (see Additional file 1: Members of the PVS group).
The PVS project was supported by the Carlos III Health Institute of the Spanish Ministry of Economy and Competitiveness, co-financed by the European Regional Development Fund (research grant PS09/01461), the Health Department of the Basque Government (research grants 2007111009, 2009111072, and 2011111145), the Basque Foundation for Social and Health Care Innovation (grant CA-2012-086), the Basque Research Center in Chronicity-Kronikgune (grant 11/056), and the Spanish Primary Care Research Network for Prevention and Health Promotion (redIAPP RD06/0018/0018 and RD12/0005/0010). The funding body had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Since data supporting the present study regards to routine data retrieved from the electronic health records of the Basque Health Service-Osakidetza, it will be only shared upon justified request to the study guarantors.
GG and AS conceived the idea and are the study guarantors. They are primarily responsible for the study design and planning, coordination and supervision, analysis and interpretation of results. AS and GG were responsible for the analysis of results and drafted the manuscript. JMC and HP collaborated in the study design, obtained funding, and were responsible for study coordination. MHC, EP, JM, and EG were local leaders at the primary care centers and contributed to implementation and interpretation of the process. All contributors have critically reviewed the manuscript and approved this version submitted for publication to Implementation Science.
The study protocol was approved by the Primary Care Research Committee of the Basque Health Service, Osakidetza, and by the Basque Country Clinical Research Ethics Committee (Ref: 6/2009). Health care professionals that committed to participate also gave written consent for the anonymous management and publication of data pertaining both to patients assigned to their practices and indicators related to their health care delivery activity.
Primary Care Research Unit of Bizkaia, Basque Healthcare Service - Osakidetza, BioCruces Health Research Institute, Luis Power 18, 4ª planta, E48014, Bilbao, Spain
Alvaro Sanchez
, Gonzalo Grandes
, Haizea Pombo
& Catalina Martinez
Deusto Primary Health Care Center, Bilbao-Basurto Integrated Care Organization– Osakidetza, BioCruces Health Research Institute, Luis Power 18, E48014, Bilbao, Spain
Josep M. Cortada
La Merced Primary Health Care Center, Bilbao-Basurto Integrated Care Organization – Osakidetza, Luis Iraurrizaga 1, 48003, Bilbao, Spain
Mary Helen Corrales
Sondika Primary Health Care Center, Uribe Integrated Care Organization – Osakidetza, Lehendakari Agirre 41, 48160, Sondika, Spain
Enrique de la Peña
Beasain Primary Health Care Center, Goieri-Alto Urola Integrated Care Organization – Osakidetza, Bernedo s/n, 20200, Beasain, Spain
Justo Mugica
Matiena Primary Health Care Center, Barrualde-Galdakao Integrated Care Organization – Osakidetza, BioCruces Health Research Institute, Trañabarren 13-Bajo, 48220, Abadiño, Spain
Esther Gorostiza
Search for Alvaro Sanchez in:
Search for Gonzalo Grandes in:
Search for Josep M. Cortada in:
Search for Haizea Pombo in:
Search for Catalina Martinez in:
Search for Mary Helen Corrales in:
Search for Enrique de la Peña in:
Search for Justo Mugica in:
Search for Esther Gorostiza in:
Correspondence to Gonzalo Grandes.
Additional file 1: Appendix 1.
Members of the PVS group. (PDF 192 kb)
Sanchez, A., Grandes, G., Cortada, J.M. et al. Feasibility of an implementation strategy for the integration of health promotion in routine primary care: a quantitative process evaluation. BMC Fam Pract 18, 24 (2017). https://doi.org/10.1186/s12875-017-0585-5
Process evaluation
Service organization, utilization, and delivery of care


text:
Remote HiringPosted on Apr 03, 2020 Published by Jannelle Sanchez
Tips for Remote Hiring: How Atlassian is Making Virtual Interviews a Reality
Remote hiring is a process that companies across all sectors are now incorporating into their hiring strategy. To help set your team up for remote hiring success, HackerRank's Co-founder and CEO, Vivek Ravisankar, spoke with Atlassian's Andy Mountney about remote hiring best practices.
When it comes to remote interviewing, Atlassian is ahead of the curve—in fact, it's something they've been doing since their founding. Originally started in Australia, Atlassian began hiring remotely as a means to bring international talent to work at their Sydney HQ. Pursuing international talent meant some candidates weren't able to attend a traditional onsite—so remote interviews became a must-have. They've been refining and perfecting their remote hiring process ever since.
As the Talent Acquisition Site Lead for Atlassian's Sydney location, Andy Mountney has been helping his technical teams conduct remote interviews since 2018. To hear his advice on creating a smooth remote hiring process, read the key takeaways below.
Define, document, and communicate a consistent remote hiring process
Changes in policies and procedures will inevitably happen when making the shift to remote hiring. To minimize room for dysfunction, Andy advises that teams spend time defining and documenting what the new remote hiring process will look like. Then communicate the process to internal team members and candidates.
Start by defining & documenting your process
Explicitly defining the new workflow prevents confusion and empowers interviewers to deliver a positive remote candidate experience. It also proactively answers questions from interviewers, and enables teams to adjust quickly if a teammate—or the entire company—suddenly has to work remotely.
"I think one of the real strengths we had when making this pivot wasn't just the fact that we've already conducted so many remote interviews. It was the documentation that we had to support it," says Andy. "With it, we could lift very quickly at scale and build consistency into that change...so I'd certainly encourage people to document it and think about it."
Communicate clearly, and often
What's next after defining and documenting your new remote hiring process? Communicate it to your candidates. Many candidates have never gone through an entirely remote hiring process; it's the recruiter's responsibility to set expectations. Andy says it's also crucial that recruiters communicate the intended outcome of the process, should there be a mutual fit.
"It's important to make sure that the candidate understands [if] there could be an offer coming out of this process still if it's successful," says Andy. "You want your recruiters to be [asking]: Will you be ready if we make an offer? How can we help you make that decision?"
Especially when taking your hiring process remote, it's helpful to amp up your candidate communications. Atlassian has done this by increasing the number of digital touch points they have with their candidates throughout the hiring process—just one of the ways they've adapted their in-person hiring process to a remote-friendly one.
Don't skimp on candidate or interviewer prep
It's natural to feel more relaxed when working from home. But it's important for candidates to treat the remote interview the same way they would treat a traditional onsite. Andy encourages candidates to dedicate plenty of time to prepping; from his perspective, it's the best way they can set themselves up for success.
Preparing to interview from home
"Typically, if you were going to an interview as a candidate, you're going to prepare for going to a physical place. And you're going to think about, perhaps, your journey there," says Andy. "If you're interviewing remotely as a candidate, it's still important to take that step and just think about the environment you're going to deliver your interview in."
At Atlassian, Andy says it's standard to send candidates a guide with interview prep tips and suggestions. He likes to include things like:
Instruction on how to access the video interview tool they'll be using, and any other tools or software they'll need for the interview
A reminder to choose a clean and comfortable interview space
The names and LinkedIn profiles of the people on the interview panel
Adopt a 10-minute rule
Andy says it's equally important that the interview panel prepares for each interview.
"From the interviewer's perspective, it's important to make sure that interviewers are set up to switch into that interview mindset—just as they would be in the workplace."
To enable that, Atlassian likes to set aside an extra 10 minutes before the interview for both the interviewer and the candidate to get ready. During these 10 minutes, the interviewer and the candidates have the time to set up, calm any nerves, and get ready for their discussion.
"We block that time out in the interviewer's calendar so that they have that 10 minutes to get their brain into the right place to deliver the interview, get their laptops set up, and get their tools set up for the interview," Andy explains. "I think that really helps calm someone down and get them back into that right place to deliver."
When in doubt, practice empathy
For most candidates, remote interviewing is a new experience. And to make that transition smooth, empathy is a must-have. "I think for remote interviews, it's just about thinking 'How can I help facilitate something which is possibly a first-time experience for the person on the other end?,'" Andy stressed. And that starts with the interviewer.
Focus on putting the candidate at ease
"As an interviewer, you have as much responsibility as the candidate does to make it a great experience," Andy says. To accurately evaluate fit, it's key that interviewers give candidates a welcoming, comfortable atmosphere to showcase their skills.
"For the interviewer, [it's important] to make the interviewing experience as comfortable as possible, and to ensure that the [candidate] is only being evaluated on the skills and attributes that they should be." That means keeping focus on the candidate's skills—not their video background, or accidental interruptions from their family.
Evaluate on skills, not minor mishaps
Say, for example, the candidate is having trouble with their video tool in the first 5-10 minutes of the interview. While some interviewers might see this as a red flag, Andy stresses that this isn't a chance to judge the candidate. Instead, he feels strongly that interviewers should keep the evaluation to the interview itself.
"[It's a] big responsibility of the interviewer to help calm that person, settle them, and help them reset [in the event of an issue]," Andy argues. "It's not an opportunity to judge." A little bit of empathy for the candidate can go a long way, and can help you stay focused on what matters: their skills.
Use the flexibility of remote hiring to your advantage
Since remote interviewing can be done from home—versus an office—it's inherently more flexible. Andy sees that as an opportunity to build an even stronger relationship with the candidate.
"I think one of the advantages of the remote [interview] is that you can build in breaks very comfortably...whether it's hard stops over the course of 24 hours, or a longer period of time," Andy notes. With remote hiring, companies have the chance to break the interview process up into smaller, more manageable pieces.
Take, for example, breaks between interviews. "Typically, [you'd be] trying to fill that space if somebody was onsite," Andy explains. To keep the candidate engaged, you might have to orchestrate activities like office tours, team lunches, or coffee breaks.
But by cutting them out, you give candidates more room to reset, or prepare for their next round. "Now, you're actually giving that time back to candidates." And that helps candidates get in the right headspace to deliver a great interview.
The future of remote hiring at Atlassian
So how will this shift to remote hiring impact Atlassian's hiring process in the long run? "We always want to learn through experience—and inevitably, we're going to learn through this experience." Andy believes. "We're really fascinated to see the impact of a remote-only interviewing model."
Atlassian regularly surveys candidates on their interview experience: the highs, the lows, and everything in between. They plan to keep a close eye on that data to learn from this transition as it unfolds.
"Will it enhance or deliver specific changes that we've identified today? Absolutely not," Andy admits. "But when we get back in the office, it'll be a good opportunity to retro, reflect, and understand what the opportunities are: what we could've done better, and what [the process] will look like going forward."
Want to listen to the conversation live? Catch Vivek and Andy's interview on HackerRank Radio
Would you like to receive similar articles straight to your inbox?
previous article 4 Ways Candidates Can Prepare for a Remote Interview
Next article New Product Updates: Enabling Remote Hiring with HackerRank

redpajama_set_name: RedPajamaCommonCrawl


text:
Why your Cup horse 'can't win'
Scottish trainer Iain Jardine with his Melbourne Cup runner Nakeeta. Picture: Michael Klein
by Nathan Exelby
7th Nov 2017 5:09 AM
STRAIGHT-shooting owner and respected form analyst Luke Murrell has shot holes in all of the top chances for the Melbourne Cup at Flemington.
Murrell's Australian Bloodstock goes into the race with the well-exposed Big Duke and the more lightly raced import Red Cardinal. Previously they have won the race with Protectionist (2014) and also unearthed the freakishly talented Lucas Cranach, which ran third in 2011 despite a hoof injury.
Murrell isn't approaching this year's race with the same confidence he did with Protectionist, but feels there are many rivals that simply "can't win".
"I think there's a lot in the race you can put the pen through," he said.
"No doubt the horse with the best rating in the race is Humidor, but if you look at (Humidor's sire) Teofilo's record of getting 2400m horses, it's atrocious and he's had a few goes at getting 2400m and done nothing.
"He scares me because of that last run and Weiry's a freak, but not for me.
"Hartnell's a no, Almandin's a no, Tiberian's a no, Johannes Vermeer definitely won't run the trip."
He's also not glowing about the chances of new favourite Marmelo.
"I was a bit different to everyone else. I didn't think Marmelo was as good as others did (in the Caulfield Cup)," he said.
"It was a mad fence day and for 2000m of the 2400m he stayed on the fence. No disrespect to Single Gaze, but he still couldn't get past her after the post.
"Look, he's a nice horse and the way the field is, he's obviously a top-four or five chance."
Murrell believes Red Cardinal is capable of turning around the six lengths margin between the pair when they met in the Kergolay.
"Given what we know about Red Cardinal's issues with the skin disease that day, I'm pretty confident to say with even luck we will be beating Marmelo," he said.
Red Cardinal works on the grass at Werribee. Picture: Michael Klein
But there is a horse from left field he's giving a lot of respect to.
"Normally it's rubbish form, but I would give the Ebor winner (Nakeeta) some hope. He ran a record that day," he said.
Red Cardinal is likely to go right back in the field from barrier 24.
"There looks a lot of pressure in the race and we know he will be really strong through the line," he said.
Our bloke has a lot of upside. If we got a drop of rain I would be warming to say he's a guaranteed top-three chance.
"Big Duke, if he runs up to Sydney run, he will run top three, but Darren (Weir) is not 100 per cent sure just how good he is going.
"I really think this year it will be down to the fittest horse."
FRANKIE READY TO BREAK CUP HOODOO
FRANKIE Dettori touched down in Melbourne on Monday keen to erase the demons of Cups gone by and make the most of his late call-up for defending champ Almandin in the $6.2 million feature at Flemington.
Dettori's Cup mission dates back to 1993. He has always felt 1999 was the one that got away. That year he rode Central Park into second, but only after Godolphin's top seed Kayf Tara was sidelined by injury.
Two years ago he was a fast-closing second on Max Dynamite.
"This race has eluded me for so many years so the chance to ride the favourite is very exciting," he said.
"It is up there with the very best (races in the world).
"The Melbourne Cup has grown in stature over the last 20 years. Horses from all over the world, it's the one every jockey wants to win and I'd be lying if I said I didn't want to win it, so I'm going to try again.
"I managed to get 10 hours' sleep on the plane. The adrenaline has already kicked in, I'm so excited. It's going to be a great race and let's hope we can break this hoodoo."
Frankie Dettori on Central Park (right) finish second to Rogan Josh, ridden by jockey John Marshall (left), in the 1999 Melbourne Cup.
He described Almandin's last-start fourth in the Bart Cummings as "a good prep race".
"If he could do it twice, it would be absolutely amazing," he said.
Dettori is one of the world's most flamboyant riders but even he has been taken aback by what he has seen at Flemington during his Melbourne Cups visits.
"It's absolute mayhem," he says.
"One year someone stuck a broom on some sort of inflatable doll and started waving it in front of my horse.
"You see all sorts of masks and crazy things out there. We try to concentrate, but it's part and parcel of the Melbourne Cup carnival. It's all good banter and it's very exciting."
Dettori rates Marmelo the best of this year's imports and also has respect for Rekindling after his solid three-year-old season in Europe.
"The last run of Marmelo was pretty impressive. He looks like he needs two miles. He has had time to acclimatise, so he would be my No. 1 of the Europeans," he said.
Asked to compare his Arc winner Enable with Australia's champion Winx, Dettori said he would stick with the European filly.
"Take nothing away from Winx. She's won 22 races in a row, she's your phenomenon," he said.
"Who knows if it will happen or not (a clash between the two), but I would stick with mine."
Rekindling wins the Melbourne Cup
MELBOURNE CUP: Our Bart Cummings gives his race tips
REVEALED: The horses Coast punters are backing for the Cup
Fairytale Cup comeback everyone wants to see
Melbourne Cup form guide for race that stops nation
betting editors picks melbourne cup


Kim Milyoner 2014 for PC is a trivia game developed by Hacisoft. This game has triggered several great minds in the world. As the matter of fact, Hacisoft has recorded 500,000 – 1,000,000 download of this game wherein 8811 people have given it a rating of 3.53. Kim Milyoner 2014 for PC was previously introduced to Android devices and then recently launched for PC and laptop gaming. With the increasing number of download and positive feedbacks from users, the developer of the game found it necessary to bring another version of this application – and Kim Milyoner 2014 for PC has been launched.
The challenge is up to you. Playing Kim Milyoner 2014 for PC is fun and challenging. It is fun because you got to play with your friends online – or simply play offline using one PC. Since this is a trivia game, it can be challenging for players like you. You got to know a lot of stuffs to win this game.
The basic of Kim Milyoner 2014 for PC. If you are familiar with the game 'Who wants to be a Millionaire', then you probably have the general understanding about this game. Kim Milyoner 2014 for PC is simply answering the question posted on each level.
At the start of the game, there will be options or question categories wherein you have to choose. The beginning of the game marks the easiest questions. However, don't be too complacent as you might miss some parts of the question that will lead you to the false answer. In each question, you will be given three (3) choices for your answer. Once you selected an answer, you have to confirm it so that you can advance to the next question.
Unlocking levels. There are several levels in Kim Milyoner 2014 for PC that you need to accomplish in order to unlock the other succeeding levels. Once you completed answering questions in each level, you will be advanced to the next one. Each level has a corresponding prize when you get the answer correctly. You will be able to collect as many money as you can – as long as you answer the question correctly. Once you failed to answer a question, the pot money will be deducted by the amount of money that the question stands.
The worth of each question. Each question has a corresponding amount of money. Once you answered it right, you will get the amount and it will be added on your pot money. However, once failed, nothing will be added.
Your lifeline. At the start of Kim Milyoner 2014 for PC, you will be given 5 lifelines. Use these lifelines wisely and get as many levels as you can. Once you lose, you have to wait for another couple of hours for you to get your full life and will be able to play again.
Your intact knowledge. This game is about a lot of things. As you pick the category, make sure that you know a lot of things about that category, otherwise you will lose all your money and will no longer be a millionaire.
Free Game.One of the major features of Kim Milyoner 2014 for PC is that it is for FREE. Yes, you read it right. Once you have it installed to your PC or laptop, you get to play it all you want. However, there are items that you need to buy online if you want them added in your collection, especially when it is not yet unlocked in your level. You can also buy hints and lifelines just in case you run out of those items and you really wanted to answer the question.
Playing with your friends. You can also play Kim Milyoner 2014 for PCwith your friends and post your progress in Facebook. You can also invite other friends to play the game, should they want in the future.
Great memory and trivia game. This game is a cool way to refresh your memory about history, people, places and events. Kim Milyoner 2014 for PC is also a great game for parties.
Step 4: Start Google play store app and use its search tool to search Kim Milyoner 2014 download.
Step 5: Find Kim Milyoner 2014and start the installation.
Step 6: Launch the game and you can now play Kim Milyoner 2014 on pc using a mouse or your keyboard and even your touch screen, you can use the control button to emulate the pinch function to zoom in and out.
Enjoy playing Kim Milyoner 2014 on PC!!!


It's pretty simple. We are very interested in talking with corporations, municipalities and waste management firms interested in buying one of our units, investing in us, or partnering with us.
We are seriously seeking NGO partners as well as manufacturing partners overseas.
We are in the process of putting together a PPM to seek accredited investors for Seed and Series A investments.
or feel free to click on the Contact Us at top of menu and complete the form.


Melanie Fishbane holds an M.F.A. in Writing for Children and Young Adults from the Vermont College of Fine Arts. She is a lecturer and scholar. MAUD is her first novel. You can find out more about Melanie here.


text:
Trades Routes and Cultural Influences of the Philippine Islands 900-1500 AD
June 24, 2015, marks the 444th Foundation Day of the City of Manila. The Presidential Communications Development and Strategic Planning Office (PCDSPO) joins the commemoration by publishing a special webpage that examines its rich precolonial past, its evolution from a walled city to a megacity, and the significance of the Ultramar—symbol of the city the Spaniards once heralded as the Distinguished and Ever Loyal.
Manila is one of many pre-Hispanic polities throughout the islands that make up the Philippine archipelago. Sources for the pre-Hispanic polities, trade routes, and cultural influences include scholarship from Laura L. Junker's Raiding, Trading, and Feasting and inputs from archaeology Professor Cyril Calugay of the University of the Philippines-Diliman.


text:
globalnation / Asia & Pacific
NAVY BELITTLES THREAT
Critics rage against increased presence of China vessels
By: Cathrine Gonzales, Frances Mangosing - @inquirerdotnet
INQUIRER.net / 07:04 AM March 31, 2019
MANILA, Philippines — Two opposition senatorial candidates on Saturday called on the Duterte administration to protest against "aggressive moves" by China in the West Philippine Sea following reports of a surge in the presence of Chinese vessels in waters close to the biggest island occupied by Filipinos in the disputed waters.
The military's Western Command (Wescom) on Thursday reported that more than 600 Chinese vessels had been monitored since January near Pag-asa (Thitu) Island, one of nine islets and shoals occupied by Filipino forces west of Palawan province.
According to Bayan Muna chair and Makabayan bloc senatorial candidate Neri Colmenares, there seems to be a coordinated effort by the Chinese to constrict and restrict the areas in the disputed waters that Filipino fishermen and other Philippine vessels can enter.
"Fishermen have reported continued Chinese presence in Bajo de Masinloc [Panatag (Scarborough) Shoal] and our fishermen were shooed away by the foreigners while at the same time China is also boxing us out of Pag-asa Island and nearby areas," he said.
Fear of invasion
"The government should protest these types of actions and get the support of the international community against these aggressive moves in the West Philippine Sea," Colmenares said.
He expressed fears that China "might be gearing up to build more artificial islands or even invade our Pag-asa Island" and urged the Duterte administration to "prepare for this and not let China trample our sovereignty again."
Magdalo Rep. Gary Alejano, a Liberal Party candidate, lamented that President Duterte did not heed his warnings as early as two years ago that China was slowly trying to gain control of sandbars close to Pag-asa by massing up Chinese coast guard and naval vessels while "warding off" Philippine patrols in the area.
The sandbars are located between Pag-asa and Zamora (Subi) Reef, which has been turned into an artificial island and a military outpost by the Chinese.
"The President has never given any serious attention to issues concerning the seizure by China of our territory and the abuse of our fishermen and our troops," Alejano said in a statement on Saturday.
"As I have said before, China will continue to assert control in the Pag-asa Island sandbars despite the 'friendly' relations that the administration is trying to foster," he said, adding that the sandbars were critical to China's claim on Zamora Reef.
The former Marine officer urged the Duterte administration "to act on the rising number of Chinese vessels around Pag-asa Island and protest China's illegal actions" before it's too late.
Wasted opportunity
"China is establishing a norm there which we cannot alter later on. Every day is a wasted opportunity to assert our sovereignty if we do not act now," Alejano said.
Lt. Col. Elpidio Factor, assistant chief of Wescom's Unified Command Staff for Intelligence, told the Mimaropa Regional Development Council, and Regional Peace and Order Council special meeting on Thursday that as of March 24, Filipino forces had counted up to 657 Chinese vessels close to the sandbars.
"These vessels are considered Chinese maritime militia and are officially complemented by Chinese coast guard vessels to sustain China's assertive presence in the vicinity of the sandbars," Factor said.
Wescom chief Vice Adm. Rene Medina tried to downplay the presence of the Chinese vessels, saying Chinese and Vietnamese fished around Pag-asa alongside Filipinos.
"There are no threats to our fishermen. We have constant coordination with higher headquarters, particularly with the Naval Task Force in the West Philippine Sea," he told reporters on Friday during the command's 43rd founding anniversary.
Biggest number
Factor reported that the biggest number of vessels, 87, was monitored on Feb. 10, the day the military delivered heavy equipment needed to repair the beaching ramp, air strip and other facilities on the island.
Chinese vessels were also monitored close to other Philippine-occupied islands like Panata and Kota, Factor said.
Chinese coast guard vessels have also been seen near Ayungin Shoal but there were no sightings last week, according to military reports.
A dilapidated Philippine Navy ship that was intentionally grounded on Ayungin is manned by a Marine contingent to stand guard over the shoal.
China, the Philippines, Taiwan, Vietnam, Malaysia and Brunei have conflicting claims over the South China Sea, one of the world's busiest sea-lanes.
A UN-backed international arbitral tribunal ruled in July 2016 to invalidate China's claim to nearly all of the strategic waters. Beijing, however, has ignored the ruling on the case filed by Manila.
China has built islands on shoals, complete with airstrips and missile defense systems.
The United States and its allies will continue to conduct freedom of navigation operations to prevent China from completely militarizing the disputed waterway, Factor said. —With a report from Redempto D. Anda
EU to probe alleged diversion of funds to CPP-NPA
TAGS: China-Philippines relations, Gary Alejano, Maritime Dispute, Neri Colmenares, Rodrigo Duterte, South China Sea, West Philippine Sea