Exploring patient safety culture in preventive medicine
settings: an experience from Northern Italy
Patient safety, defined as "the prevention of harm caused by errors of commission and omission", is a critical challenge of healthcare systems around the world . Risk profile in healthcare settings depends on a lot of factors, of which users' characteristics and organizational variables are the most important . Users' characteristics, such as age and current health condition, establish the access point to the healthcare system, but they cannot be largely influenced in order to increase patient safety . For instance, objectively healthy people are served by preventive medicine facilities; community members with less serious conditions are in charge of primary care settings; people with serious acute conditions needing high diagnostic and therapeutic technologies make use of hospitals, while frail elderly people with chronic diseases and lower need of medical technologies are hosted in nursing homes. Conversely, organizational factors such as procedures, staff competence and skills, quality systems and organizational culture, which can be influenced, should be systematically assessed and improved to continually increase patient safety. Quality of care and patient safety should be guaranteed in all access points to the healthcare system of a country, independently of the intensity of care needed by their health condition. Examining staff attitudes with regard to patient safety (safety culture) in each type of healthcare setting may contribute to the better understanding of performance variations across them in terms of quality and safety. Several international surveys showed that differences in patient safety culture exist between primary care, hospital and nursing home staff . Surveys of patient safety culture that include territorial Preventive medicine staff are scarce and no disaggregated/specific data are available . Across Italy, 154 regional public agencies called Local Health Authorities (LHAs) manage healthcare services for subsets of the regional population in defined geographical areas (the average population served is 390.000 inhabitants) . Within the LHAs in Northern Italy, the Department of Medical Prevention works according to regional prevention programs to provide sanitary education, healthy life style promotion, vaccinations, screenings, safety and hygiene services for food, the environment, the workplace etc., infectious disease surveillance and public health lab analyses . Staff work in multidisciplinary teams of public health professionals and workers, including doctors (e.g. specialists in Public Health, Preventive medicine, Infectious diseases, Environmental epidemiology, Toxicology), sanitary assistants (e.g. assistant medical officers, public health nurses), technicians (e.g. environmental health officers or public health inspectors), clerks and others (e.g. psychologists, dietitians and nutritionists, engineers, public health lawyers, sociologists) . The Department of Medical Prevention closely collaborates with the Department of Veterinary Prevention, according to the "one health" pattern, based on a socio-ecological system perspective, in which several distinct service providers contribute to public health in their catchment area in a coordinated manner, each overseeing a different branch. While in some Italian LHAs medical and veterinary preventive activities are provided by separate departments (e.g. Lombardy region), in others these activities are provided by the same department, i.e. the Department of Prevention (e.g. Piedmont region). The aim of this pilot study was to examine patient safety culture in Italian territorial Prevention facilities by investigating this in four different settings across Northern Italy. Assuming that patient safety culture in the staff members of an organization is a multidimensional concept, we applied the Agency for Healthcare Research and Quality (AHRQ) Hospital Survey on Patient Safety Culture (Hospital SOPS) , which was translated into Italian and adapted to our target settings, to find out which areas of patient safety were poor and needed improvement. We also examined differences across work areas and professional categories.   Study design and Settings A descriptive cross-sectional study was carried out in four Italian territorial Prevention facilities: three Departments of Medical Prevention in the Lombardy region and one Department of Prevention in the Piedmont region. These settings voluntarily participated in an international project aimed at developing patient safety culture in Italian territorial Prevention facilities and Eastern European hospitals ( il progetto IRIDE: Italia - Romania - Repubblica Moldova in Rete: Imparando dagli errori verso una cultura della sicurezza dei pazienti/utenti ). They serve a population varying from about 200,000 to 1,100,000 inhabitants. Data were collected with an online form. The survey was administered from October 1st 2013 until the end of the month in two settings and between September 15th through to October 15th 2014 in the other two settings. Two reminders were sent in each setting before ending data collection, in order to increase the response rate. Participants The target population was represented by all Units and staff members in the target facilities. Most Units existed in all four facilities at the time of the study ( e.g. Hygiene and Public Health, Infectious Disease Prevention and Epidemiology, Community Preventive Medicine, Prevention and Safety in the Workplace, Plant engineering and Safety in the Workplace, Food & Nutrition Hygiene and Management). Some other Units ( e.g. Public Health Laboratory, Environmental Medicine, Legal Medicine and Veterinary) did not exist in all facilities. The main professional categories were represented by Technicians, followed by Physicians, Nurses/Sanitary assistants and Unit assistants/clerks/secretaries. Data sources and measurement Since its release in 2004, the AHRQ Hospital SOPS was translated in 31 languages and administered in 66 countries . It showed acceptable psychometric properties in Europe , Asia and the Middle East . It had been already translated into Italian (with the back translation method)  and applied in several Italian hospitals . It was slightly adjusted for application in our settings and pre-tested on a small group of staff members from different professions. Psychometrics of the Italian version of the Hospital SOPS for territorial Prevention facilities were then explored. Among the 42 items of the12-factor original US survey, only 33 items based on a 10-factor model showed acceptable psychometrics for application in our target facilities . Moreover, the survey assessed two output indicators and required additional information on work area, staff position, and whether they have direct or indirect interaction with patients. The survey also allowed for open comments to be written at the end. Items were measured using a 5-point Likert-type scale and were then aggregated into 10 composites (factors). Most safety culture composites used the scale of response option in terms of agreement ( Strongly agree to Strongly disagree ) and three composites in terms of frequency ( Always to Never ). Patient safety grade (output indicator) was measured with a five-point scale ranging from " Excellent " to " Failing ". Another output indicator was the number of reported adverse events in the last 12 months, assessed through five frequency categories. Participants were asked to respond to this item only if there had been an incident reporting system in their facility. Anonymity was ensured throughout the study. To reduce respondents' fear of being identified, several methods were adopted. Units with very low number of staff were aggregated to Units with higher number of staff, within the same work area. Moreover, a work area called " Not otherwise specified " was added to the seven work areas obtained, in order to be ticked by the respondents who did not want to indicate his/her true Unit. The same was done for the professional categories. The pre-test participants were informed that they would not be further invited to complete the survey. A thorough quality check was carried out on the surveys received. Forms with less than one entire section completed, with less than half the questions answered, and straight-lining forms (where responses to all items in Sections A, B, C, D and F were the same) were excluded. Study size Overall, 673 workers received the survey (staff census). After the quality check, the final dataset consisted of 479 respondents across four territorial prevention facilities. Statistical methods Analyses were performed using STATA. The percentage of missing data was very low and therefore it was not necessary to address this issue. Frequency distributions were computed for the demographic characteristics of the respondents, for the two output indicators of the survey, as well as for the responses to each one of the 33 items of the survey. Negatively worded items were reverse coded before calculating the 10 composites scores. Patient safety culture was measured overall, by work area, and by professional category. Overall composites were benchmarked with Italian and US hospitals and other outpatient settings from other countries . In order to facilitate comparisons, 95% confidence intervals (CI) were computed.   A descriptive cross-sectional study was carried out in four Italian territorial Prevention facilities: three Departments of Medical Prevention in the Lombardy region and one Department of Prevention in the Piedmont region. These settings voluntarily participated in an international project aimed at developing patient safety culture in Italian territorial Prevention facilities and Eastern European hospitals ( il progetto IRIDE: Italia - Romania - Repubblica Moldova in Rete: Imparando dagli errori verso una cultura della sicurezza dei pazienti/utenti ). They serve a population varying from about 200,000 to 1,100,000 inhabitants. Data were collected with an online form. The survey was administered from October 1st 2013 until the end of the month in two settings and between September 15th through to October 15th 2014 in the other two settings. Two reminders were sent in each setting before ending data collection, in order to increase the response rate.   The target population was represented by all Units and staff members in the target facilities. Most Units existed in all four facilities at the time of the study ( e.g. Hygiene and Public Health, Infectious Disease Prevention and Epidemiology, Community Preventive Medicine, Prevention and Safety in the Workplace, Plant engineering and Safety in the Workplace, Food & Nutrition Hygiene and Management). Some other Units ( e.g. Public Health Laboratory, Environmental Medicine, Legal Medicine and Veterinary) did not exist in all facilities. The main professional categories were represented by Technicians, followed by Physicians, Nurses/Sanitary assistants and Unit assistants/clerks/secretaries.   Since its release in 2004, the AHRQ Hospital SOPS was translated in 31 languages and administered in 66 countries . It showed acceptable psychometric properties in Europe , Asia and the Middle East . It had been already translated into Italian (with the back translation method)  and applied in several Italian hospitals . It was slightly adjusted for application in our settings and pre-tested on a small group of staff members from different professions. Psychometrics of the Italian version of the Hospital SOPS for territorial Prevention facilities were then explored. Among the 42 items of the12-factor original US survey, only 33 items based on a 10-factor model showed acceptable psychometrics for application in our target facilities . Moreover, the survey assessed two output indicators and required additional information on work area, staff position, and whether they have direct or indirect interaction with patients. The survey also allowed for open comments to be written at the end. Items were measured using a 5-point Likert-type scale and were then aggregated into 10 composites (factors). Most safety culture composites used the scale of response option in terms of agreement ( Strongly agree to Strongly disagree ) and three composites in terms of frequency ( Always to Never ). Patient safety grade (output indicator) was measured with a five-point scale ranging from " Excellent " to " Failing ". Another output indicator was the number of reported adverse events in the last 12 months, assessed through five frequency categories. Participants were asked to respond to this item only if there had been an incident reporting system in their facility. Anonymity was ensured throughout the study. To reduce respondents' fear of being identified, several methods were adopted. Units with very low number of staff were aggregated to Units with higher number of staff, within the same work area. Moreover, a work area called " Not otherwise specified " was added to the seven work areas obtained, in order to be ticked by the respondents who did not want to indicate his/her true Unit. The same was done for the professional categories. The pre-test participants were informed that they would not be further invited to complete the survey. A thorough quality check was carried out on the surveys received. Forms with less than one entire section completed, with less than half the questions answered, and straight-lining forms (where responses to all items in Sections A, B, C, D and F were the same) were excluded.   Overall, 673 workers received the survey (staff census). After the quality check, the final dataset consisted of 479 respondents across four territorial prevention facilities.   Analyses were performed using STATA. The percentage of missing data was very low and therefore it was not necessary to address this issue. Frequency distributions were computed for the demographic characteristics of the respondents, for the two output indicators of the survey, as well as for the responses to each one of the 33 items of the survey. Negatively worded items were reverse coded before calculating the 10 composites scores. Patient safety culture was measured overall, by work area, and by professional category. Overall composites were benchmarked with Italian and US hospitals and other outpatient settings from other countries . In order to facilitate comparisons, 95% confidence intervals (CI) were computed.   The response rate across the four territorial Prevention facilities varied from 67% to 73%, with an average of 71%. All items had good variability and the rates of missing responses ranged from 0% to 4% per item. shows respondents' demographics and response distribution concerning two output indicators. Most respondents (35%) worked in the Hygiene and Public Health area, which was common to all four facilities, while the Veterinary Medicine area provided the least amount of respondents (2%), as it existed in one setting only. Half of the respondents experienced more than 21 years in the current profession (54%) and in the department (45%), but only a third of them (32%) in the current Unit, reflecting a job rotation process across the Units of the same department. Most respondents (74%) usually worked between 20 to 38 hours a week. Almost half of the respondents were Prevention Technicians (43%). Ninety percent of the respondents worked in direct contact with patients/users. Half of the respondents (49%) appreciated the "Patient Safety Grade" indicator as "excellent or very good". The most frequent response to the " Number of events reported in the last 12 months " indicator was " No event reports ". Interestingly, 36% of the respondents did not answer it. shows the response frequency and the percentage of positive responses (with 95% CI) by survey item. Positive answers varied from 23% for the item "Problems often occur in the exchange of information across department Units", to 70% for the item "People support one another in this Unit". Composites scores varied from 36% for "handoffs and transitions" to 65% for "communication openness". Six out of 10 composites were poor (i.e. under the cut-off point of 50%). These were: "management support for patient/user safety", "feedback and communication about errors", "frequency of events reported", "non-punitive response to errors", "teamwork across Units", "handoffs and transitions". Patient safety composites of positive responses (with 95% CI) by work area are shown in and by professional group in . " Communication openness ", " Teamwork within Units " and " Supervisor/head expectations and actions promoting patient/user safety " were sufficiently developed in all work areas and professional categories (scores >50%). Compared to the overall results, significantly higher scores were found for all composites in the Management area (range: 64% for " Teamwork across Units " - 86% for " Communication openness ") and for six composites in the Public Health Laboratory area .The poorest findings were in the Workplace Prevention area (range: 26% for " Handoffs and transitions " - 62% for " Communication openness "), which exhibited significantly lower scores for six out of ten composites. The Physician group exhibited significantly higher scores than the overall figure for six out of ten composites. Their composites ranged from 42% for "Handoffs and transitions" to 80% for " Communication openness ". On the contrary, the Technician group showed the poorest results (range: 30% for " Handoffs and transitions " - 62% for " Communication openness "), with significantly lower composites than the overall figure for five composites. Significantly higher scores were found for staff belonging to other professional categories (e.g. engineers, dieticians, etc), ranging from 52% for " Handoffs and transitions " to 74% for " Teamwork within Units ". However, they represented only 7% of the total number of respondents, so these results should be interpreted with caution. shows an international benchmark of composites scores. . The Italian experience pointed out that patient safety culture in Prevention facilities is less developed than in hospitals. While " Teamwork within Units " and " Supervisor/head expectations & actions promoting patient/user ' safety" (range: 59%-81%) are the most developed safety culture aspects across the compared facilities, " Non-punitive response to errors " remain problematic in all settings (range: 17%-44%).   This study represents the first examination of patient safety culture within the staff of territorial Prevention facilities within the Local Health Authorities of Northern Italy. Four facilities were included in the study. Since there was not a specific survey available to be used in these settings, after searching existing scientific literature, we selected the Hospital version of the AHRQ SOPS. Besides being one of the most popular surveys currently used at international level  and being already available in Italian , this survey explores most of the aspects of patient safety culture which we were interested in. Moreover, several research groups around the world found the AHRQ Hospital survey useful to explore patient safety culture in non-hospital settings . Thus, the original survey was slightly adjusted for use in our facilities and pre-tested on a few staff members. The psychometrics were checked thereafter. Results of the psychometric validation pointed out that 10 factors and 33 items of the original US survey (based on 12 factors with 42 items) were satisfactory for use in our facilities . The Italian experience indicates that patient safety culture is less developed in territorial Prevention facilities than in hospitals . Interestingly, the latter showed composites lower than US hospitals . Our results are consistent with results from other studies carried out in facilities for outpatients, such as primary healthcare services, characterised by a lower potential of life-threatening medical errors and procedures . Nonetheless, it raises serious concern from a public health point of view, as prevention facilities deal with entire communities and/or sub-groups of the population and most of the individuals interacting with our territorial Prevention facilities are objectively healthy. Overall, " Communication openness ", " Teamwork within Units " and " Supervisor/head expectations and actions promoting patient/user safety " were the most developed aspects of the culture. Staff help each other, supervisors promote user safety and communication barriers between them are minimal, which suggests that some important basis for further developing user safety already exists. Conversely, " Teamwork across Units ", " Handoffs and transitions " as well as " Non-punitive response to errors " are the least developed aspects of the culture, requiring prompt intervention. Many other studies have pointed out the same strengths and weakness of patient safety culture . Voluntary error reporting is a critical mechanism for identifying patient safety issues and improving quality in an organization . Patients' safety culture enables providers to report mistakes and near misses . In our facilities, a low frequency of events reported suggests the persistence of blame culture and under-reporting of incidents, as pointed out by other Italian studies . Respondents in the study only had to respond to the question about incident reporting if an incident reporting system was in place in their facility. The high proportion of non-response (36%) suggested that several staff members were not aware of the existence of the incident reporting system, which had been in place for several years. This is likely to be another cause of the underreporting of incidents in the settings participating in the study. We found a great variability of the positive responses among work areas and the profession of the respondents. The highest composites were exhibited by the Management area. Since it is the first recipient of the institutional strategic safety policies and has to account for their implementation into practice at each Unit level, we could consider this area highly auto-referential. Similar results have been observed in other studies . Our results also pointed out higher scores in the Laboratory of Public Health. This suggests that a strong leadership for quality, thorough external certification and accreditation processes, along with continuous internal autocontrol, are important contributors to the development of good patient safety culture within staff. Physicians working in territorial Prevention facilities showed higher composite scores of positive responses for patient safety than other professionals (nurses, technicians, clerks). A recent study carried out by Nguyen et al. [35] in two Italian hospitals supports our findings, showing that professional profile contributed significantly to differences in safety attitudes and teamwork climate, which were more developed in physicians that in nurses. Our study has several limitations. Firstly, all our facilities consisted of Units and healthcare professions that are quite different from those existing in hospitals, for which the survey we used was originally elaborated. For instance, physicians and nurses represented only one third of all the staff surveyed. Secondly, the study was not based on a random sample with a selection in numerous Italian regions, but only on four voluntary facilities, located in two northern regions. Thirdly, the organisational heterogeneity of the four facilities included in the study could also have introduced some bias. In fact, contrarily to the three Departments of Medical Prevention in the Lombardy Region, the Department of Prevention in the Piedmont Region covers a small territory and population, has closer collaboration with the hospitals in its activities, and runs not only human but also veterinary preventive activities to preserve public health. It also has a larger proportion of staff members with shorter experience in the department/ Unit/profession and with more than 38 working hours a week. These distinct characteristics contributed to different awareness levels about risk of error/adverse events with respect to the other departments (which were more homogeneous), leading to the better development of some dimensions of patient safety culture. Finally, some Units were so small that despite our effort to preserve anonymity, opportunistic staff attitudes due to fear of being identified were still possible. For these reasons our results are not representative for all the facilities similar to ours in Italy and further application of the survey in other territorial Prevention facilities would be necessary to confirm our results. Although it might seem appealing, international comparisons of results are to be considered very cautiously. The study has some important strengths as well. Firstly, we psychometrically validated the survey that we applied to measure patient safety culture . Secondly, the overall response rate (71%) was satisfactory. Thirdly, we described patient safety culture through a multidimensional tool in territorial Prevention facilities for the first time in our country. Finally, based on the results of this study, several actions for improvement were set up: a) courses on risk management have been organized for all work areas and professions, with priority given to the areas with the poorest results; b) thorough revision of the existing incident reporting system, including major advertising and ensuring wide-spreading accessibility and feedback; c) application of pro-active risk management tools such as Failure Mode and Effect Analysis to some key processes; d) intense exchange of information regarding best practices among the four departments participating in the study. Thus, the results of this study constitute not only an opportunity to explore and understand staff perception of user safety in the Prevention field, they can also be used as a baseline for improvement interventions and future assessments of the efficacy of specific targeted interventions.   A voluntary and anonymous qualitative cross-sectional study was carried out for the first time in Italian territorial Prevention facilities using a psychometrically validated version of the US Hospital Survey of Patient Safety Culture. " Communication openness ", " Teamwork within Units ", " Supervisor/head expectations and actions promoting patient/user safety " and " Organizational learning-continuous improvement " were the most developed factors of patient safety culture, while the other six factors evaluated were quite poor. Management scored highest across work areas, and Physicians scored highest across professional categories. However, overall results were poorer than in Italian hospitals. To confirm the results of this pilot study, the survey should be further expanded to other Italian territorial Prevention facilities; post-intervention application in the same facilities could help monitor efficacy of improvement actions. In this study, intra-country comparisons provided some interesting information, which could be useful to prevent auto-referentiality. Inter-country comparisons might be influenced by cultural and geographical differences and therefore they should be considered with caution.   