Surgical Team Member Assessment of the Safety of Surgery Practice in 38 South Carolina Hospitals
MEDICAL CARE RESEARCH AND REVIEW
2015; 72 (3): 298-323
The Surgical Safety Checklist and Teamwork Coaching Tools: a study of inter-rater reliability
BMJ QUALITY & SAFETY
2014; 23 (8): 639-650
We assessed surgical team member perceptions of multiple dimensions of safe surgical practice in 38 South Carolina hospitals participating in a statewide initiative to implement surgical safety checklists. Primary data were collected using a novel 35-item survey. We calculated the percentage of 1,852 respondents with strongly positive, positive, and neutral/negative responses about the safety of surgical practice, compared results by hospital and professional discipline, and examined how readiness, teamwork, and adherence related to staff perception of care quality. Overall, 78% of responses were positive about surgical safety at respondent's hospitals, but in each survey dimension, from 16% to 40% of responses were neutral/negative, suggesting significant opportunity to improve surgical safety. Respondents not reporting they would feel safe being treated in their operating rooms varied from 0% to 57% among hospitals. Surgeons responded more positively than nonsurgeons. Readiness, teamwork, and practice adherence related directly to staff perceptions of patient safety (p < .001).
View details for DOI 10.1177/1077558715577479
View details for Web of Science ID 000354117900004
View details for PubMedID 25828528
Safety in Numbers: The Development of Leapfrog's Composite Patient Safety Score for U.S. Hospitals.
Journal of patient safety
2014; 10 (1): 64-71
To assess the inter-rater reliability (IRR) of two novel observation tools for measuring surgical safety checklist performance and teamwork.Data surgical safety checklists can promote adherence to standards of care and improve teamwork in the operating room. Their use has been associated with reductions in mortality and other postoperative complications. However, checklist effectiveness depends on how well they are performed.Authors from the Safe Surgery 2015 initiative developed a pair of novel observation tools through literature review, expert consultation and end-user testing. In one South Carolina hospital participating in the initiative, two observers jointly attended 50 surgical cases and independently rated surgical teams using both tools. We used descriptive statistics to measure checklist performance and teamwork at the hospital. We assessed IRR by measuring percent agreement, Cohen's κ, and weighted κ scores.The overall percent agreement and κ between the two observers was 93% and 0.74 (95% CI 0.66 to 0.79), respectively, for the Checklist Coaching Tool and 86% and 0.84 (95% CI 0.77 to 0.90) for the Surgical Teamwork Tool. Percent agreement for individual sections of both tools was 79% or higher. Additionally, κ scores for six of eight sections on the Checklist Coaching Tool and for two of five domains on the Surgical Teamwork Tool achieved the desired 0.7 threshold. However, teamwork scores were high and variation was limited. There were no significant changes in the percent agreement or κ scores between the first 10 and last 10 cases observed.Both tools demonstrated substantial IRR and required limited training to use. These instruments may be used to observe checklist performance and teamwork in the operating room. However, further refinement and calibration of observer expectations, particularly in rating teamwork, could improve the utility of the tools.
View details for DOI 10.1136/bmjqs-2013-002446
View details for Web of Science ID 000339176900006
View details for PubMedID 24497526
Comparing safety climate in naval aviation and hospitals: Implications for improving patient safety
HEALTH CARE MANAGEMENT REVIEW
2010; 35 (2): 134-146
To develop a composite patient safety score that provides patients, health-care providers, and health-care purchasers with a standardized method to evaluate patient safety in general acute care hospitals in the United States.The Leapfrog Group sought guidance from a panel of national patient safety experts to develop the composite score. Candidate patient safety performance measures for inclusion in the score were identified from publicly reported national sources. Hospital performance on each measure was converted into a "z-score" and then aggregated using measure-specific weights. A reference mean score was set at 3, with scores interpreted in terms of standard deviations above or below the mean, with above reflecting better than average performance.Twenty-six measures were included in the score. The mean composite score for 2652 general acute care hospitals in the United States was 2.97 (range by hospital, 0.46-3.94). Safety scores were slightly lower for hospitals that were publicly owned, rural in location, or had a larger percentage of patients with Medicaid as their primary insurance.The Leapfrog patient safety composite provides a standardized method to evaluate patient safety in general acute care hospitals in the United States. While constrained by available data and publicly reported scores on patient safety measures, the composite score reflects the best available evidence regarding a hospital's efforts and outcomes in patient safety. Additional analyses are needed, but the score did not seem to have a strong bias against hospitals with specific characteristics. The composite score will continue to be refined over time as measures of patient safety evolve.
View details for DOI 10.1097/PTS.0b013e3182952644
View details for PubMedID 24080719
Identifying organizational cultures that promote patient safety
HEALTH CARE MANAGEMENT REVIEW
2009; 34 (4): 300-311
Evidence of variation in safety climate suggests the need for improvement among at least some hospitals. However, comparisons only among hospitals may underestimate the improvement required. Comparison of hospitals with analogous industries may provide a broader perspective on the safety status of our nation's hospitals.The purpose of this study was to compare safety climate among hospital workers with personnel from naval aviation, an organization that operates with high reliability despite intrinsically hazardous conditions.We surveyed a random sample of health care workers in 67 U.S. hospitals and, for generalizability, 30 veterans affairs hospitals using questions comparable with those posed at approximately the same time (2007) to a census of personnel from 35 squadrons of U.S. naval aviators. We received 13,841 (41%) completed surveys in U.S. hospitals, 5,511 (50%) in veterans affairs hospitals, and 14,854 (82%) among naval aviators. We examined differences in respondents' perceptions of safety climate at their institution overall and for 16 individual items.Safety climate was three times better on average among naval aviators than among hospital personnel. Naval aviators perceived a safer climate (up to seven times safer) than hospital personnel with respect to each of the 16 survey items. Compared with hospital managers, naval commanders perceived climate more like frontline personnel did. When contrasting naval aviators with hospital personnel working in comparably hazardous areas, safety climate discrepancies increased rather than decreased. One individual hospital performed as well as naval aviation on average, and at least one hospital outperformed the Navy benchmark for all but three individual survey items.Results suggest that hospitals have not sufficiently created a uniform priority of safety. However, if each hospital performed as well as the top-performing hospital in each area measured, hospitals could achieve safety climate levels comparable with naval aviation. Major interventions to bolster hospital safety climate continue to be required to improve patient safety.
View details for DOI 10.1097/HMR.0b013e3181c8b20c
View details for Web of Science ID 000276557800005
View details for PubMedID 20234220
Comparing Safety Climate between Two Populations of Hospitals in the United States
HEALTH SERVICES RESEARCH
2009; 44 (5): 1563-1584
Safety climate refers to shared perceptions of what an organization is like with regard to safety, whereas safety culture refers to employees' fundamental ideology and orientation and explains why safety is pursued in the manner exhibited within a particular organization. Although research has sought to identify opportunities for improving safety outcomes by studying patterns of variation in safety climate, few empirical studies have examined the impact of organizational characteristics such as culture on hospital safety climate.This study explored how aspects of general organizational culture relate to hospital patient safety climate.In a stratified sample of 92 U.S. hospitals, we sampled 100% of senior managers and physicians and 10% of other hospital workers. The Patient Safety Climate in Healthcare Organizations and the Zammuto and Krakower organizational culture surveys measured safety climate and group, entrepreneurial, hierarchical, and production orientation of hospitals' culture, respectively. We administered safety climate surveys to 18,361 personnel and organizational culture surveys to a 5,894 random subsample between March 2004 and May 2005. Secondary data came from the 2004 American Hospital Association Annual Hospital Survey and Dun & Bradstreet. Hierarchical linear regressions assessed relationships between organizational culture and safety climate measures.Aspects of general organizational culture were strongly related to safety climate. A higher level of group culture correlated with a higher level of safety climate, but more hierarchical culture was associated with lower safety climate. Aspects of organizational culture accounted for more than threefold improvement in measures of model fit compared with models with controls alone. A mix of culture types, emphasizing group culture, seemed optimal for safety climate.Safety climate and organizational culture are positively related. Results support strategies that promote group orientation and reduced hierarchy, including use of multidisciplinary team training, continuous quality improvement tools, and human resource practices and policies.
View details for Web of Science ID 000270852700002
View details for PubMedID 19858915
Relationship of Hospital Organizational Culture to Patient Safety Climate in the Veterans Health Administration
MEDICAL CARE RESEARCH AND REVIEW
2009; 66 (3): 320-338
To compare safety climate between diverse U.S. hospitals and Veterans Health Administration (VA) hospitals, and to explore the factors influencing climate in each setting.Primary data from surveys of hospital personnel; secondary data from the American Hospital Association's 2004 Annual Survey of Hospitals.Cross-sectional study of 69 U.S. and 30 VA hospitals.For each sample, hierarchical linear models used safety-climate scores as the dependent variable and respondent and facility characteristics as independent variables. Regression-based Oaxaca-Blinder decomposition examined differences in effects of model characteristics on safety climate between the U.S. and VA samples.The range in safety climate among U.S. and VA hospitals overlapped substantially. Characteristics of individuals influenced safety climate consistently across settings. Working in southern and urban facilities corresponded with worse safety climate among VA employees and better safety climate in the U.S. sample. Decomposition results predicted 1.4 percentage points better safety climate in U.S. than in VA hospitals: -0.77 attributable to sample-characteristic differences and 2.2 due to differential effects of sample characteristics.Results suggest that safety climate is linked more to efforts of individual hospitals than to participation in a nationally integrated system or measured characteristics of workers and facilities.
View details for DOI 10.1111/j.1475-6773.2009.00994.x
View details for Web of Science ID 000269494600008
View details for PubMedID 19619250
View details for PubMedCentralID PMC2754548
Relationship of Safety Climate and Safety Performance in Hospitals
HEALTH SERVICES RESEARCH
2009; 44 (2): 399-421
Improving safety climate could enhance patient safety, yet little evidence exists regarding the relationship between hospital characteristics and safety climate. This study assessed the relationship between hospitals' organizational culture and safety climate in Veterans Health Administration (VA) hospitals nationally. Data were collected from a sample of employees in a stratified random sample of 30 VA hospitals over a 6-month period (response rate = 50%; n = 4,625). The Patient Safety Climate in Healthcare Organizations (PSCHO) and the Zammuto and Krakower surveys were used to measure safety climate and organizational culture, respectively. Higher levels of safety climate were significantly associated with higher levels of group and entrepreneurial cultures, while lower levels of safety climate were associated with higher levels of hierarchical culture. Hospitals could use these results to design specific interventions aimed at improving safety climate.
View details for DOI 10.1177/1077558709331812
View details for Web of Science ID 000265690500004
View details for PubMedID 19244094
Patient Safety Climate in 92 US Hospitals Differences by Work Area and Discipline
2009; 47 (1): 23-31
To examine the relationship between measures of hospital safety climate and hospital performance on selected Patient Safety Indicators (PSIs).Primary data from a 2004 survey of hospital personnel. Secondary data from the 2005 Medicare Provider Analysis and Review File and 2004 American Hospital Association's Annual Survey of Hospitals.A cross-sectional study of 91 hospitals.Negative binomial regressions used an unweighted, risk-adjusted PSI composite as dependent variable and safety climate scores and controls as independent variables. Some specifications included interpersonal, work unit, and organizational safety climate dimensions. Others included separate measures for senior managers and frontline personnel's safety climate perceptions.Hospitals with better safety climate overall had lower relative incidence of PSIs, as did hospitals with better scores on safety climate dimensions measuring interpersonal beliefs regarding shame and blame. Frontline personnel's perceptions of better safety climate predicted lower risk of experiencing PSIs, but senior manager perceptions did not.The results link hospital safety climate to indicators of potential safety events. Some aspects of safety climate are more closely related to safety events than others. Perceptions about safety climate among some groups, such as frontline staff, are more closely related than perceptions in other groups.
View details for DOI 10.1111/j.1475-6773.2008.00918.x
View details for Web of Science ID 000264164400006
View details for PubMedID 19178583
View details for PubMedCentralID PMC2677046
Patient Safety Climate in US Hospitals Variation by Management Level
2008; 46 (11): 1149-1156
Concern about patient safety has promoted efforts to improve safety climate. A better understanding of how patient safety climate differs among distinct work areas and disciplines in hospitals would facilitate the design and implementation of interventions.To understand workers' perceptions of safety climate and ways in which climate varies among hospitals and by work area and discipline.We administered the Patient Safety Climate in Healthcare Organizations survey in 2004-2005 to personnel in a stratified random sample of 92 US hospitals.We sampled 100% of senior managers and physicians and 10% of all other workers. We received 18,361 completed surveys (52% response).The survey measured safety climate perceptions and worker and job characteristics of hospital personnel. We calculated and compared the percent of responses inconsistent with a climate of safety among hospitals, work areas, and disciplines.Overall, 17% of responses were inconsistent with a safety climate. Patient safety climate differed by hospital and among and within work areas and disciplines. Emergency department personnel perceived worse safety climate and personnel in nonclinical areas perceived better safety climate than workers in other areas. Nurses were more negative than physicians regarding their work unit's support and recognition of safety efforts, and physicians showed marginally more fear of shame than nurses. For other dimensions of safety climate, physician-nurse differences depended on their work area.Differences among and within hospitals suggest that strategies for improving safety climate and patient safety should be tailored for work areas and disciplines.
View details for Web of Science ID 000262186500004
View details for PubMedID 19106727
Front-line staff perspectives on opportunities for improving the safety and efficiency of hospital work systems
HEALTH SERVICES RESEARCH
2008; 43 (5): 1807-1829
Strengthening hospital safety culture offers promise for reducing adverse events, but efforts to improve culture may not succeed if hospital managers perceive safety differently from frontline workers.To determine whether frontline workers and supervisors perceive a more negative patient safety climate (ie, surface features, reflective of the underlying safety culture) than senior managers in their institutions. To ascertain patterns of variation within management levels by professional discipline.A safety climate survey was administered from March 2004 to May 2005 in 92 US hospitals. Individual-level cross sectional comparisons related safety climate to management level. Hierarchical and hospital-fixed effects modeling tested differences in perceptions.Random sample of hospital personnel (18,361 respondents).Frequency of responses indicating absence of safety climate (percent problematic response) overall and for 8 survey dimensions.Frontline workers' safety climate perceptions were 4.8 percentage points (1.4 times) more problematic than were senior managers', and supervisors' perceptions were 3.1 percentage points (1.25 times) more problematic than were senior managers'. Differences were consistent among 7 safety climate dimensions. Differences by management level depended on discipline: senior manager versus frontline worker discrepancies were less pronounced for physicians and more pronounced for nurses, than they were for other disciplines.Senior managers perceived patient safety climate more positively than nonsenior managers overall and across 7 discrete safety climate domains. Patterns of variation by management level differed by professional discipline. Continuing efforts to improve patient safety should address perceptual differences, both among and within groups by management level.
View details for Web of Science ID 000260745900004
View details for PubMedID 18953225
An overview of patient safety climate in the VA
HEALTH SERVICES RESEARCH
2008; 43 (4): 1263-1284
To contrast the safety-related concerns raised by front-line staff about hospital work systems (operational failures) with national patient safety initiatives.Primary data included 1,732 staff-identified operational failures at 20 U.S. hospitals from 2004 to 2006.Senior managers observed front-line staff and facilitated open discussion meetings with employees about their patient safety concerns.Hospitals submitted data on the operational failures identified through managers' interactions with front-line workers. Data were analyzed for type of failure and frequency of occurrence. Recommendations from staff were compared with recommendations from national initiatives.The two most frequent categories of operational failures, equipment/supplies and facility issues, posed safety risks and diminished staff efficiency, but have not been priorities in national initiatives.Our study suggests an underutilized strategy for improving patient safety and staff efficiency: leveraging front-line staff experiences with work systems to identify and address operational failures. In contrast to the perceived tradeoff between safety and efficiency, fixing operational failures can yield benefits for both. Thus, prioritizing improvement of work systems in general, rather than focusing more narrowly on specific clinical conditions, can increase safety and efficiency of hospitals.
View details for DOI 10.1111/j.1475-6773.2008.00868.x
View details for Web of Science ID 000259344300003
View details for PubMedID 18522667
View details for PubMedCentralID PMC2654160
Workforce perceptions of hospital safety culture: Development and validation of the patient safety climate in healthcare organizations survey
HEALTH SERVICES RESEARCH
2007; 42 (5): 1999-2021
To assess variation in safety climate across VA hospitals nationally.Data were collected from employees at 30 VA hospitals over a 6-month period using the Patient Safety Climate in Healthcare Organizations survey.We sampled 100 percent of senior managers and physicians and a random 10 percent of other employees. At 10 randomly selected hospitals, we sampled an additional 100 percent of employees working in units with intrinsically higher hazards (high-hazard units [HHUs]).Data were collected using an anonymous survey design.We received 4,547 responses (49 percent response rate). The percent problematic response--lower percent reflecting higher levels of patient safety climate--ranged from 12.0-23.7 percent across hospitals (mean=17.5 percent). Differences in safety climate emerged by management level, clinician status, and workgroup. Supervisors and front-line staff reported lower levels of safety climate than senior managers; clinician responses reflected lower levels of safety climate than those of nonclinicians; and responses of employees in HHUs reflected lower levels of safety climate than those of workers in other areas.This is the first systematic study of patient safety climate in VA hospitals. Findings indicate an overall positive safety climate across the VA, but there is room for improvement.
View details for DOI 10.1111/j.1475-6773.2008.00839.x
View details for Web of Science ID 000257756000009
View details for PubMedID 18355257
View details for PubMedCentralID PMC2517282
Prospects for improved decision making about medical necessity
2001; 20 (1): 200-206
In loco parentis? The purchaser role in managed care
CALIFORNIA MANAGEMENT REVIEW
2000; 43 (1): 34-?
Structural problems of managed care in California and some options for ameliorating them
CALIFORNIA MANAGEMENT REVIEW
2000; 43 (1): 50-?
What's not to like about HMOs
2000; 19 (4): 206-209
Unrealistic expectations born of defective institutions
JOURNAL OF HEALTH POLITICS POLICY AND LAW
1999; 24 (5): 931-939
The managed care backlash and the task force in California
1998; 17 (4): 95-110
To describe the development of an instrument for assessing workforce perceptions of hospital safety culture and to assess its reliability and validity.Primary data collected between March 2004 and May 2005. Personnel from 105 U.S. hospitals completed a 38-item paper and pencil survey. We received 21,496 completed questionnaires, representing a 51 percent response rate.Based on review of existing safety climate surveys, we developed a list of key topics pertinent to maintaining a culture of safety in high-reliability organizations. We developed a draft questionnaire to address these topics and pilot tested it in four preliminary studies of hospital personnel. We modified the questionnaire based on experience and respondent feedback, and distributed the revised version to 42,249 hospital workers.We randomly divided respondents into derivation and validation samples. We applied exploratory factor analysis to responses in the derivation sample. We used those results to create scales in the validation sample, which we subjected to multitrait analysis (MTA).We identified nine constructs, three organizational factors, two unit factors, three individual factors, and one additional factor. Constructs demonstrated substantial convergent and discriminant validity in the MTA. Cronbach's alpha coefficients ranged from 0.50 to 0.89.It is possible to measure key salient features of hospital safety climate using a valid and reliable 38-item survey and appropriate hospital sample sizes. This instrument may be used in further studies to better understand the impact of safety climate on patient safety outcomes.
View details for DOI 10.1111/j.1475-6773.2007.00706.x
View details for Web of Science ID 000249429000012
View details for PubMedID 17850530
View details for PubMedCentralID PMC2254575
Economists' perspectives on health care delivery in California as of 1995
WESTERN JOURNAL OF MEDICINE
1998; 168 (5): 360-370
Signs of a managed care backlash in California are increasing. This paper reports and interprets the recently completed work of the California Managed Health Care Improvement Task Force, focusing on the managed care backlash and the state's regulatory response. Although cost containment was a contributing factor, the causes of and solutions to the backlash differ among consumers, physicians, health care workers, politicians, and health plans. The recommendations of the task force could improve the market for health insurance. However, lasting solutions to the profound problems causing the backlash will require fundamental cultural and systemic change.
View details for Web of Science ID 000074933100013
View details for PubMedID 9691553
Paying more twice: When employers subsidize higher-cost health plans
1997; 16 (6): 150-156
Markets and collective action in regulating managed care
1997; 16 (6): 26-32
Managed competition and California's health care economy
1996; 15 (1): 39-57
The health care delivery system is made up of providers--hospitals and doctors--increasingly organized into medical groups. Medical groups interact with payors, primarily health maintenance organizations, that increasingly pass through both risk and prices from increasingly demanding purchasers. This article summarizes the present and future prospects for each of these groups.
View details for Web of Science ID 000073747700010
View details for PubMedID 9614794
Increasing cost-consciousness for managed care: reforming the tax treatment of health insurance expenditures.
Health care management (Philadelphia, Pa.)
1995; 2 (1): 109-114
There is evidence in California of a broad decline in health care costs to employment groups adopting managed care and managed competition--premium reductions up to 10 percent. National comparisons and utilization data generally confirm the beginning of lower costs. Large California medical groups and health systems have responded to pressure by finding ways to reduce costs and improve quality. While examples are encouraging, there is room for improvement. Two levels of competition have emerged and continue to evolve: carrier competition and delivery system competition. Each model has strengths and limitations, but the existing mix is driving down costs.
View details for Web of Science ID A1996VB83800005
View details for PubMedID 8920568
Incentives for a better health care system.
Journal of health care benefits
1994; 3 (6): 4-7
A SINGLE-PAYER SYSTEM IN JACKSON HOLE CLOTHING
1994; 13 (1): 81-95
The current Internal Revenue Code encourages employees who receive health insurance as part of their benefits package to choose more costly coverage than they would buy with their own money. The authors propose an approach that corrects this problem as well as the inequities experienced by self-employed and unemployed people.
View details for PubMedID 10165625
PROBLEMS IN GAINING ACCESS TO HOSPITAL INFORMATION
1991; 10 (2): 148-151
President Clinton's Health Security Act relies on government regulation, not market forces, to control costs. The act creates an entitlement to comprehensive benefits and places the federal budget at risk for total health care costs in order to achieve universal coverage; it creates a system of new state purchasing monopsonies; and it attempts to control costs with price controls on health plan premiums, set and administered by a National Health Board that would be part of the executive branch, not insulated from political considerations. We believe there is a better way.
View details for Web of Science ID A1994MX78800011
View details for PubMedID 8188160