ABSTRACT
Concern about the adequacy of the credentialing process led the Massachusetts Board of Registration in Medicine to create the Expert Panel on Credentialing for the purpose of ensuring that all physicians on a medical staff are providing safe and competent care throughout the entire duration of their careers. The Panel was charged with creating a standardized framework that facilities could use for both the initial credentialing and the re-credentialing processes.
The Panel began its deliberations in September 2006. An initial survey of selected health care facilities in Massachusetts was conducted to understand the current spectrum of credentialing criteria. The Panel reviewed the literature and developed core credentialing criteria. These criteria, or guidelines, suggest several assessment measures for each of the six core competencies endorsed by The Accreditation Council for Graduate Medical Education and The Joint Commission (Table 4). Health care facilities may elect to use these guidelines during the credentialing process to ensure that every licensed and certified physician is competent to provide current evidence-based care.
Keywords:
A decade has passed since the publication of the IOM report To Err Is Human.1 Yet the pressing question remains: are patients any safer? A recent report from the Agency for Healthcare Research and Quality (AHRQ) suggests that progress toward a safer environment is mixed. Overall, measures of patient safety have actually declined recently.2 There was a positive finding in that hospitals are responding with performance improvement initiatives, but unfortunately their effects will take some time to show up in the statistics.2,3 As the AHRQ report notes, progress has been slow with regard to optimizing health care quality, measurement of that quality and therefore patient safety. Safety initiatives stagnate unless there is active involvement of leadership and the medical staff.4,5 Missing from the discussion are any data concerning physician competence. Yet, successful implementation of these initiatives requires well-qualified, knowledgeable, currently competent physicians. The primary method for ensuring competence is the hospital credentialing process.
Concern about the adequacy of the credentialing process led the Massachusetts Board of Registration in Medicine (Board), in September 2006, to create the Expert Panel on Credentialing (Panel) through its Patient Care Assessment (PCA) division. The Board's PCA has statutory and regulatory authority over quality improvement, patient safety, medical error prevention, and credentialing activities at Massachusetts health care facilities. PCA monitors these processes through review of quarterly reports submitted by the facilities describing all serious, unexpected patient outcomes, results of their investigations, and corrective plans undertaken by the institution. Through examination of these reports and communication with health care facility leadership, PCA concluded that the credentialing process in many hospitals is weak and haphazard, making it difficult to achieve the purpose of ensuring that all physicians on the medical staff are providing safe and competent care.
Since there seemed to be no uniform or reproducible method common to all hospitals for the required biennial physician credentialing, the Panel was charged with creating a standardized framework that facilities could use for both the initial credentialing and the re-credentialing processes. The overall objective was to develop a mechanism whereby populations served could be assured that the hospitals' credentialed physicians remain competent throughout the entire duration of their careers. Optimally, this framework should include a broad array of methods, such as evaluation of patient outcomes through case reviews, analysis of data, review of accomplishments, complaints, certifications, and other competency assessments as recommended by specialty boards, professional societies, or regulatory agencies.
The Panel acknowledged at the outset that satisfactory completion of a training program does not ensure sustained competency. The Accreditation Council for Graduate Medical Education (ACGME) and American Board of Medical Specialties (ABMS) recognized this reality several years ago. These organizations, together with the Federation of State Medical Boards (FSMB), are working to establish standardized, comprehensive, and continuing methods for assessing physician competencies, both for physicians in training, at the hospital level, and for physicians in practice.6–8 As part of this process, the ACGME identified six areas of core competencies, for which each specialty has developed its own specifics. The driving purpose of the Panel, as well as these organizations, is to assure the public that every licensed and certified physician is competent to provide current evidence-based care.
The Panel began its deliberations in September 2006. An initial survey of selected health care facilities in Massachusetts was conducted to understand the current spectrum of credentialing criteria. As evidenced in Table 1, while there were several common elements, considerable variation in criteria was observed. Based on this finding, the Panel reviewed the literature and developed the Core Credentialing Criteria listed in Table 2. Primary Criteria are those typically used by facilities to meet mandatory credentialing requirements, while Secondary Criteria are suggested as elective depending upon the needs of the specific facility. In addition to ensuring compliance with the basic essentials of credentialing, these criteria or guidelines, taken in the aggregate, provide a basis for assessing the six major areas embraced by the ACGME, ABMS, Joint Commission, and FSMB as defined in Table 4.6–9
Spectrum of Core Credentialing Criteria
Spectrum of Core Credentialing Criteria
Primary and Secondary Credentialing Criteria
Primary and Secondary Credentialing Criteria
On Oct. 17, 2007, the Board approved this report, including the proposed guidelines.10
The responsibility for measuring competency rests with the hospitals or health care facilities where physicians practice. The guidelines suggest several assessment measures for each of the six core competencies. As the science of measuring competency is in its early stages of development, the Panel did not believe that use of any specific measures should be mandated at this time. These metrics will undoubtedly be modified and expanded over time. However, the broad array of assessment methods currently available is more than adequate to permit more meaningful competency measurement than has been the case in the past.
To test the feasibility of implementing these core guidelines, the Panel asked four hospitals to use them in their credentialing processes. One was a large teaching hospital (735 beds). The others were community hospitals: two mid-sized (360 beds and 270 beds), and one a small hospital (78 beds).
Results
The level of adoption of the proposed criteria was proportional to hospital size. The large teaching hospital adopted and harmonized the guidelines with other certifying standards, including the new mandates from The Joint Commission requiring frequent practice evaluations.8 ,11 An administrative arm, Medical Staff Services, worked closely with department chiefs and members of the Credentials Committee and rolled the end product out to departments one at a time. As of this writing, 12 of 14 departments have selected appropriate measures: 11 have a written plan in place and have fully implemented the process. Medical Staff Services maintains central administrative oversight and provides monthly reminders to chiefs and/or designees as to which physicians need evaluation. The centralized service also maintains summary documentation and conducts periodic audits of departmental files to ensure regulatory compliance.
The larger mid-sized hospital developed an Excel™ spreadsheet for departments to use, which incorporated the name of the competency, a description of what was meant, and a request for the department to indicate the measurement used for the assessment. The spreadsheet was rolled out to all departments at the same time. This change brought about some initial reluctance to adopt this new method of assessing competency, but a year later, and with significant administrative support, a solid majority of departments are using the standards.12
The smaller mid-sized hospital withdrew from the pilot study because their clinical champion relocated.
The small hospital implemented the proposed credentialing framework in 2007. Initially, the chairs and chiefs of departments and divisions had some concerns about the quality and reliability of the data available to use for evaluation. Once a method for supplying clear, precise, up-to-date data was provided, they endorsed and adopted the framework. Like the large teaching hospital, this small community hospital coupled use of the guidelines with other mandates and initiatives, and all departments initiated the change at once.13
Discussion
The proposed elements of core competencies parallel initiatives by the ABMS, ACGME, Joint Commission, and FSMB. They are designed to standardize expectations through professional development from medical student to senior physician. Our intent is to provide guidelines for facilities to incorporate within their credentialing process, along with suggested measures where available and applicable (Table 3).
Generic Measures Applicable to Assessment of Clinical Competence
Sample Evaluation for Medical Staff Appointment
Assessment of Current Clinical Competence
Applicant's Name: ______________________________________
Evaluating Institution: ______________________________________
Current Status: Active _____ Affiliate ____ Fellow _____ Resident
Dates of Appointment: From ____ To _____
Goals/Objectives for Next Year: 1. ___________________
2.__________________
Signature of Evaluator: ______________ Signature of Applicant: ____________
The Panel also provided a sample template based upon the six core competencies to facilitate the annual or biannual evaluation (Table 4).
While these guidelines are not provided as regulations, institutions are accountable for implementing a sustainable process for ensuring competency. The proposed framework endorsing the six core competencies and associated measures presents a spectrum of options for measurement. Some may not be applicable to a specific health care facility or specialty practice. However, the measures listed provide several alternatives from which a facility can select those deemed most appropriate.
The predominant impediment to implementation of this standardized approach to competency-based credentialing is the established culture of medicine, which is fiercely individualistic, skeptical, professionally autonomous, and generally resistant to monitoring or proctoring. In most health care organizations, accountability is diffuse, and physician authority structures tend to be rigid and hierarchal. Therefore, imposing measurement of current competency as the most important element in credentialing generates fear of judgment and suspicion of motives. Use of data that may be marginally accurate adds uncertainty to the mix, fueling an atmosphere of distrust. In this environment, granting authority figures considerable power over how a physician practices constitutes a clear threat to the physician, and a risk for the evaluators.
The Panel believes this culture generates the first barrier for implementing standardized credentialing guidelines: obtaining buy-in by hospital leaders and the medical staff. The objective measurement of competency beyond those specified for specialty board maintenance of certification is difficult. When individual performance measures are adopted that are not based upon financial or clinical process indicators, skepticism rapidly emerges regarding objective validity. Most physicians believe that meaningful measures of medical staff performance are determined not only by evidence-based medical practice and outcome parameters, but also by thoughtful deliberation led by a respected clinical champion.14 In our pilot testing, it was very clear that sensitive hospital leadership was crucial in getting physicians to adopt and implement the Panel's credentialing criteria.
The second major barrier is the threat inherent in change itself. Many physicians live by routines; the “same way everyday” philosophy in surgery has led to the use of checklists, which have been shown to lower mortality.15 If one approach has worked successfully in the past, why risk that comfort zone for unproven, and only potential, improvement? Leading change is about listening and taking time for people to voice opinions and process new information. The eight-step change process developed by John Kotter requires communication across constituencies and then more communication (Table 5).16 ,17 This thoughtful communication process was evident in each hospital which successfully implemented the standardized credentialing scheme.
Kotter's 8-Step Change Model
In addition to endorsement by the medical staff, ensuring compliance with competency-based credentialing will require more administrative resources. However, these are probably no more than those now required to comply with new The Joint Commission standards for physician evaluation.8 More difficult is the challenge posed by physicians who provide care to a low volume of patients, or do not admit patients to the hospital at all. Yet another daunting issue is the current variability in training and performance measures for physicians from different disciplines who provide the same therapeutic modalities.
The issue of granting privileges once a physician has satisfied the criteria for credentialing is not addressed in this document. It is recognized that a number of issues enter into this decision, such as practice volume, emerging technology and type of supervision required for the privileged physician, all of which significantly impact quality of care and need to be considered. In addition, we have not addressed the challenge inherent in assuring competency of physicians who have no affiliation with an institution or are so remotely affiliated as to preclude informed assessment. The Massachusetts Medical Society has agreed to pursue this latter task.
The Panel puts forth this proposal to initiate a process that is hoped to evolve as entities such as the FSMB, ABMS, The Joint Commission, state medical societies, professional societies, health plans, insurers, and various institutions work together to standardize a competency-based credentialing process.
Appendix
Massachusetts Board of Registration in Medicine Expert Panel on Credentialing
Anthony D. Whittemore, M.D.
Chief Medical Officer, Brigham and Women's Hospital, Professor of Surgery, Harvard Medical School
Robert J. Cella, M.D.
Chief Medical Officer, St. Peter's Hospital, Albany, New York
Alice A. Coombs, M.D.
President-Elect, Massachusetts Medical Society, Member, Patient Care Assessment Committee, Massachusetts Board of Registration in Medicine
Martin Crane, M.D.
Past Chair, Board of Directors, Federation of State Medical Boards
Charlene A. DeLoach Oliver, J.D., CISR
Consultant, Federation of State Medical Boards Foundation, Public Member
James E. Fanale, M.D.
Chief Operating Officer, Jordan Hospital
John A. Fromson, M.D.
Department of Psychiatry, Massachusetts General Hospital, Assistant Clinical Professor of Psychiatry, Harvard Medical School
Gwen Gilchrist
Director, Provider Services, Brigham and Women's Hospital, President, Massachusetts Association for Medical Staff Services
Ronald B. Goodspeed, M.D.—retired
President & Chief Executive Officer, Emeritus, Southcoast Hospitals Group
John Herman, M.D.
Associate Professor of Psychiatry, Harvard Medical School, Massachusetts General Hospital
Katharine S. Kosinski, M.D.
Chief, Department of Pathology, Cambridge Hospital
Carolyn S. Langer, M.D.
Medical Director, Fallon Community Health Plan
Lucian L. Leape, M.D.
Adjunct Professor of Health Policy, Harvard School of Public Health
Timothy R. Lynch, M.D.
Patient Care Assessment Coordinator, Brockton Hospital
Barry M. Manuel, M.D.
Associate Dean, Continuing Medical Education, Professor of Surgery, Emeritus, Boston University School of Medicine
Stancel M. Riley, M.D.
Director, Patient Care Assessment Division, Massachusetts Board of Registration in Medicine
Robert J. Schreiber, M.D.
Physician-in-Chief, Hebrew Senior Life
Joan C. Stoddard, J.D.
Legal Counsel, Office of General Counsel, Partners HealthCare System, Harvard Medical School
References
- 1.↵Kohn LT , CorriganJM, DonaldsonMS. To Err Is Human: Building a Safer Health System. Washington, DC: National Academy Press; 2000.
- 2.↵Agency for Healthcare Research and Quality. Key themes and highlights from the National Healthcare Quality Report. In: National Healthcare Quality Report 2008, National Academy Press; 2009.
- 3.↵Leape LL , BerwickDM. Five years after To Err is Human: what have we learned? JAMA, 2005; 293 (19).
- 4.↵Joint Commission Alert: Effective Leadership Critical to Preventing Medical Errors. http://www.jointcommission.org/NewsRoom/NewsReleases/nr_8_27_09.htm. Accessed August 28, 2009.
- 5.↵Walsh KE , EttingerWH, KlugmanRA. Physician quality officer: a new model for engaging physicians in quality improvement. American Journal of Medical Quality. 2009;24:295–301.
- 6.↵Joyce B. Introduction to competency-based residency education. A product of the ACGME Outcome Project. Chicago, IL: ACGME; 2006.
- 7.American Board of Medical Specialties. MOC Competencies and Criteria. http://www.abms.org/Maintenance_of_Certification/MOC_competencies.aspx. Accessed August 28, 2009.
- 8.↵Federation of State Medical Boards. The Changing Landscape of Competency. http://www.fsmb.org/pdf/as_presentations_2009/sat_050209/mol_panel/competency_dalton_0509.pdf. Accessed August 28, 2009.
- 9.Joint Commission Resources. Medical staff. In: Comprehensive Accreditation Manual for Hospitals: The Official Handbook. Oakbrook Terrace, IL; 2010.
- 10.↵Massachusetts Board of Registration in Medicine. Report of the Expert Panel on Credentialing: Guidelines for Competency-based Hospital Credentialing. Updated February 2008. http://www.massmedboard.org/pca/pdf/credentialing_guidelines_2008.pdf. Accessed August 28, 2009.
- 11.↵Gilchrist G. Brigham and Women's Hospital Experience using Massachusetts Board of Registration Expert Panel Credentialing Guidelines. Presentation to the Credentialing Expert Panel. June 23, 2009; Boston, MA.
- 12.↵Lynch T. Signature Healthcare—Brockton's Experience using BORIM Expert Panel Credentialing Guidelines. Presentation to the Credentialing Expert Panel. June 23, 2009; Boston, MA.
- 13.↵Goodspeed R. Southcoast Hospital Group Experience using BORIM Expert Panel Credentialing Guidelines. Presentation to the Credentialing Expert Panel. June 23, 2009; Boston, MA.
- 14.
- 15.↵Haynes AB , WeiserTG, BerryWR, et al. A surgical safety checklist to reduce morbidity and mortality in a global population. NEJM. 2009; 360(5):491–499.
- 16.
- 17.↵Kotter's 8-step Change Model. http://www.mindtools.com/pages/article/newPPM_82.htm. Accessed June 2, 2010.





