Skip to content Skip to navigation

West Quality Improvement Award Winner: Measuring the seven 'Rs'

May 1, 2008
by the CRC Health Group Recovery Division QM/CS Team
| Reprints
CRC's Rating Audit Instrument allows the team to review, report, rate, respond, react, reassess, and resolve

JAMES W. WEST, MD, QUALITY IMPROVEMENT AWARD WINNER

Top row (l to r): nancy good, nathaniel lunn, celeste n. jupinko, emily jennings. bottom row: lillian gonzales, nancy casillas, fred pottle, michele solomon

Top row (l to r): Nancy Good, Nathaniel Lunn, Celeste N. Jupinko, Emily Jennings.
Bottom row: Lillian Gonzales, Nancy Casillas, Fred Pottle, Michele Solomon


CRC Health Group, headquartered in Cupertino, California, has 145 behavioral healthcare facilities in 29 states, with more than 5,000 employees serving more than 29,000 people every day. CRC's Quality Management and Clinical Services (QM/CS) Team directly assists each treatment facility within CRC's Recovery Division. The QM/CS Team develops, implements, monitors, and trends quality improvement activities for 62 comprehensive treatment clinics (CTCs) in 18 states, and team members realized in 2003 that they needed a standardized evaluation tool to meet their goals.

Thus, the QM/CS team developed the Quality Management Rating Audit Instrument (RAI), which allows the team to accomplish seven “R” factors: review, report, rate, respond, react, reassess, and resolve. These R factors allow for an ongoing, complete, comprehensive, full-circle, standardized quality management performance review of each facility. The RAI has ten distinct performance measurement categories:

  • Quantitative Documentation and Treatment Continuity/Randomly Selected Patient Records

  • Quality of Treatment and Documentation/Randomly Selected Patient Records

  • Quality of Treatment and Documentation/Special Patient Records

  • Administrative Oversight

  • Human Resources/Staffing

  • Customer Satisfaction/Services

  • Marketing/Public Relations

  • Regulatory Compliance

  • Staff Development/Training

  • Special Services

CTCs receive two on-site audits per year, during which the QM/CS Team auditor collects data using the following sources:

  • Inspection/review of patient files (active and inactive)

  • Inspection/review of human resources and personnel files

  • Inspection/review of administrative files

  • Walk-through(s) of the program facility

  • Interviews with staff members

  • Review of other survey/audit reports, outcomes, and plans of correction

In addition, the auditor collects narrative information for each RAI category, identifying areas of strength or those needing improvement as well as offering other comments (e.g., training needs). The reviewer scores each performance measurement area on a 1 to 10 Likert scale:

  • 1 to 4—nonconformance. A plan of action is required within 7 days to initiate movement toward conformance.

  • 5 to 7—moderate conformance. A plan of action within 90 days would be appropriate.

  • 8 to 10—commendable conformance. A minor plan of action might be needed over six months.

Once each of the ten RAI scores is calculated, the scores are totaled to yield a mean score for the facility. The auditor presents the facility with preliminary results, focusing on the most deficient areas. This immediate feedback allows the facility to commence its plan of action.

Cumulative data for two consecutive six-month reporting periods are shown in the table, which exhibits overall mean scores from all active, operating clinics within each six-month range. CTCs have demonstrated either ongoing improvement or stability in each of the ten performance measurement areas.


Table. Overall RAI mean scores for CTCs

Performance Measurement Indicator

December 2006 All Clinic Mean*

June 2007 All Clinic Mean**

Percentage Change

* Representative of mean scores for June to December 2006 for 55 CTC programs;

** representative of mean scores for January to June 2007 for 58 CTC programs.

Quantitative Documentation and Treatment Continuity/Randomly Selected Patient Records

6.7

7.1

+0.4%

Quality of Treatment and Documentation/Randomly Selected Patient Records

7.1

7.4

+0.3%

Quality of Treatment and Documentation/Special Patient Records

6.8

7.1

+0.3%

Administrative Oversight

7.8

8.0

+0.2%

Human Resources/Staffing

7.5

7.5

0.0%

Customer Satisfaction/Services

7.7

7.8

+0.1%

Marketing/Public Relations

7.8

8.2

+0.4%

Regulatory Compliance

8.3

8.3

0.0%

Staff Development/Training

7.3

7.7

+0.4%

Special Services

6.6

7.6

+1.0%

Pages

Topics