Overview
   • What are quality metrics and how can they be used?
   • What are the current problems in using these concepts to 
      measure the quality and effectiveness of IRBs?
   • How can we use metrics in our local programs to measure 
      and improve the performance of our IRB?
   • What kind of metrics should be used in the future to 
      measure the quality and effectiveness of IRBs and/or are 
      different types of tools needed?
                                                                 2
     Background
     • “Quality” and “Metrics” – definitions differ depending on   
       upon context, industry, and viewpoint
     • Used most in business, engineering, and manufacturing
     • Adopted by many other sectors (e.g., the government 
       and health care industry)
     • Applying the business principles underlying “Quality 
       Metrics” to IRBs can be problematic
                                                                  3
     What is the Meaning of “Quality”
     • Definitions:
        • An inherent or distinguishing characteristic; a property or attribute
              inherent                 characteristic             attribute
        • A personal trait, especially a character trait
        • Essential character; nature
        • Superiority of kind
           Superiority of kind
        • Degree or grade of excellence
           Degree or grade of excellence
     • ISO 9000:  Degree to which a set of inherent 
       characteristics fulfills requirements
     • A perceptual, conditional, and somewhat subjective 
       attribute understood differently by different people
        attribute
                                                                         4
     Two Common Quality-Related 
     Functions
     • Quality Control - the process of reviewing the quality of 
        all factors involved in the production of goods or services 
         • Emphasizes testing and verification
         • Use of audits and checklists to uncover defects or deficiencies
     • Quality Assurance – systematic monitoring and 
        evaluation of the various aspects of a process, service, 
        or facility to maximize the probability that minimum 
        standards of quality are being met
         • Emphasizes validation
         • Uses metrics to prevent deficiencies and measure progress 
                  metrics
            toward set goals
                                                                           5
     Definition of “Metrics”
    • Verifiable measures stated in either quantitative or 
       Verifiable measures 
       qualitative terms that:
        • Capture performance in terms of how something is being done 
           relative to a standard or target
        • Allow and encourage comparison
        • Support the goals and objectives of the organization
    • Performance metrics (i.e., Key Performance Indicators) 
       often represent how far a metric is above or below a 
       specified target
                                                                        6