Method Evaluation in Quality Assurance
29 Questions
11 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What is involved in pre-analytic quality assurance?

  • Evaluating the method
  • Testing precision and accuracy
  • Proper specimen collection and labeling (correct)
  • Assessing safety considerations
  • Why should precision and accuracy be tested when getting a new method of testing or instrument?

  • To ensure procedure or instrument performance (correct)
  • To determine financial issues
  • To assess medical usefulness
  • To evaluate safety considerations
  • What are the criteria for selecting a new method or instrument based on medical usefulness?

  • Diagnostic/Prognostic purpose (correct)
  • Application methodology
  • Chemical specificity
  • Anticipated workload
  • What should be considered under technical issues for method selection?

    <p>Optimum reaction conditions</p> Signup and view all the answers

    Which factor is NOT part of the technical considerations during method selection?

    <p>Safety consideration</p> Signup and view all the answers

    What is the primary reason for evaluating precision and accuracy with a new analytical method?

    <p>To ensure reliability of results</p> Signup and view all the answers

    What are the 5 steps that must be part of method evaluation?

    <p>Instrument maintenance, technologist training, sample collection, precision check, linearity check</p> Signup and view all the answers

    What is the formula for calculating Total Error (TE)?

    <p>TE = RE + SE</p> Signup and view all the answers

    What is analyzed to obtain an estimate of short-term imprecision?

    <p>20 samples of each material within a run</p> Signup and view all the answers

    What type of error occurs in one direction only and results in inaccuracy?

    <p>Systematic error</p> Signup and view all the answers

    In long-term replication experiments, how many samples of each control material should be analyzed?

    <p>1 sample of each material on 20 different days</p> Signup and view all the answers

    What are the two types of errors that need to be tested during method validation?

    <p>Systematic error and random error</p> Signup and view all the answers

    Which calculation is used to determine the coefficient of variation?

    <p>$\text{CV} = s \times 100 / \text{mean}$</p> Signup and view all the answers

    What is the purpose of performing linearity studies?

    <p>To confirm the analytic range of an analyte</p> Signup and view all the answers

    Which step involves checking for random errors during method evaluation?

    <p>Precision check</p> Signup and view all the answers

    What percentage of the defined total error should the within-run standard deviation be for short-term imprecision?

    <p>&lt;25%</p> Signup and view all the answers

    What do recovery studies measure in accuracy assessments?

    <p>Systematic error</p> Signup and view all the answers

    What do interference studies aim to check in quality assurance?

    <p>Matrix effects</p> Signup and view all the answers

    What questions can be answered through method evaluation of a new method or instrument?

    <p>Is it performing as expected by the manufacturer?</p> Signup and view all the answers

    What does the upper limit of linearity of a new method refer to?

    <p>The maximum range of sample values that can be accurately measured</p> Signup and view all the answers

    What is the significance of establishing a working Method Evaluation Plan?

    <p>To evaluate the performance characteristics and precision of the new method</p> Signup and view all the answers

    Why is it important to have a procedure in place if the test sample exceeds the limit of linearity?

    <p>To ensure accurate results are still obtained</p> Signup and view all the answers

    What determines whether a new method can be implemented after evaluation?

    <p>SOP documentation and training of technologists</p> Signup and view all the answers

    What is the CLIA criterion for acceptable performance for cholesterol?

    <p>19.9 mg/dL</p> Signup and view all the answers

    When comparing a new method with a reference method, what study design should be followed?

    <p>Analyze the same samples using both methods</p> Signup and view all the answers

    How is precision typically measured in quality assurance studies?

    <p>Mean, standard deviation, and %CV</p> Signup and view all the answers

    What does the accuracy of a new method compare to the reference method indicate?

    <p>Agreement of a measurement with the true value</p> Signup and view all the answers

    What is the total error in quality assurance composed of?

    <p>Random error from precision study and systematic error from linearity or comparison of methods</p> Signup and view all the answers

    In quality assurance, how is linearity typically determined?

    <p>With graph and linear regression</p> Signup and view all the answers

    Study Notes

    Pre-analytic Quality Assurance

    • Involves proper specimen collection, identification, and labeling, as well as storage and transport at the correct temperature
    • Processing includes adding preservatives, and equipment and reagents must be properly received and referred or delivered for testing

    Method Evaluation

    • Definition: A systematic test of an analytical method to assess a procedure or instrument's performance
    • Objectives: To test precision and accuracy when getting a new method or instrument
    • Involves replicant studies, linearity, recovery, interference, and comparison with previous methods

    Method Selection

    • A new method or instrument should be chosen based on medical usefulness, financial issues, technical issues, application, methodology, and performance
    • Technical issues include required personnel training, safety considerations, sample type and size, anticipated workload, and routine turnaround time
    • Technical considerations include methodology characteristics, such as chemical specificity, optimum reaction conditions, and manner of calibration, as well as performance characteristics like upper limit of linearity and lower limit of sensitivity

    Method Evaluation Plan

    • Involves implementing a new method if the method evaluation shows acceptable results, the SOP is written, and technologists are trained
    • The plan should answer questions about a new method or instrument, such as its performance, manufacturer's claims, and provision of information for patient care
    • The plan includes 5 steps: instrument maintenance and calibration, technologist training, sample collection, precision check, linearity check, recovery studies, interference experiment, and comparison of methods

    Method Validation

    • Precision and accuracy must be tested, with precision checked first to test random errors and accuracy checked second to test systematic errors
    • Part of the process to evaluate method performance

    Types of Error

    • Random error (precision error): due to chance and affecting precision
    • Systematic error (accuracy error): due to factors like erroneous values for standards and incomplete calibration, affecting accuracy
    • Total error (TE) is the sum of random error (RE) and systematic error (SE)

    Systematic Error

    • Error that occurs in one direction only, increasing or decreasing results by the same amount
    • Due to factors like erroneous values for standards, incomplete calibration, and shifts in reagent baseline
    • Results in inaccuracy

    Linearity

    • Example: cholesterol levels with a linear regression equation of y = 1.001x - 0.289
    • Linearity studies involve analyzing 20 samples of each material within a run or day to obtain an estimate of short-term imprecision
    • Long-term replication experiment involves analyzing 1 sample of each material on 20 different days to estimate long-term imprecision

    Precision Calculations

    • Calculate the mean, standard deviation, and coefficient of variation for each material
    • Formulae: mean = ∑xi / n, SD or s = √∑(xi-mean)² / (N-1), CV = s / mean × 100
    • Determine whether short-term and long-term imprecision is acceptable based on total allowable error

    Precision Acceptable Levels

    • For short-term imprecision: within-run standard deviation should be ¼ or less of the defined allowable total error
    • For long-term imprecision: the total standard deviation should be 1/3 or less of the defined total error

    Accuracy Studies

    • Types of accuracy studies: recovery studies, interference studies, and dilution (linearity) studies
    • Recovery studies measure proportional systematic error and help understand bias revealed in the comparison of methods experiment

    Comparison of Methods

    • If reference method available, validate new method compared to reference
    • Study design: analyze same samples by both methods, making sure both instruments are well maintained and calibrated
    • Plot results of new method on Y-axis and reference method on X-axis, with a plot comparison line (slope 1.0 and y-intercept 0)

    Accuracy of New Method

    • Agreement of a measurement with the true value, indicating systematic error
    • Measured with linearity, recovery, and interference studies

    Summary

    • Precision is measured with replicant studies, involving mean, standard deviation, and %CV
    • Accuracy is measured with linearity, recovery, and interference studies
    • Total error is the sum of random error (from precision study) and systematic error (from linearity or comparison of methods)

    Studying That Suits You

    Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

    Quiz Team

    Description

    Learn about the steps involved in method evaluation for quality assurance, including precision check, linearity check, recovery studies, interference experiments, and comparison of different methods. Understand the importance of testing precision and accuracy in method validation.

    More Like This

    Use Quizgecko on...
    Browser
    Browser