Advertisement

Estimation of receiver-operating characteristic curves to determine accuracy of a competitive enzyme-linked immunosorbent assay for the serodiagnosis of Brucella infection in domestic water buffalo (Bubalus bubalis) and cattle

Geoffrey T. FosgateDepartment of Medicine and Epidemiology, University of California, Davis, CA 95616.
Present address is Department of Veterinary Anatomy and Public Health, College of Veterinary Medicine, Texas A&M University, College Station, TX 77843.

Search for other papers by Geoffrey T. Fosgate in
Current site
Google Scholar
PubMed
Close
 DVM, PhD
,
Abiodun A. AdesiyunFaculty of Medical Sciences, School of Veterinary Medicine, University of the West Indies, Champs Fleurs, Trinidad and Tobago.

Search for other papers by Abiodun A. Adesiyun in
Current site
Google Scholar
PubMed
Close
 DVM, MPH, PhD
,
David W. HirdDepartment of Medicine and Epidemiology, University of California, Davis, CA 95616.

Search for other papers by David W. Hird in
Current site
Google Scholar
PubMed
Close
 DVM, MPVM, PhD
,
Wesley O. JohnsonSchool of Veterinary Medicine, and the Department of Statistics, University of California, Davis, CA 95616.

Search for other papers by Wesley O. Johnson in
Current site
Google Scholar
PubMed
Close
 PhD
,
Sharon K. HietalaCalifornia Animal Health and Food Safety Laboratory, University of California, Davis, CA 95616.

Search for other papers by Sharon K. Hietala in
Current site
Google Scholar
PubMed
Close
 PhD
,
Gerhardt G. SchurigVirginia-Maryland Regional College of Veterinary Medicine, Virginia Tech University, Blacksburg, VA 24061.

Search for other papers by Gerhardt G. Schurig in
Current site
Google Scholar
PubMed
Close
 DVM, PhD
, and
Joseph RyanVeterinary Diagnostic Laboratory, Ministry of Agriculture, Lands and Marine Resources, Champs Fleurs, Trinidad and Tobago.

Search for other papers by Joseph Ryan in
Current site
Google Scholar
PubMed
Close
 BVSc

Abstract

Objective—To estimate receiver-operating characteristic (ROC) curves for a competitive ELISA (c-ELISA) that is used in serodiagnosis of brucellosis in water buffalo and cattle, to determine the most appropriate positive cutoff value for the c-ELISA in confirmation of infection, and to evaluate species differences in c-ELISA function.

Sample population—Sera from 4 herds of cattle (n = 391) and 4 herds of water buffalo (381).

Procedure—Serum samples were evaluated for Brucella-specific antibodies by use of a c-ELISA. On the basis of previous serologic test results, iterative simulation modeling was used to classify animals as positive or negative for Brucella infection without the use of a gold standard. Accuracy of c-ELISA for diagnosis of infection was compared between cattle and water buffalo by comparison of areas under ROC curves.

Results—A positive cutoff value of 30% inhibition for c-ELISA yielded sensitivity and specificity estimates, respectively, of 83.9 and 92.6% for cattle and 91.4 and 95.4% for water buffalo. A positive cutoff value of 35% inhibition yielded sensitivity and specificity estimates, respectively, of 83.9 and 96.2% for cattle and 88.0 and 97.4% for water buffalo. Areas under ROC curves were 0.94 and 0.98 for cattle and water buffalo, respectively.

Conclusion and Clinical Relevance—ROC curves can be estimated by use of iterative simulation methods to determine optimal cutoff values for diagnostic tests with quantitative outcomes. A cutoff value of 35% inhibition for the c-ELISA was found to be most appropriate for confirmation of Brucella infection in cattle and water buffalo. (Am J Vet Res 2003;64:57–64)

Abstract

Objective—To estimate receiver-operating characteristic (ROC) curves for a competitive ELISA (c-ELISA) that is used in serodiagnosis of brucellosis in water buffalo and cattle, to determine the most appropriate positive cutoff value for the c-ELISA in confirmation of infection, and to evaluate species differences in c-ELISA function.

Sample population—Sera from 4 herds of cattle (n = 391) and 4 herds of water buffalo (381).

Procedure—Serum samples were evaluated for Brucella-specific antibodies by use of a c-ELISA. On the basis of previous serologic test results, iterative simulation modeling was used to classify animals as positive or negative for Brucella infection without the use of a gold standard. Accuracy of c-ELISA for diagnosis of infection was compared between cattle and water buffalo by comparison of areas under ROC curves.

Results—A positive cutoff value of 30% inhibition for c-ELISA yielded sensitivity and specificity estimates, respectively, of 83.9 and 92.6% for cattle and 91.4 and 95.4% for water buffalo. A positive cutoff value of 35% inhibition yielded sensitivity and specificity estimates, respectively, of 83.9 and 96.2% for cattle and 88.0 and 97.4% for water buffalo. Areas under ROC curves were 0.94 and 0.98 for cattle and water buffalo, respectively.

Conclusion and Clinical Relevance—ROC curves can be estimated by use of iterative simulation methods to determine optimal cutoff values for diagnostic tests with quantitative outcomes. A cutoff value of 35% inhibition for the c-ELISA was found to be most appropriate for confirmation of Brucella infection in cattle and water buffalo. (Am J Vet Res 2003;64:57–64)