This Article Full Text (PDF) All Versions of this Article: 1087057107312628v1 13/2/159    most recent References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Google Scholar Articles by Zhijin Wu, Articles by Yunxia Sui, Search for Related Content PubMed PubMed Citation Articles by Zhijin Wu, Articles by Yunxia Sui, Social Bookmarking                   What's this?

Quantitative Assessment of Hit Detection and Confirmation in Single and Duplicate High-Throughput Screenings

Center for Statistical Sciences, zhijin_wu{at}brown.edu, Department of Community Health, Brown University, Providence, Rhode Island

Dongmei Liu

Department of Epidemiology and Population Health, London School of Hygiene and Tropical Medicine, United Kingdom

Yunxia Sui

Department of Community Health, Brown University, Providence, Rhode Island

The process of identifying active targets (hits) in high-throughput screening (HTS) usually involves 2 steps: first, removing or adjusting for systematic variation in the measurement process so that extreme values represent strong biological activity instead of systematic biases such as plate effect or edge effect and, second, choosing a meaningful cutoff on the calculated statistic to declare positive compounds. Both false-positive and false-negative errors are inevitable in this process. Common control or estimation of error rates is often based on an assumption of normal distribution of the noise. The error rates in hit detection, especially false-negative rates, are hard to verify because in most assays, only compounds selected in primary screening are followed up in confirmation experiments. In this article, the authors take advantage of a quantitative HTS experiment in which all compounds are tested 42 times over a wide range of 14 concentrations so true positives can be found through a dose-response curve. Using the activity status defined by dose curve, the authors analyzed the effect of various data-processing procedures on the sensitivity and specificity of hit detection, the control of error rate, and hit confirmation. A new summary score is proposed and demonstrated to perform well in hit detection and useful in confirmation rate estimation. In general, adjusting for positional effects is beneficial, but a robust test can prevent overadjustment. Error rates estimated based on normal assumption do not agree with actual error rates, for the tails of noise distribution deviate from normal distribution. However, false discovery rate based on empirically estimated null distribution is very close to observed false discovery proportion. (Journal of Biomolecular Screening 2008:159-167)

Key Words: high-throughput screening • hit detection • error rate • hit confirmation • false discovery rate

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?