Skip to main content
  • Analytic Perspective
  • Open access
  • Published:

Flexible Two-Phase studies for rare exposures: Feasibility, planning and efficiency issues of a new variant

Abstract

The two-phase design consists of an initial (Phase One) study with known disease status and inexpensive covariate information. Within this initial study one selects a subsample on which to collect detailed covariate data. Two-phase studies have been shown to be efficient compared to standard case-control designs. However, potential problems arise if one cannot assure minimum sample sizes in the rarest categories or if recontact of subjects is difficult.

In the case of a rare exposure with an inexpensive proxy, the authors propose the flexible two-phase design for which there is a single time of contact, at which a decision about full covariate ascertainment is made based on the proxy. Subjects are screened until the desired numbers of cases and controls have been selected for full data collection. Strategies for optimizing the cost/efficiency of this design and corresponding software are presented. The design is applied to two examples from occupational and genetic epidemiology. By ensuring minimum numbers for the rarest disease-covariate combination(s), we obtain considerable efficiency gains over standard two-phase studies with an improved practical feasibility.

The flexible two-phase design may be the design of choice in the case of well targeted studies of the effect of rare exposures with an inexpensive proxy.

Introduction

For rare exposures, the power of epidemiological studies depends mainly on the rarest disease-exposure combinations. For example, in population-based case-control studies the limiting factor is frequently the number of exposed cases and/or controls. One approach that may substantially increase power for these types of studies is the two-phase study design.

The two-phase design [14] consists of an initial (Phase One) large study with known disease status and easily collectible or inexpensive covariate information. Within this initial study one selects a subsample on which to collect detailed covariate data (Phase Two). In Phase Two, one may deliberately oversample the subjects with the rarest exposure-disease combinations based on the available Phase One information, consequently increasing power. Appropriate statistical methods [5] correct for the biased sampling by incorporating the statistical distribution of the available information among cases and controls from Phase One. The data collection of Phase Two usually proceeds in one of two ways. The first approach includes recontacting selected study subjects from Phase One to obtain detailed covariate information. However, with secondary data collection, potential problems may arise if recontacting subjects is difficult, if cases have died, or if response rates are low. Alternatively, one may collect full raw data at first contact for all participants and process only selected subjects. An example would be a molecular or genetic epidemiologic study in which biological specimens were obtained for all cases and controls but only a subsample were genotyped (see [6] for another example). This may, however, be considered wasteful since only a fraction of the collected data is used.

As an alternative, we propose a new variant of the two-phase design called the flexible two-phase design, for which there is a single time of contact. Phase One data are collected for all subjects and Phase Two subjects are selected for immediate complete data collection based on their basic Phase One information. The key principle of this new variant is to fix a priori stratum-wise numbers of cases and controls for full data collection and recruit Phase One subjects until the required numbers of subjects in each stratum are reached.

We describe the proposed study design and its implementation in terms of power, cost/efficiency considerations and statistical analysis. We illustrate its applicability using two examples from occupational and molecular/genetic epidemiology.

Steps in the planning and the analysis of flexible two-phase studies

We start by defining several key variables and then describe the proposed set-up for the study design. First, define Z, a discrete proxy variable for the exposure(s) of interest (X). Z needs to be collected and available at Phase One. Then, compute the power for several design options within the flexible two-phase design (see below). Based on these computations, select the design option which produces the best compromise between power and feasibility in terms of subject availability, cost and other study-specific criteria that will permit achievement of the study aims.

The four major steps for the set-up of a study with the proposed design are as follows:

Design set-up

1. Identify a stratification variable Z which is an easily available proxy of the exposure(s) of interest X. The number of strata (J) will equal the number of response choices for Z.

2. For each stratum, fix the number of cases and controls (nij), based on study power and cost considerations, for whom the exposure of interest X and covariates will be assessed. From nij, compute their expected distributions according to X and the numbers of cases and controls who will need to be screened at Phase One.

Data collection

3. Screen subjects for Z and keep cases and controls for full data collection (i.e. the variable(s) of interest X and potential confounders) until the numbers of cases and controls fixed in step 2 are reached.

4. Within each stratum j, count the number of cases and controls that were screened in Phase One at Step 3.

Computation of expected numbers and power

As mentioned above, the expected Phase One numbers depend on the fixed stratum-specific Phase Two numbers. They also depend on the study hypotheses including exposure prevalences and odds ratios. Other assumptions, common to all types of two-phase studies, quantify how well the Phase One strata predict the exposure of interest (sensitivity and specificity of proxy Z). The formulas for expected Phase One and Phase Two numbers are given in Appendix 1. From these numbers, one can compute, using specific variance computations given in Schill and Drescher [5], the expected asymptotic variance and the statistical power. A corresponding STATA (StataCorp, College Station Texas) program for data analysis and power computations is included as an online add-on to this paper.

Planning options

A critical issue is how to optimize, in terms of cost and power, the fixed stratum-wise numbers of cases and controls with full data collection. This complex problem has been addressed in different contexts [710]. However, one can formulate a general heuristic rule, which has worked well in our applications using Maximum Likelihood as the analysis method. Specifically, choose the numbers of cases and controls for full data collection so that, within both controls and cases, the overall expected Phase Two exposure proportions are as equally distributed as possible. For rare exposures, this means choosing cases and controls to oversample the rarest exposure categories among both groups.

Statistical analysis

The collected data can be analyzed using any two-phase analysis software. As the second phase sample is a biased sample of the original population, a combined analysis of the Phase One and the Phase Two data relies on weighting of the Phase Two data by the inverse sampling fractions. The two main methods for analysis are maximum likelihood (ML) and weighted likelihood (WL) which differ in the weights used; the more efficient ML estimate iteratively adjusts these weights using the estimated disease model. As such software is not readily available, we included our STATA-based two-phase analysis program "blogit_2P.ado" [see additional file 1]. The software takes as input the disease indicator, the stratum indicator, the Phase One frequencies, the Phase Two frequencies and the independent variables. A help file accessible from within STATA "blogit_2P.hlp" [see additional file 2] is also included as well as an illustrative example [see additional files 3 and 4]. In this paper, we use the ML approach.

Examples

To demonstrate the potential efficiency of the flexible two-phase approach, we present two examples from occupational and molecular/genetic epidemiology. In the first example, we detail the computations for a given design; in the second, we perform a full search for optimal designs for given scenarios.

Example 1: Metalworking fluids and bladder cancer

A number of population-based case-control studies have found an association between bladder cancer and metalworking fluids (MWF) exposure (see Calvert [11] for a review). However, because of the low prevalence of the exposure, the numbers of exposed cases and controls in each study were too small to produce a stable estimate of the association. We use a flexible two-phase study to illustrate the efficiency gain over a standard case-control study, considering as a proxy of MWF exposure "having worked in the metal industry". In practice, when contacting cases and controls, for instance in a telephone interview, one of the first questions to the volunteers would be: "Have you ever worked in the metal industry?". Based on the answer to this question the subject would then be included (or not) in Phase Two; that is, the interview would be continued to assess a detailed work history and confounder information.

Table 1 details the assumptions. The study proceeds along the four steps as follows:

Table 1 Scenario for Example 1

Study design

1. Stratify subjects by Z (Table 1, Line 1).

2. Per stratum, fix the numbers of cases and controls (160 metal-working and 40 non-metal-working controls, 85 metal-working and 20 non-metal-working cases – Table 2 Column 3) to be included and for whom MWF exposure will be assessed at Phase Two. These numbers were chosen using our heuristic rule to reach 80% power to detect the effect of MWF.

Table 2 Design of the flexible two-phase study for Example 1

Planned data collection

3. Screen cases and controls until the required numbers in each stratum are reached and assess the detailed exposure to MWF and potential confounders in this sample of 305 subjects.

4. Record the number of subjects screened in order to reach the required sample size. At the planning stage, these numbers are not yet available, but expected numbers can be computed. Assuming 20% metal-workers in the general population, we would expect to screen 800 controls (N0) to obtain 160 metal-workers (20% × 800 = 160). Therefore, the number of non-metal worker controls that would have been screened (N00) is expected to be 640 (800–160) of which 40 are included in Phase Two for detailed exposure assessment. For the corresponding computations for cases, see Table 2 and Appendix 2.

We note that oversampling the metal-workers has achieved our aim of increased numbers of MWF exposed cases and controls. Among the 200 controls, 41 are exposed (20.5% versus 7% in Phase One) and among the 105 cases, 35 are exposed (33.3% versus 13% in Phase One) (Table 2, Column 6 and Footnote §.

Figure 1 shows the STATA output of the analysis of the expected frequencies. The STATA program for this analysis is included as an additional file (figure 1.do [see Additional file 3] using the STATA data file MWF.dta [see Additional file 4] obtained by applying the computations shown in Appendix 2). In this example d, z, X, Nij, nijk, respectively denote, the case status (1 = case, 0 = control), the stratum indicator, the metal fluid indicator (X = 1 exposed, X = 0 unexposed), the stratum-wise numbers in Phase One, and the Phase Two numbers by stratum and exposure to metal fluids. The power is computed using a bilateral Wald test at a 5% level using the following formula: Power = Φ(βx/se(βx)-1.96) = 80.2% where Φ denotes the cumulative standard normal distribution, βx the log-odds ratio and se(βx) its standard error. The asymptotic standard error se(βx) is 0.247 for the log-odds ratio and βx = ln(2) = 0.693, as the assumed OR is equal to 2. In contrast, a standard case-control study, in which 200 controls and 105 cases were randomly selected, would yield a se(βx) = 0.400, corresponding to 40.9% power using the same formula.

Figure 1
figure 1_48

STATA output for Example 1.

Example 2: Detection of gene-environment interaction

Molecular/genetic epidemiology studies identify genes involved in disease risk, estimate the strength of the disease-gene association and investigate modifier factors that may interact with the susceptibility genes. The study of interactions between genes and "environmental" factors is often challenging because of the rarity of having both factors, i.e., being exposed to the environmental factor of interest and carrying a deleterious allele.

We present a search for an optimized flexible Two-Phase design, in this setting, assuming that an inexpensive proxy of the deleterious allele (e.g., family history of disease) is available.

The scenarios

We consider a rare deleterious allele G with 1% prevalence (PG), interacting with an environmental exposure E with 20% prevalence (PE). The odds ratios for E, G and their interaction (I) are respectively 2, 3 and 5 (Table 3).

Table 3 Scenarios for Example 2

We further assume that the proxy of the susceptibility gene (SG) and the environmental exposure (E) are available at Phase One for an unlimited number of controls. However, we restrict the number of cases available in Phase One to a maximum of 2000 cases. We further assume that capacities for genotyping restrict the total number of subjects (cases + controls) that can be included in Phase Two to a maximum of 1200 subjects. We assume that the cost of genotyping is 20 times the cost of screening. Such a cost ratio would arise if, for example, a SNP array costs $100 and 15 minutes for a trained interviewer screening a subject for E and SG costs $5. We repeat the design search for each combination of sensitivity (Se) and specificity (Sp) of 0.6, 0.7, 0.8, and 0.9.

Planning the design

The aim of the flexible two-phase approach is to choose subjects for genotyping to optimize the study power for given costs. This is achieved by oversampling subjects with positive gene proxy and environmental exposure.

In practice, such oversampling could be done during case/control recruitment using a short interview that allows assessment of the environmental exposure and the gene proxy (e.g., a family history of disease) and getting a blood/buccal sample (for genotyping) only for the subjects sampled for Phase Two based on the results of this first interview.

Step 1: The stratification is by gene surrogate and environmental exposure (Table 3, line 1).

Step 2 entails choosing the stratum-wise numbers of cases and controls to be included in Phase Two. We use our general heuristic rule with respect to E and fix at 50% the target numbers of E+ and E- to be included in Phase Two among cases and controls. The amount by which we oversample SG+ will be considered through use of two additional parameters, the proportion of controls ρ0 with SG+ and the proportion ρ1 of cases with SG+. For example, if we selected 800 controls and 400 cases with proportions ρ0 = 80% and ρ1 = 60%, this would correspond to 800*50%*80% = 320 E+ SG+ controls, 400*50%*60% = 120 E+ SG+ cases, 800*50%*20% = 80 E+ SG- controls and so on.

Comparing designs

We now consider a series of design options for this example for which we compare power and cost. To meet the constraints on availability and capacity fixed above, the designs considered have numbers of cases ranging from 100 to 600 and numbers of controls from 400 to 1100 in steps of 100, with a maximum of 1200 subjects to be included in Phase Two. For each of these combinations, ρ0 and ρ1 are varied from 40% to 90%. This corresponds to several hundred possible designs for each combination of sensitivity and specificity of SG.

Table 4 shows, for each combination of sensitivity and specificity, the design which achieves the maximal power to detect ORI = 5. Only designs achieving 80% power are shown. For example, if SG has 80% specificity and 70% sensitivity, the design with the highest power would include 400 cases and 800 controls with ρ1 = ρ0 = 90% SG+ (Table 4, line 4). We would, thus, include 90%*400 = 360 SG+ cases and 720 SG+ controls for genotyping. The expected numbers of cases to be screened would be 1889 and the expected number of controls would be 8780.

Table 4 Designs with maximal power of detecting the interaction, according to sensitivity and specificity

Table 5 shows, for each combination of sensitivity and specificity, the design which achieves the minimal cost with 80% power to detect ORI = 5. Using the same example as above, this design would include 300 cases with 80% SG+ and 600 controls with 90% SG+. This would imply screening 1259 cases and 6585 controls and would correspond to a 25% cost decrease compared to the most powerful design (1292 vs. 1733) (Table 5, line 4).

Table 5 Designs with minimum cost among designs with 80% power of detecting the interaction

Note that the better the proxy, the more effective the flexible two-phase approach. For example, for a gene proxy with 70% specificity and 80% sensitivity, the most cost effective design costs 1534 units whereas the most cost effective design for a gene proxy with 90% specificity and 90% sensitivity costs 1082 units.

Comparison with standard case-control studies

For the scenario considered, the most powerful standard case-control study with 1200 genotyped subjects would include 300 cases and 900 controls with an expected var(βI) = 0.96, corresponding to a statistical power of 37%. Achieving 80% power would require var(βI) = 0.33. Thus, for a standard case-control study to attain 80% power, it would require genotyping of 870 cases (i.e. 300 × 0.96/0.33) and 2610 controls (i.e. 900 × 0.96/0.33), totaling a cost of 3480 units. This compares to 1534 units in the most cost-effective flexible two-phase design assuming 70% specificity and 80% sensitivity.

Comparison with balanced two-phase studies

A second comparison of interest would be a comparison with balanced two-phase studies, the design that is generally recommended in papers on two-phase studies (see [1, 2, 12]). As mentioned in the introduction, these studies start from a fixed Phase One sample and draw equal numbers in each stratum for Phase Two data collection. In order to be comparable to our flexible design, we considered a design in which 8000 controls and 2000 cases were assessed in Phase One and 800 controls and 400 cases included in Phase Two. As the design is balanced, we selected equal numbers, i.e., 200 controls and 100 cases from each stratum defined by SG × E.

This balanced Two-Phase design is always less efficient than the Flexible Two-Phase design although more efficient than the standard case-control design. For instance, in the preceding example with 70% specificity and 80% sensitivity, the expected variance is var(βI) = 0.47, corresponding to a statistical power of 65%. The corresponding cost is 1200+(10000:20) = 1700 units.

Discussion

Two-phase studies are efficient compared to standard case-control designs. The variant design presented in this paper improves on some aspects of standard two-phase studies. Specifically, with respect to data collection there is only one time of contact. At a time when studies are struggling with decreasing response rates, collection of all necessary data at a single time of contact may result in improved overall participation rates. Moreover, for rare exposures, minimum numbers of exposed subjects can be guaranteed in this design, thus increasing the power, even compared with standard balanced Two-Phase designs. The disadvantage of the flexible two-phase design compared to other designs, including standard two-phase, is the additional complexity in design planning. Another possible disadvantage is that the categories that are relatively easy to fill will be filled quickly during recruitment, while the hard-to-fill categories will take longer to reach their sampling targets. This can produce complex relationships between covariates and recruitment times. This could be alleviated by the randomized recruitment approach proposed by Weinberg and Sandler [13] in which the most common Phase One category would be included in Phase Two with a given probability, chosen so that all categories are filled in at about the same time.

In the examples presented, we focused on rare exposures for which one could identify inexpensive proxies. Using our proposed heuristic rule, this allows oversampling the rare exposure and thus increasing power. This approach is efficient provided the analysis method used is maximum likelihood, thus, implicitly assuming non-differential misclassification, i.e., that the proxy is not a confounder. In practical terms, this means that the disease risk, given exposure, is the same in all strata. If the disease risk varies across strata, the effect of exposure may have to be assessed separately in each stratum resulting in reduced power to detect the effect of exposure in the underrepresented strata.

One major consideration for the flexible two-phase design is the availability of an adequate proxy for Phase One screening. The proxy must be easily obtained on all screened subjects but must also have high sensitivity and specificity. For a study focused on occupational exposures, as in example 1, a question about working in the industry of interest is easily collected and should yield a reasonable proxy for exposure. This binary stratification for the proxy may be extended to increase sensitivity and specificity. For example, one could ask about duration of work in a particular industry, thereby obtaining a proxy of the actual cumulative dose. Similarly, a positive family history was previously shown [14] to be a good proxy for a rare gene with a strong effect. However, as the effect of the allele decreases and its frequency increases (as would be the situation for a low-risk gene) the sensitivity and specificity for family history decreases. In such situations, an alternative proxy for G may need to be considered, such as age at diagnosis, or a quick inexpensive physiologic test during the in-person interview at Phase One. Of course, the more information obtained at Phase One, the more expensive Phase One becomes.

We acknowledge that a gene-environment interaction odds ratio of 5 may be rather extreme for most diseases, particularly given some recent findings, as in [15]. We are currently working on a more topic-oriented comparison of different study designs for detecting gene-environment interactions using a wider range of scenarios and including the Flexible Two-Phase design and case-only design (under the assumption of independence of Genetic and Environmental factors in the population).

In the present paper, we focused on the estimation of a single odds-ratio. However, dose-response estimation is possible, as long as detailed data are available at Phase Two. Similarly, it is possible to adjust for confounders as long as the relevant data are available in Phase Two. However, since the flexible two-phase design is mostly targeted on predefined hypotheses, especially if one oversamples some strata, there may be limited power to test other hypotheses or perform exploratory analyses. For example, exposure to some aromatic amines increases risk for bladder cancer, but this exposure is rare in the metal industry. Thus, the design we considered would have low power for detecting this risk. Many epidemiologic studies are exploratory in that they assess the effects of a large spectrum of factors without focusing on predefined hypotheses. The Flexible Two-Phase design is not adapted to this situation and focuses necessarily on a restricted number of explicitly stated hypotheses. We are, however, convinced that in many circumstances, only studies with predefined hypotheses will allow progress in understanding disease etiology.

Conclusion

In conclusion, the flexible two-phase design expands the advantages of two-phase designs to substantially increase power for studies of rare disease-exposure combinations. The flexible two-phase design may be the design of choice in well targeted studies of the effect of rare exposures for which inexpensive proxies are available.

Abbreviations

MWF:

metal working fluid

SG:

the surrogate of the gene G considered as a risk factor.

References

  1. Cain KC, Breslow NE: Logistic regression analysis and efficient design for two-stage studies. Am J Epidemiol 1988,128(6):1198–1206.

    CAS  PubMed  Google Scholar 

  2. Breslow NE, Cain KC: Logistic regression for two-stage case-control data. Biometrika 1988, 75:11–20.

    Article  Google Scholar 

  3. White JE: A two stage design for the study of the relationship between a rare exposure and a rare disease. Am J Epidemiol 1982, 115:119–128.

    CAS  PubMed  Google Scholar 

  4. Walker AM: Anamorphic analysis: Sampling and estimation for covariate effect when both exposure and disease are known. Biometrics 1982, 38:1025–32.

    Article  CAS  PubMed  Google Scholar 

  5. Schill W, Drescher K: Logistic analysis of studies with two-stage sampling: a comparison of four approaches. Stat Med 1997, 16:117–32.

    Article  CAS  PubMed  Google Scholar 

  6. Pohlabeln H, Wild P, Schill W, Ahrens W, Jahn I, Bolm-Audorff U, Jöckel KH: Asbestos fibreyears and lung cancer: a two phase case-control study with expert exposure assessment. Occup Environ Med 2002, 59:410–4.

    Article  CAS  PubMed  Google Scholar 

  7. Reilly M: Optimal sampling strategies for two-stage studies. Am J Epidemiol 1996, 143:92–100.

    CAS  PubMed  Google Scholar 

  8. McNamee R: Optimal design and efficiency of two-phase case-control studies with error-prone and error-free exposure measures. Biostatistics 2005, 6:590–603.

    Article  CAS  PubMed  Google Scholar 

  9. Schill W, Wild P: Minmax designs for planning the second Phase of a two-phase case-control study. Stat Med 2006, 25:1646–59.

    Article  CAS  PubMed  Google Scholar 

  10. Schill W, Wild P: Re: "flexible matching strategies to increase power and efficiency to detect and estimate gene-environment interactions in case-control studies". Am J Epidemiol 2004, 159:1107–8.

    Article  PubMed  Google Scholar 

  11. Calvert GM, Ward E, Schnorr TM, et al.: Cancer risks among workers exposed to metalworking fluids: a systematic review. Am J Ind Med 1998, 33:282–92.

    Article  CAS  PubMed  Google Scholar 

  12. Breslow NE, Chatterjee N: Design and analysis of two-phase studies with binary outcome applied to Wilms tumour prognosis. Applied Statistics 1999, 48:457–468.

    Google Scholar 

  13. Weinberg CR, Sandler DP: Randomized recruitment in case-control studies. Am J Epidemiol 1991, 134:421–32.

    CAS  PubMed  Google Scholar 

  14. Andrieu N, Goldstein AM, Thomas DC, Langholz B: Counter-matching in studies of gene-environment interaction: efficiency and feasibility. Am J Epidemiol 2001, 153:265–74.

    Article  CAS  PubMed  Google Scholar 

  15. He C, Tamimi RM, Hankinson SE, Hunter DJ, Han J: A prospective study of genetic polymorphism in MPO, antioxidant status, and breast cancer risk. Breast Cancer Res Treat 2008, in press. 2008 Mar 14

Download references

Acknowledgements

This work was funded by the National Cancer Institute, NIH (Intramural Research Program to A.G.) and the Deutsche Forschungsgemeinschaft (PI 345/1–2 to W.S.)

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pascal Wild.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

The idea of this new method originated from discussions between PW and WS. PW wrote the first draft, carried out the computations and prepared the tables and figure. NA and AMG contributed the gene-environment example and parts of the discussion. All authors participated substantially in the writing of the submitted manuscript and approved the submitted version.

Electronic supplementary material

1742-5573-5-4-S1.txt

Additional file 1: This is a text file containing the code of the Stata statistical software (StataCorp. 2007; Stata Statistical Software: Release 9 and onwards. College Station, TX: StataCorp LP.) for fitting two-phase data. It can be accessed using any text processor but can only be executed within Stata. It should be saved under the name blogit_2P.ado. (TXT 10 KB)

1742-5573-5-4-S2.txt

Additional file 2: This is a help file describing the preceding program and its options. In can only be displayed as a help file from within Stata. It should be saved under the name blogit_2P.hlp. (TXT 3 KB)

1742-5573-5-4-S3.txt

Additional file 3: This is a text file containing the code of the Stata statistical software for performing the power computation for Example 1 using the above program and performing the computations shown in figure 1. In reads in the data in the data file MWF.raw included as Additional file 4. It can be accessed using any text processor but can only be executed within Stata. It should be saved under the name figure1.do. (TXT 1 KB)

1742-5573-5-4-S4.txt

Additional file 4: This is text file containing the data obtained by performing the computations shown in Appendix 2. It is used by the Stata program figure1.do included as Additional file 3. It should be saved under the name mwf.raw. (TXT 197 bytes)

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Wild, P., Andrieu, N., Goldstein, A.M. et al. Flexible Two-Phase studies for rare exposures: Feasibility, planning and efficiency issues of a new variant. Epidemiol Perspect Innov 5, 4 (2008). https://doi.org/10.1186/1742-5573-5-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1742-5573-5-4