Skip to main content
Log in

Comparison of stepwise covariate model building strategies in population pharmacokinetic-pharmacodynamic analysis

  • Published:
AAPS PharmSci Aims and scope Submit manuscript

Abstract

The aim of this study was to compare 2 stepwise covariate model-building strategies, frequently used in the analysis of pharmacokinetic-pharmacodynamic (PK-PD) data using nonlinear mixed-effects models, with respect to included covariates and predictive performance. In addition, the effects of stepwise regression on the estimated covariate coefficients wise regression on the estimated covariate coefficients were assessed. Using simulated and real PK data, covariate models were built applying (1) stepwise generalized additive models (GAM) for identifying potential covariates, followed by backward elimination in the computer program NONMEM, and (2) stepwise forward inclusion and backward elimination in NONMEM. Different versions of these procedures were tried (eg, treating different study occasions as separate individuals in the GAM, or fixing a part of the parameters when the NONMEM procedure was used). The final covariate models were compared, including their ability to predict a separate data set or their performance in cross-validation. The bias in the estimated coefficients (selection bias) was assessed. The model-building procedures performed similarly in the data sets explored. No major differences in the resulting covariate models were seen, and the predictive performances overlapped. Therefore, the choice of model-building procedure in these examples could be based on other aspects such as analyst-and computer-time efficiency. There was a tendency to selection bias in the estimates, although this was small relative to the overall variability in the estimates. The predictive performances of the stepwise models were also reasonably good. Thus, selection bias seems to be a minor problem in this typical PK covariate analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Beal SL, Sheiner LB. NONMEM Users Guides. San Francisco, CA: University of California; 1992.

    Google Scholar 

  2. Maitre PO, Buhrer M, Thomson D, Stanski DR. A three-step approach combining Bayesian regression and NONMEM population analysis: application to midazolam. J Pharmacokinet Biopharm. 1991;19(4):377–384.

    Article  CAS  PubMed  Google Scholar 

  3. Mandema JW, Verotta D, Sheiner LB. Building population pharmacokinetic-pharmacodynamic models. I. Models for covariate effects. J Pharmacokin Biopharm 1992;20(5):511–528.

    Article  CAS  Google Scholar 

  4. Gallo JM, Laub PB, Rowinsky EK, Grochow LB, Baker SD. Population pharmacokinetic model for topotecan derived from phase I clinical trials. J Clin Oncol. 2000;18(12):2459–2467.

    CAS  PubMed  Google Scholar 

  5. Troconiz IF, Armenteros S, Planelles MV, Benitez J, Calvo R, Dominguez R. Pharmacokinetic-Pharmacodynamic Modelling of the antipyretic effect of two oral formulations of ibuprofen. Clin Pharmacokinet. 2000;38(6):505–518.

    Article  CAS  PubMed  Google Scholar 

  6. Takama H, Tanaka H, Sudo T, Tamura T, Tanigawara Y. Population pharmacokinetic modeling and model validation of a spicamycin derivative, KRN5500, in phase 1 study. Cancer Chemother Pharmacol. 2001;47(5):404–410.

    Article  CAS  PubMed  Google Scholar 

  7. du Preez MJ, Botha JH, McFadyen ML, Holford NH. The pharmacokinetics of theophylline in premature neonates during the first few days after birth. Ther Drug Monit. 1992;21(6):598–603.

    Article  Google Scholar 

  8. Zhou XJ, Sheiner LB, D'Aquila RT, et al. Population pharmacokinetics of nevirapine, zidovudine, and didanosine in human immunodeficiency virus-infected patients. The National Institute of Allergy and Infectious Diseases AIDS Clinical Trials Group Protocol 241 Investigators. Antimicrob Agents Chemother. 1999;43(1):121–128.

    CAS  PubMed  PubMed Central  Google Scholar 

  9. Zhou H, Chen TL, Marino M, et al. Population PK and PK/PD modelling of microencapsulated octreotide acetate in healthy subjects. Br J Clin Pharmacol. 2000;50(6):543–552.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Gwilt P, Tempero M, Kremer A, Connolly M, Ding C. Pharmacokinetics of levamisole in cancer patients treated with 5- fluorouracil. Cancer Chemother Pharmacol. 2000;45(3):247–251.

    Article  CAS  PubMed  Google Scholar 

  11. Gidal BE, Anderson GD, Rutecki PR, Shaw R, Lanning A. Lack of an effect of valproate concentration on lamotrigine pharmacokinetics in developmentally disabled patients with epilepsy. Epilepsy Res. 2000;42(1):23–31.

    Article  CAS  PubMed  Google Scholar 

  12. Ouellet D, Periclou AP, Johnson RD, Woodworth JR, Lalonde RL. Population pharmacokinetics of pemetrexed disodium (ALIMTA) in patients with cancer. Cancer Chemother Pharmacol. 2000;46(3):227–234.

    Article  CAS  PubMed  Google Scholar 

  13. Freyer G, Tranchand B, Ligneau B, et al. Population pharmacokinetics of doxorubicin, etoposide and ifosfamide in small cell lung cancer patients: results of a multicentre study. Br J Clin Pharmacol. October 2000;50(4):315–324.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Jonsson EN, Karlsson MO. Xpose-an S-PLUS based population pharmacokinetic/pharmacodynamic model building aid for NONMEM. Comput Methods Programs Biomed. 1999;58(1):51–64.

    Article  CAS  PubMed  Google Scholar 

  15. Jonsson EN, Karlsson MO. Automated covariate model building within NONMEM. Pharm. Res. 1998;15(9):1463–1468.

    Article  CAS  PubMed  Google Scholar 

  16. Miller AJ. Subset Selection in Regression Vol 40. 1st ed. London, UK: Chapman & Hall; 1990.

    Book  Google Scholar 

  17. Steyerberg EW, Eijkemans MJ, Habbema JD. Stepwise selection in small data sets: a simulation study of bias in logistic regression analysis. J Clin Epidemiol. October 1999;52(10):935–942.

    Article  CAS  PubMed  Google Scholar 

  18. Vach K, Sauerbrei W, Schumacher M. Variable selection and shrinkage: comparison of some approaches. Statistica Neerlandica. 2001;55(1):53–75.

    Article  Google Scholar 

  19. Harrell FE. Regression Modeling Strategies. New York, NY: Springer; 2001.

    Book  Google Scholar 

  20. Derksen S, Keselman HJ. Backward, forward and stepwise automated subset selection algorithms: Frequency of obtaining authentic and noise variables. Br J of Math Stat Psychol. 1992;45:265–282.

    Article  Google Scholar 

  21. Harrell FE, Jr., Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361–387.

    Article  PubMed  Google Scholar 

  22. Steyerberg EW, Eijkemans MJ, Harrell FE, Jr., Habbema JD. Prognostic modelling with logistic regression analysis: a comparison of selection and estimation methods in small data sets. Stat Med. 2000;19(8):1059–1079.

    Article  CAS  PubMed  Google Scholar 

  23. Bruno R, Iliadis MC, Lacarelle B, et al. Evaluation of Bayesian estimation in comparison to NONMEM for population pharmacokinetic data analysis: application to pefloxacin in intensive care unit patients. J Pharmacokinet Biopharm. 1992;20(6):653–669.

    Article  CAS  PubMed  Google Scholar 

  24. Karlsson MO, Sheiner LB. The importance of modeling interoccasion variability in population pharmacokinetic analyses. J Pharmacokinet Biopharm. 1993;21(6):735–750.

    Article  CAS  PubMed  Google Scholar 

  25. Vozeh S, Maitre PO, Stanski DR. Evaluation of population (NONMEM) pharmacokinetic parameter estimates. J Pharmacokinet Biopharm. 1990;18(2):161–173.

    Article  CAS  PubMed  Google Scholar 

  26. Wahlby U, Jonsson EN, Karlsson MO. Assessment of actual significance levels for covariate effects in NONMEM. J Pharmacokinet Pharmacodyn. 2001;28(3):231–252.

    Article  CAS  PubMed  Google Scholar 

  27. Wakefield J, Bennett J. The Bayesian Modeling of Covariates for Population Pharmacokinetic Models. J Am Stat Assoc. 1996;91:917–927.

    Article  Google Scholar 

  28. Kowalski KG, Hutmacher MM. Efficient screening of covariates in population models using Wald's approximation to the likelihood ratio test. J Pharmacokinet Pharmacodyn. 2001;28(3):253–275.

    Article  CAS  PubMed  Google Scholar 

  29. Bonate PL. The effect of collinearity on parameter estimates in nonlinear mixed effect models. Pharm Res. 1999;16(5):709–717.

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ulrika Wählby.

Additional information

Published: October 7, 2002

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wählby, U., Jonsson, E.N. & Karlsson, M.O. Comparison of stepwise covariate model building strategies in population pharmacokinetic-pharmacodynamic analysis. AAPS J 4, 27 (2002). https://doi.org/10.1208/ps040427

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1208/ps040427

Keywords

Navigation