IDEAS home Printed from https://ideas.repec.org/p/bca/bocawp/25-17.html

Correcting Selection Bias in a Non-Probability Two-Phase Payment Survey

Author

Listed:
  • Heng Chen
  • John Tsang

Abstract

We develop statistical inferences for a non-probability two-phase survey sample when relevant auxiliary information is available from a probability survey sample. To reduce selection bias and gain efficiency, both selection probabilities of Phase 1 and Phase 2 are estimated, and two-phase calibration is implemented. We discuss both analytical plug-in and pseudo-population bootstrap variance estimation methods that account for the effects of using estimated selection probabilities and calibrated weights. The proposed method is assessed by simulation studies and used to analyze a non-probability two phase payment survey.

Suggested Citation

  • Heng Chen & John Tsang, 2025. "Correcting Selection Bias in a Non-Probability Two-Phase Payment Survey," Staff Working Papers 25-17, Bank of Canada.
    • Handle: RePEc:bca:bocawp:25-17
    DOI: 10.34989/swp-2025-17
    as

    Download full text from publisher

    File URL: https://doi.org/10.34989/swp-2025-17
    File Function: Abstract
    Download Restriction: no
    File URL: https://www.bankofcanada.ca/wp-content/uploads/2025/06/swp2025-17.pdf
    File Function: Full text
    Download Restriction: no
    File URL: https://libkey.io/10.34989/swp-2025-17?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hartman, Erin & Huang, Melody, 2024. "Sensitivity Analysis for Survey Weights," Political Analysis, Cambridge University Press, vol. 32(1), pages 1-16, January.
    2. Zhonglei Wang & Liuhua Peng & Jae Kwang Kim, 2022. "Bootstrap inference for the finite population mean under complex sampling designs," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(4), pages 1150-1174, September.
    3. Angelika Welte & Joy Wu, 2023. "The 2021–22 Merchant Acceptance Survey Pilot Study," Discussion Papers 2023-1, Bank of Canada.
    4. David Haziza & Jean‐François Beaumont, 2007. "On the Construction of Imputation Classes in Surveys," International Statistical Review, International Statistical Institute, vol. 75(1), pages 25-43, April.
    5. Jae Kwang Kim & Seho Park & Yilin Chen & Changbao Wu, 2021. "Combining non‐probability and probability survey samples through mass imputation," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(3), pages 941-963, July.
    6. Heng Chen & Walter Engert & Marie-Hélène Felt & Kim P. Huynh & Gradon Nicholls & Daneal O'Habib & Julia Zhu, 2021. "Cash and COVID-19: The impact of the second wave in Canada," Discussion Papers 2021-12, Bank of Canada.
    7. Yilin Chen & Pengfei Li & Changbao Wu, 2020. "Doubly Robust Inference With Nonprobability Survey Samples," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(532), pages 2011-2021, December.
    8. Jean‐François Beaumont & Zdenek Patak, 2012. "On the Generalized Bootstrap for Sample Surveys with Special Attention to Poisson Sampling," International Statistical Review, International Statistical Institute, vol. 80(1), pages 127-148, April.
    9. Kim, Jae Kwang & Navarro, Alfredo & Fuller, Wayne A., 2006. "Replication Variance Estimation for Two-Phase Stratified Sampling," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 312-320, March.
    10. Nevo, Aviv, 2003. "Using Weights to Adjust for Sample Selection When Auxiliary Information Is Available," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(1), pages 43-52, January.
    11. S Chen & D Haziza & C Léger & Z Mashreghi, 2019. "Pseudo-population bootstrap methods for imputed survey data," Biometrika, Biometrika Trust, vol. 106(2), pages 369-384.
    12. Christopher Henry & Matthew Shimoda & Julia Zhu, 2022. "2021 Methods-of-Payment Survey Report," Discussion Papers 2022-23, Bank of Canada.
    13. Martin Huber, 2014. "Treatment Evaluation in the Presence of Sample Selection," Econometric Reviews, Taylor & Francis Journals, vol. 33(8), pages 869-905, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tillé, Yves, 2025. "A simple bootstrap method for large entropy unequal probability sampling designs," Statistics & Probability Letters, Elsevier, vol. 224(C).
    2. Felt, Marie-Hélène & Hayashi, Fumiko & Stavins, Joanna & Welte, Angelika, 2023. "Regressive effects of payment card pricing and merchant cost pass-through in the United States and Canada," Journal of Banking & Finance, Elsevier, vol. 154(C).
    3. Sixia Chen & Alexandra May Woodruff & Janis Campbell & Sara Vesely & Zheng Xu & Cuyler Snider, 2023. "Combining Probability and Nonprobability Samples by Using Multivariate Mass Imputation Approaches with Application to Biomedical Research," Stats, MDPI, vol. 6(2), pages 1-9, May.
    4. Ieva Burakauskaitė & Andrius Čiginas, 2023. "An Approach to Integrating a Non-Probability Sample in the Population Census," Mathematics, MDPI, vol. 11(8), pages 1-14, April.
    5. Beaumont, Jean-François & Charest, Anne-Sophie, 2012. "Bootstrap variance estimation with survey data when estimating model parameters," Computational Statistics & Data Analysis, Elsevier, vol. 56(12), pages 4450-4461.
    6. Marius Stefan & Michael A. Hidiroglou, 2023. "A Bootstrap Variance Procedure for the Generalised Regression Estimator," International Statistical Review, International Statistical Institute, vol. 91(2), pages 294-317, August.
    7. Chien-Min Huang & F. Jay Breidt, 2023. "A dual-frame approach for estimation with respondent-driven samples," METRON, Springer;Sapienza Università di Roma, vol. 81(1), pages 65-81, April.
    8. Zhonglei Wang & Liuhua Peng & Jae Kwang Kim, 2022. "Bootstrap inference for the finite population mean under complex sampling designs," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(4), pages 1150-1174, September.
    9. Xiaojun Mao & Zhonglei Wang & Shu Yang, 2023. "Matrix completion under complex survey sampling," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(3), pages 463-492, June.
    10. Vladimir Hlasny & Lidia Ceriani & Paolo Verme, 2022. "Bottom Incomes and the Measurement of Poverty and Inequality," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 68(4), pages 970-1006, December.
    11. Natalia Golini & Paolo Righi, 2024. "Integrating probability and big non-probability samples data to produce Official Statistics," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 33(2), pages 555-580, April.
    12. Marie-Hélène Felt & David Laferrière, 2020. "Sample Calibration of the Online CFM Survey," Technical Reports 118, Bank of Canada.
    13. Pier Luigi Conti & Fulvia Mecatti, 2022. "Resampling under Complex Sampling Designs: Roots, Development and the Way Forward," Stats, MDPI, vol. 5(1), pages 1-12, March.
    14. Gerry H. Makepeace & Michael J. Peel, 2013. "Combining information from Heckman and matching estimators: testing and controlling for hidden bias," Economics Bulletin, AccessEcon, vol. 33(3), pages 2422-2436.
    15. Igari, Ryosuke & Hoshino, Takahiro, 2018. "A Bayesian data combination approach for repeated durations under unobserved missing indicators: Application to interpurchase-timing in marketing," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 150-166.
    16. Erika Antal & Yves Tillé, 2014. "A new resampling method for sampling designs without replacement: the doubled half bootstrap," Computational Statistics, Springer, vol. 29(5), pages 1345-1363, October.
    17. Heng Chen & Joy Wu, 2025. "Low Response Rate from Merchants? Sample and Ask Consumers! An Application of Indirect Sampling Under a Consumer-Merchant Bipartite Network," Technical Reports 126, Bank of Canada.
    18. Takahiro Hoshino & Yuya Shimizu, 2019. "Doubly Robust-type Estimation of Population Moments and Parameters in Biased Sampling," Keio-IES Discussion Paper Series 2019-006, Institute for Economics Studies, Keio University.
    19. Takeshima, Hiroyuki & Hatzenbuehler, Patrick L. & Edeh, Hyacinth O., 2020. "Effects of agricultural mechanization on economies of scope in crop production in Nigeria," Agricultural Systems, Elsevier, vol. 177(C).
    20. Luis Castro-Martín & María del Mar Rueda & Ramón Ferri-García & César Hernando-Tamayo, 2021. "On the Use of Gradient Boosting Methods to Improve the Estimation with Data Obtained with Self-Selection Procedures," Mathematics, MDPI, vol. 9(23), pages 1-23, November.

    More about this item

    Keywords

    ;
    ;

    JEL classification:

    • C - Mathematical and Quantitative Methods
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bca:bocawp:25-17. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bocgvca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.