IDEAS home Printed from https://ideas.repec.org/p/bca/bocatr/114.html
   My bibliography  Save this paper

2017 Methods-of-Payment Survey: Sample Calibration and Variance Estimation

Author

Listed:
  • Heng Chen
  • Marie-Hélène Felt
  • Christopher Henry

Abstract

This technical report describes sampling, weighting and variance estimation for the Bank of Canada’s 2017 Methods-of-Payment Survey. Under quota sampling, a raking ratio method is implemented to generate weights with both post-stratification and nonparametric nonresponse weight adjustments. In the end, we estimate variances of weighted means and proportions using bootstrap replicate survey weights. Compared with probability sampling, we find that (i) strong assumptions are required to reduce bias when probabilities of selection are unknown, and (ii) multiple weight adjustments for bias reduction inflate variance. Therefore, it is important to focus more on bias than on variance in the context of nonprobability sampling.

Suggested Citation

  • Heng Chen & Marie-Hélène Felt & Christopher Henry, 2018. "2017 Methods-of-Payment Survey: Sample Calibration and Variance Estimation," Technical Reports 114, Bank of Canada.
  • Handle: RePEc:bca:bocatr:114
    as

    Download full text from publisher

    File URL: https://www.bankofcanada.ca/wp-content/uploads/2018/12/tr114.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David Haziza & Jean‐François Beaumont, 2007. "On the Construction of Imputation Classes in Surveys," International Statistical Review, International Statistical Institute, vol. 75(1), pages 25-43, April.
    2. Judith K. Hellerstein & Guido W. Imbens, 1999. "Imposing Moment Restrictions From Auxiliary Data By Weighting," The Review of Economics and Statistics, MIT Press, vol. 81(1), pages 1-14, February.
    3. Bryan S. Graham, 2011. "Efficiency Bounds for Missing Data Models With Semiparametric Restrictions," Econometrica, Econometric Society, vol. 79(2), pages 437-452, March.
    4. Carlos Arango & Angelika Welte, 2012. "The Bank of Canada’s 2009 Methods-of-Payment Survey: Methodology and Key Results," Discussion Papers 12-6, Bank of Canada.
    5. Heng Chen & Marie-Hélène Felt & Kim P. Huynh, 2017. "Retail payment innovations and cash usage: accounting for attrition by using refreshment samples," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(2), pages 503-530, February.
    6. Christopher Henry & Kim Huynh & Rallye Shen, 2015. "2013 Methods-of-Payment Survey Results," Discussion Papers 15-4, Bank of Canada.
    7. Kyle Vincent, 2015. "2013 Methods-of-Payment Survey: Sample Calibration Analysis," Technical Reports 103, Bank of Canada.
    8. Heng Chen & Q. Rallye Shen, 2019. "Variance Estimation for Survey-Weighted Data Using Bootstrap Resampling Methods: 2013 Methods-of-Payment Survey Questionnaire," Advances in Econometrics, in: The Econometrics of Complex Survey Data, volume 39, pages 87-106, Emerald Group Publishing Limited.
    9. Heng Chen & Geoffrey Dunbar & Q. Rallye Shen, 2020. "The Mode is the Message: Using Predata as Exclusion Restrictions to Evaluate Survey Design," Advances in Econometrics, in: Essays in Honor of Cheng Hsiao, volume 41, pages 341-357, Emerald Group Publishing Limited.
    10. Heng Chen & Q. Rallye Shen, 2017. "Variance estimation for survey-weighted data using bootstrap resampling methods: 2013 methods-of-payment," Canadian Stata Users' Group Meetings 2017 13, Stata Users Group.
    11. Wang, Wei & Rothschild, David & Goel, Sharad & Gelman, Andrew, 2015. "Forecasting elections with non-representative polls," International Journal of Forecasting, Elsevier, vol. 31(3), pages 980-991.
    12. Heejung Bang & James M. Robins, 2005. "Doubly Robust Estimation in Missing Data and Causal Inference Models," Biometrics, The International Biometric Society, vol. 61(4), pages 962-973, December.
    13. Christopher Henry & Kim Huynh & Angelika Welte, 2018. "2017 Methods-of-Payment Survey Report," Discussion Papers 18-17, Bank of Canada.
    14. Stanislav Kolenikov, 2014. "Calibrating survey data using iterative proportional fitting (raking)," Stata Journal, StataCorp LP, vol. 14(1), pages 22-59, March.
    15. Nevo, Aviv, 2002. "Sample selection and information-theoretic alternatives to GMM," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 149-157, March.
    16. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marie-Hélène Felt & Fumiko Hayashi & Joanna Stavins & Angelika Welte, 2020. "Distributional Effects of Payment Card Pricing and Merchant Cost Pass-through in the United States and Canada," Working Papers 20-13, Federal Reserve Bank of Boston.
    2. Heng Chen & Walter Engert & Marie-Hélène Felt & Kim P. Huynh & Gradon Nicholls & Daneal O'Habib & Julia Zhu, 2021. "Cash and COVID-19: The impact of the second wave in Canada," Discussion Papers 2021-12, Bank of Canada.
    3. Marie-Hélène Felt & Fumiko Hayashi & Joanna Stavins & Angelika Welte, 2021. "Distributional Effects of Payment Card Pricing and Merchant Cost Pass-through in Canada and the United States," Staff Working Papers 21-8, Bank of Canada.
    4. Christopher Henry & Doina Rusu & Matthew Shimoda, 2024. "2022 Methods-of-Payment Survey Report: Cash Use Over 13 Years," Discussion Papers 2024-01, Bank of Canada.
    5. Heng Chen & Walter Engert & Kim Huynh & Gradon Nicholls & Mitchell Nicholson & Julia Zhu, 2020. "Cash and COVID-19: The impact of the pandemic on demand for and use of cash," Discussion Papers 2020-6, Bank of Canada.
    6. Walter Engert & Kim Huynh, 2022. "Cash, COVID-19 and the Prospects for a Canadian Digital Dollar," Discussion Papers 2022-17, Bank of Canada.
    7. Christopher Henry & Kim Huynh & Gradon Nicholls & Mitchell Nicholson, 2019. "2018 Bitcoin Omnibus Survey: Awareness and Usage," Discussion Papers 2019-10, Bank of Canada.
    8. Christopher Henry & Matthew Shimoda & Julia Zhu, 2022. "2021 Methods-of-Payment Survey Report," Discussion Papers 2022-23, Bank of Canada.
    9. Marie-Hélène Felt & David Laferrière, 2020. "Sample Calibration of the Online CFM Survey," Technical Reports 118, Bank of Canada.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Heng Chen & Walter Engert & Kim Huynh & Gradon Nicholls & Julia Zhu, 2021. "Cash and COVID-19: The Effects of Lifting Containment Measures on Cash Demand and Use," Discussion Papers 2021-3, Bank of Canada.
    2. Marie-Hélène Felt & David Laferrière, 2020. "Sample Calibration of the Online CFM Survey," Technical Reports 118, Bank of Canada.
    3. Heng Chen & Walter Engert & Marie-Hélène Felt & Kim P. Huynh & Gradon Nicholls & Daneal O'Habib & Julia Zhu, 2021. "Cash and COVID-19: The impact of the second wave in Canada," Discussion Papers 2021-12, Bank of Canada.
    4. Henry, Christopher S. & Huynh, Kim P. & Nicholls, Gradon, 2018. "Bitcoin awareness and usage in Canada," Journal of Digital Banking, Henry Stewart Publications, vol. 2(4), pages 311-337, May.
    5. Kim Huynh & Jozsef Molnar & Oleksandr Shcherbakov & Qinghui Yu, 2020. "Demand for Payment Services and Consumer Welfare: The Introduction of a Central Bank Digital Currency," Staff Working Papers 20-7, Bank of Canada.
    6. Christopher Henry & Kim Huynh & Gradon Nicholls, 2017. "Bitcoin Awareness and Usage in Canada," Staff Working Papers 17-56, Bank of Canada.
    7. Christopher Henry & Kim Huynh & Gradon Nicholls & Mitchell Nicholson, 2019. "2018 Bitcoin Omnibus Survey: Awareness and Usage," Discussion Papers 2019-10, Bank of Canada.
    8. Bryan S. Graham & Cristine Campos De Xavier Pinto & Daniel Egel, 2012. "Inverse Probability Tilting for Moment Condition Models with Missing Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 1053-1079.
    9. Anneke Kosse & Zhentong Lu & Gabriel Xerri, 2020. "An Economic Perspective on Payments Migration," Staff Working Papers 20-24, Bank of Canada.
    10. Marie-Hélène Felt, 2018. "A Look Inside the Box: Combining Aggregate and Marginal Distributions to Identify Joint Distributions," Staff Working Papers 18-29, Bank of Canada.
    11. Heng Chen & Marie-Hélène Felt & Kim P. Huynh, 2017. "Retail payment innovations and cash usage: accounting for attrition by using refreshment samples," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(2), pages 503-530, February.
    12. Ruoxuan Xiong & Allison Koenecke & Michael Powell & Zhu Shen & Joshua T. Vogelstein & Susan Athey, 2021. "Federated Causal Inference in Heterogeneous Observational Data," Papers 2107.11732, arXiv.org, revised Apr 2023.
    13. Kim Huynh & Gradon Nicholls & Oleksandr Shcherbakov, 2019. "Explaining the Interplay Between Merchant Acceptance and Consumer Adoption in Two-Sided Markets for Payment Methods," Staff Working Papers 19-32, Bank of Canada.
    14. Valéry Dongmo Jiongo & Pierre Nguimkeu, 2018. "Bootstrapping Mean Squared Errors of Robust Small-Area Estimators: Application to the Method-of-Payments Data," Staff Working Papers 18-28, Bank of Canada.
    15. Satoshi Hattori & Masayuki Henmi, 2014. "Stratified doubly robust estimators for the average causal effect," Biometrics, The International Biometric Society, vol. 70(2), pages 270-277, June.
    16. Fan Li & Ashley L. Buchanan & Stephen R. Cole, 2022. "Generalizing trial evidence to target populations in non‐nested designs: Applications to AIDS clinical trials," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(3), pages 669-697, June.
    17. Prokhorov, Artem & Schmidt, Peter, 2009. "GMM redundancy results for general missing data problems," Journal of Econometrics, Elsevier, vol. 151(1), pages 47-55, July.
    18. Graham, Bryan S. & Pinto, Cristine Campos de Xavier, 2022. "Semiparametrically efficient estimation of the average linear regression function," Journal of Econometrics, Elsevier, vol. 226(1), pages 115-138.
    19. Jiafeng Chen & David M. Ritzwoller, 2021. "Semiparametric Estimation of Long-Term Treatment Effects," Papers 2107.14405, arXiv.org, revised Aug 2023.
    20. Fung, Ben & Huynh, Kim P. & Nield, Kerry & Welte, Angelika, 2018. "Merchant acceptance of cash and credit cards at the point of sale," Journal of Payments Strategy & Systems, Henry Stewart Publications, vol. 12(2), pages 150-165, July.

    More about this item

    Keywords

    Econometric and statistical methods;

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bca:bocatr:114. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bocgvca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.