IDEAS home Printed from https://ideas.repec.org/a/bla/jconsa/v48y2014i3p603-619.html
   My bibliography  Save this article

Complex Samples and Regression-Based Inference: Considerations for Consumer Researchers

Author

Listed:
  • ROBERT B. NIELSEN
  • MARTIN C. SEAY

Abstract

type="main" xml:id="joca12038-abs-0001"> This article demonstrates that researchers who treat data collected via complex sampling procedures as if they were collected via simple random sample (SRS) may draw improper inferences when estimating regression models. Using complex sample data from the 2004 panel of the Survey of Income and Program Participation (SIPP) two models—one ordinary least squares (OLS) regression and one logistic regression—were estimated using three methods: SRS with and without population weights, Taylor series linearization, and Fay's Balanced Repeated Replication (BRR). The results of the alternative models demonstrate that depending on the variables of interest, authors who fail to incorporate sample design information or fail to consider the effects of weighting may draw improper inferences from their regression models. Reasons why researchers continue to neglect complex sample-based variance are proposed and discussed, and example SAS and Stata code is offered to encourage adoption by the consumer research community.

Suggested Citation

  • Robert B. Nielsen & Martin C. Seay, 2014. "Complex Samples and Regression-Based Inference: Considerations for Consumer Researchers," Journal of Consumer Affairs, Wiley Blackwell, vol. 48(3), pages 603-619, October.
    • Handle: RePEc:bla:jconsa:v:48:y:2014:i:3:p:603-619
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/joca.12038
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jay M. Ver Hoef, 2012. "Who Invented the Delta Method?," The American Statistician, Taylor & Francis Journals, vol. 66(2), pages 124-127, May.
    2. Alastair Scott & Chris Wild, 2002. "On the robustness of weighted methods for fitting models to case–control data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(2), pages 207-219, May.
    3. Christopher Tamborini & Howard Iams & Gayle Reznik, 2012. "Women’s Earnings Before and After Marital Dissolution: Evidence from Longitudinal Earnings Records Matched to Survey Data," Journal of Family and Economic Issues, Springer, vol. 33(1), pages 69-82, March.
    4. Alisha Coleman-Jensen, 2011. "Working for Peanuts: Nonstandard Work and Food Insecurity Across Household Structure," Journal of Family and Economic Issues, Springer, vol. 32(1), pages 84-97, March.
    5. Cynthia Sanders & Shirley Porterfield, 2010. "The Ownership Society and Women: Exploring Female Householders’ Ability to Accumulate Assets," Journal of Family and Economic Issues, Springer, vol. 31(1), pages 90-106, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Craig Gundersen & David R. Just & Fei Men, 2017. "Mothers' Within-Marriage Economic Prospects and Later Food Security: Does Marital Outcome Matter?," Journal of Consumer Affairs, Wiley Blackwell, vol. 51(3), pages 682-702, November.
    2. Su Hyun Shin & Sherman D. Hanna, 2017. "Accounting for Complex Sample Designs in Analyses of the Survey of Consumer Finances," Journal of Consumer Affairs, Wiley Blackwell, vol. 51(2), pages 433-447, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vanessa Hunn & Claudia Heath, 2011. "Path Analysis of Welfare Use: Depression as a Mediating Factor," Journal of Family and Economic Issues, Springer, vol. 32(2), pages 341-355, June.
    2. Marcela Ibanez & Sebastian O. Schneider, 2023. "Income Risk, Precautionary Saving, and Loss Aversion – An Empirical Test," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2023_06, Max Planck Institute for Research on Collective Goods.
    3. Peter L. Boveng & Jay M. Ver Hoef & David E. Withrow & Josh M. London, 2018. "A Bayesian Analysis of Abundance, Trend, and Population Viability for Harbor Seals in Iliamna Lake, Alaska," Risk Analysis, John Wiley & Sons, vol. 38(9), pages 1988-2009, September.
    4. Aurélien Saussay & Misato Sato, 2018. "The Impacts of Energy Prices on Industrial Foreign Investment Location: Evidence from Global Firm Level Data," SciencePo Working papers Main hal-03475473, HAL.
    5. Aurélien Saussay, 2019. "Dynamic heterogeneity: rational habits and the heterogeneity of household responses to gasoline prices," SciencePo Working papers Main hal-03632598, HAL.
    6. Christina Robinson, 2013. "Younger Siblings Can Be Good for Your Health: An Examination of Spillover Benefits from the Supplemental Nutrition Program for Women, Infants, and Children (WIC)," Journal of Family and Economic Issues, Springer, vol. 34(2), pages 172-184, June.
    7. Dennis D. Boos & Jason A. Osborne, 2015. "Assessing Variability of Complex Descriptive Statistics in Monte Carlo Studies Using Resampling Methods," International Statistical Review, International Statistical Institute, vol. 83(2), pages 228-238, August.
    8. Tansel Yilmazer & Angela Lyons, 2010. "Marriage and the Allocation of Assets in Women’s Defined Contribution Plans," Journal of Family and Economic Issues, Springer, vol. 31(2), pages 121-137, June.
    9. Jennifer Kohn & Susan Averett, 2014. "Can’t We Just Live Together? New Evidence on the Effect of Relationship Status on Health," Journal of Family and Economic Issues, Springer, vol. 35(3), pages 295-312, September.
    10. Brandeanna Allen & John Nunley & Alan Seals, 2011. "The Effect of Joint-Child-Custody Legislation on the Child-Support Receipt of Single Mothers," Journal of Family and Economic Issues, Springer, vol. 32(1), pages 124-139, March.
    11. Jason Scott Seligman, 2012. "Evidence on the Financial Capability of Elder Workers Facing Lump-Sum Retirement Plan Distributions," Accounting and Finance Research, Sciedu Press, vol. 1(2), pages 177-177, November.
    12. Charles Courtemanche & Art Carden & Xilin Zhou & Murugi Ndirangu, 2019. "Do Walmart Supercenters Improve Food Security?," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 41(2), pages 177-198, June.
    13. Swann, Christopher A., 2017. "Household history, SNAP participation, and food insecurity," Food Policy, Elsevier, vol. 73(C), pages 1-9.
    14. Trisha Chanda, 2023. "Economic Wellbeing and Labor Supply Patterns of Subsequently Divorcing Mothers in Wisconsin," Journal of Family and Economic Issues, Springer, vol. 44(4), pages 821-835, December.
    15. Amit Kaplan & Anat Herbst-Debby, 2018. "Fragile Employment, Liquid Love: Employment Instability and Divorce in Israel," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 37(1), pages 1-31, February.
    16. Clinton Gudmunson & Sharon Danes, 2011. "Family Financial Socialization: Theory and Critical Review," Journal of Family and Economic Issues, Springer, vol. 32(4), pages 644-667, December.
    17. Rudan Wang & Bruce Morley & Javier Ordóñez, 2016. "The Taylor Rule, Wealth Effects and the Exchange Rate," Review of International Economics, Wiley Blackwell, vol. 24(2), pages 282-301, May.
    18. John Douglas Skåtun, 2017. "Bargaining on your Spouse: Coasean and Non-Coasean Behaviour Within Marriage," Journal of Family and Economic Issues, Springer, vol. 38(2), pages 263-278, June.
    19. Emma Beacom & Sinéad Furey & Lynsey Hollywood & Paul Humphreys, 2021. "Conceptualising household food insecurity in Northern Ireland: risk factors, implications for society and the economy, and recommendations for business and policy response," SN Business & Economics, Springer, vol. 1(5), pages 1-22, May.
    20. Adrianne Frech & Matthew Painter & Jonathan Vespa, 2017. "Marital Biography and Mothers’ Wealth," Journal of Family and Economic Issues, Springer, vol. 38(2), pages 279-292, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jconsa:v:48:y:2014:i:3:p:603-619. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0022-0078 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.