IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v40y2015i3p227-253.html
   My bibliography  Save this article

Equating Without an Anchor for Nonequivalent Groups of Examinees

Author

Listed:
  • Nicholas T. Longford

    (SNTL and Universitat Pompeu Fabra)

Abstract

An equating procedure for a testing program with evolving distribution of examinee profiles is developed. No anchor is available because the original scoring scheme was based on expert judgment of the item difficulties. Pairs of examinees from two administrations are formed by matching on coarsened propensity scores derived from a set of background variables. These two subsets of scores are then equated, treating the associated sets of test performances as equivalent. The method is applied to the scores in 2 years of a testing program for admission to tertiary education.

Suggested Citation

  • Nicholas T. Longford, 2015. "Equating Without an Anchor for Nonequivalent Groups of Examinees," Journal of Educational and Behavioral Statistics, , vol. 40(3), pages 227-253, June.
  • Handle: RePEc:sae:jedbes:v:40:y:2015:i:3:p:227-253
    DOI: 10.3102/1076998615574773
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998615574773
    Download Restriction: no

    File URL: https://libkey.io/10.3102/1076998615574773?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Thaddeus Tarpey & R. Todd Ogden & Eva Petkova & Ronald Christensen, 2014. "A Paradoxical Result in Estimating Regression Coefficients," The American Statistician, Taylor & Francis Journals, vol. 68(4), pages 271-276, November.
    2. Iacus, Stefano M. & King, Gary & Porro, Giuseppe, 2011. "Multivariate Matching Methods That Are Monotonic Imbalance Bounding," Journal of the American Statistical Association, American Statistical Association, vol. 106(493), pages 345-361.
    3. Daniel F. McCaffrey & J. R. Lockwood & Claude M. Setodji, 2013. "Inverse probability weighting with error-prone covariates," Biometrika, Biometrika Trust, vol. 100(3), pages 671-680.
    4. Rosenbaum, Paul R. & Ross, Richard N. & Silber, Jeffrey H., 2007. "Minimum Distance Matched Sampling With Fine Balance in an Observational Study of Treatment for Ovarian Cancer," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 75-83, March.
    5. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Paul Allin & David J. Hand, 2017. "New statistics for old?—measuring the wellbeing of the UK," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(1), pages 3-43, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kube, Roland & von Graevenitz, Kathrine & Löschel, Andreas & Massier, Philipp, 2019. "Do voluntary environmental programs reduce emissions? EMAS in the German manufacturing sector," Energy Economics, Elsevier, vol. 84(S1).
    2. Brucal, Arlan & Javorcik, Beata & Love, Inessa, 2019. "Good for the environment, good for business: Foreign acquisitions and energy intensity," Journal of International Economics, Elsevier, vol. 121(C).
    3. Gensler, Sonja & Leeflang, Peter & Skiera, Bernd, 2012. "Impact of online channel use on customer revenues and costs to serve: Considering product portfolios and self-selection," International Journal of Research in Marketing, Elsevier, vol. 29(2), pages 192-201.
    4. Firat Bilgel & Burhan Can Karahasan, 2019. "Thirty Years of Conflict and Economic Growth in Turkey: A Synthetic Control Approach," Defence and Peace Economics, Taylor & Francis Journals, vol. 30(5), pages 609-631, July.
    5. Jason J. Sauppe & Sheldon H. Jacobson & Edward C. Sewell, 2014. "Complexity and Approximation Results for the Balance Optimization Subset Selection Model for Causal Inference in Observational Studies," INFORMS Journal on Computing, INFORMS, vol. 26(3), pages 547-566, August.
    6. Mark DeFond & David H. Erkens & Jieying Zhang, 2017. "Do Client Characteristics Really Drive the Big N Audit Quality Effect? New Evidence from Propensity Score Matching," Management Science, INFORMS, vol. 63(11), pages 3628-3649, November.
    7. Ravi Bapna & Alok Gupta & Gautam Ray & Shweta Singh, 2016. "Research Note —IT Outsourcing and the Impact of Advisors on Clients and Vendors," Information Systems Research, INFORMS, vol. 27(3), pages 636-647.
    8. Jason J. Sauppe & Sheldon H. Jacobson, 2017. "The role of covariate balance in observational studies," Naval Research Logistics (NRL), John Wiley & Sons, vol. 64(4), pages 323-344, June.
    9. Azoulay, Pierre & Greenblatt, Wesley H. & Heggeness, Misty L., 2021. "Long-term effects from early exposure to research: Evidence from the NIH “Yellow Berets”," Research Policy, Elsevier, vol. 50(9).
    10. Sun, Sizhong & Anwar, Sajid, 2019. "R&D activities and FDI in China’s iron ore mining industry," Economic Analysis and Policy, Elsevier, vol. 62(C), pages 47-56.
    11. Gao, Qin & Zhai, Fuhua & Yang, Sui & Li, Shi, 2014. "Does Welfare Enable Family Expenditures on Human Capital? Evidence from China," World Development, Elsevier, vol. 64(C), pages 219-231.
    12. Sun, Sizhong & Anwar, Sajid, 2015. "R&D status and the performance of domestic firms in China's coal mining industry," Energy Policy, Elsevier, vol. 79(C), pages 99-103.
    13. Kaat Smets & Pierangelo Isernia, 2014. "The role of deliberation in attitude change: An empirical assessment of three theoretical mechanisms," European Union Politics, , vol. 15(3), pages 389-409, September.
    14. Arlan Brucal, Inessa Love, Beata Javorcik, 2018. "Energy savings through foreign acquisitions? Evidence from Indonesian manufacturing plants," GRI Working Papers 289, Grantham Research Institute on Climate Change and the Environment.
    15. Paolo Naticchioni & Silvia Loriga, 2011. "Short and Long Term Evaluations of Public Employment Services in Italy," Applied Economics Quarterly (formerly: Konjunkturpolitik), Duncker & Humblot, Berlin, vol. 57(3), pages 201-229.
    16. Alperovych, Yan & Hübner, Georges & Lobet, Fabrice, 2015. "How does governmental versus private venture capital backing affect a firm's efficiency? Evidence from Belgium," Journal of Business Venturing, Elsevier, vol. 30(4), pages 508-525.
    17. Ellison, Richard B. & Ellison, Adrian B. & Greaves, Stephen P. & Sampaio, Breno, 2017. "Electronic ticketing systems as a mechanism for travel behaviour change? Evidence from Sydney’s Opal card," Transportation Research Part A: Policy and Practice, Elsevier, vol. 99(C), pages 80-93.
    18. Turner, Alex J. & Fichera, Eleonora & Sutton, Matt, 2021. "The effects of in-utero exposure to influenza on mental health and mortality risk throughout the life-course," Economics & Human Biology, Elsevier, vol. 43(C).
    19. Dettmann, E. & Becker, C. & Schmeißer, C., 2011. "Distance functions for matching in small samples," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1942-1960, May.
    20. Jeffrey Smith, 2000. "A Critical Survey of Empirical Methods for Evaluating Active Labor Market Policies," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 136(III), pages 247-268, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:40:y:2015:i:3:p:227-253. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.