IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v79y2014i3p357-376.html
   My bibliography  Save this article

Rating Scales as Predictors—The Old Question of Scale Level and Some Answers

Author

Listed:
  • Gerhard Tutz
  • Jan Gertheiss

Abstract

Rating scales as predictors in regression models are typically treated as metrically scaled variables or, alternatively, are coded in dummy variables. The first approach implies a scale level that is not justified, the latter approach results in a large number of parameters to be estimated. Therefore, when rating scales are dummy-coded, applications are often restricted to the use of a few predictors. The penalization approach advocated here takes the scale level serious by using only the ordering of categories but is shown to work in the high dimensional case. We consider the proper modeling of rating scales as predictors and selection procedures by using penalization methods that are tailored to ordinal predictors. In addition to the selection of predictors, the clustering of categories is investigated. Existing methodology is extended to the wider class of generalized linear models. Moreover, higher order differences that allow shrinkage towards a polynomial as well as monotonicity constraints and alternative penalties are introduced. The proposed penalization approaches are illustrated by use of the Motivational States Questionnaire. Copyright The Psychometric Society 2014

Suggested Citation

  • Gerhard Tutz & Jan Gertheiss, 2014. "Rating Scales as Predictors—The Old Question of Scale Level and Some Answers," Psychometrika, Springer;The Psychometric Society, vol. 79(3), pages 357-376, July.
  • Handle: RePEc:spr:psycho:v:79:y:2014:i:3:p:357-376
    DOI: 10.1007/s11336-013-9343-3
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11336-013-9343-3
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s11336-013-9343-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lukas Meier & Sara Van De Geer & Peter Bühlmann, 2008. "The group lasso for logistic regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(1), pages 53-71, February.
    2. anonymous, 1986. "Economic notes," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 49, march.
    3. Simon N. Wood, 2011. "Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(1), pages 3-36, January.
    4. Marx, Brian D. & Eilers, Paul H. C., 1998. "Direct generalized additive modeling with penalized likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 28(2), pages 193-209, August.
    5. anonymous, 1986. "Economic notes," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 49, january.
    6. anonymous, 1986. "Economic notes," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 49, june.
    7. Simon N. Wood, 2004. "Stable and Efficient Multiple Smoothing Parameter Estimation for Generalized Additive Models," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 673-686, January.
    8. anonymous, 1986. "Economic notes," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 49, july.
    9. Rousseeuw, Peter J. & Christmann, Andreas, 2003. "Robustness against separation and outliers in logistic regression," Computational Statistics & Data Analysis, Elsevier, vol. 43(3), pages 315-332, July.
    10. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    11. anonymous, 1986. "Economic notes," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 49, april.
    12. Robert Tibshirani & Michael Saunders & Saharon Rosset & Ji Zhu & Keith Knight, 2005. "Sparsity and smoothness via the fused lasso," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(1), pages 91-108, February.
    13. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521785167.
    14. Forrest Young & Jan Leeuw & Yoshio Takane, 1976. "Regression with qualitative and quantitative variables: An alternating least squares method with optimal scaling features," Psychometrika, Springer;The Psychometric Society, vol. 41(4), pages 505-529, December.
    15. Jan Gertheiss & Gerhard Tutz, 2009. "Penalized Regression with Ordinal Predictors," International Statistical Review, International Statistical Institute, vol. 77(3), pages 345-365, December.
    16. anonymous, 1986. "Economic notes," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 49, august.
    17. Jan Gertheiss & Sara Hogger & Cornelia Oberhauser & Gerhard Tutz, 2011. "Selection of ordinally scaled independent variables with applications to international classification of functioning core sets," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 60(3), pages 377-395, May.
    18. Howard D. Bondell & Brian J. Reich, 2009. "Simultaneous Factor Selection and Collapsing Levels in ANOVA," Biometrics, The International Biometric Society, vol. 65(1), pages 169-177, March.
    19. anonymous, 1986. "Economic notes," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 49, february.
    20. anonymous, 1986. "Economic notes," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 49, may.
    21. Rufibach, Kaspar, 2010. "An active set algorithm to estimate parameters in generalized linear models with ordered predictors," Computational Statistics & Data Analysis, Elsevier, vol. 54(6), pages 1442-1456, June.
    22. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521780506.
    23. anonymous, 1986. "Economic notes," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 49, september.
    24. Ming Yuan & Yi Lin, 2006. "Model selection and estimation in regression with grouped variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 49-67, February.
    25. M. P. Wand, 2003. "Smoothing and mixed models," Computational Statistics, Springer, vol. 18(2), pages 223-249, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gerhard Tutz & Moritz Berger, 2018. "Tree-structured modelling of categorical predictors in generalized additive regression," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 12(3), pages 737-758, September.
    2. Gerhard Tutz & Micha Schneider & Maria Iannario & Domenico Piccolo, 2017. "Mixture models for ordinal responses to account for uncertainty of choice," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 11(2), pages 281-305, June.
    3. Ejike R. Ugba & Daniel Mörlein & Jan Gertheiss, 2021. "Smoothing in Ordinal Regression: An Application to Sensory Data," Stats, MDPI, vol. 4(3), pages 1-18, July.
    4. Milenković, Marina & Glavić, Draženko & Maričić, Milica, 2019. "Determining factors affecting congestion pricing acceptability," Transport Policy, Elsevier, vol. 82(C), pages 58-74.
    5. Bierkens, Joris & Bouchard-Côté, Alexandre & Doucet, Arnaud & Duncan, Andrew B. & Fearnhead, Paul & Lienart, Thibaut & Roberts, Gareth & Vollmer, Sebastian J., 2018. "Piecewise deterministic Markov processes for scalable Monte Carlo on restricted domains," Statistics & Probability Letters, Elsevier, vol. 136(C), pages 148-154.
    6. Battauz, Michela & Vidoni, Paolo, 2022. "A likelihood-based boosting algorithm for factor analysis models with binary data," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    7. Sweeney Elizabeth & Crainiceanu Ciprian & Gertheiss Jan, 2016. "Testing differentially expressed genes in dose-response studies and with ordinal phenotypes," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 15(3), pages 213-235, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gerhard Tutz & Margret-Ruth Oelker, 2017. "Modelling Clustered Heterogeneity: Fixed Effects, Random Effects and Mixtures," International Statistical Review, International Statistical Institute, vol. 85(2), pages 204-227, August.
    2. Strasak, Alexander M. & Umlauf, Nikolaus & Pfeiffer, Ruth M. & Lang, Stefan, 2011. "Comparing penalized splines and fractional polynomials for flexible modelling of the effects of continuous predictor variables," Computational Statistics & Data Analysis, Elsevier, vol. 55(4), pages 1540-1551, April.
    3. Andreas Groll & Trevor Hastie & Gerhard Tutz, 2017. "Selection of effects in Cox frailty models by regularization methods," Biometrics, The International Biometric Society, vol. 73(3), pages 846-856, September.
    4. Hess, Wolfgang & Persson, Maria & Rubenbauer, Stephanie & Gertheiss, Jan, 2013. "Using Lasso-Type Penalties to Model Time-Varying Covariate Effects in Panel Data Regressions - A Novel Approach Illustrated by the 'Death of Distance' in International Trade," Working Papers 2013:5, Lund University, Department of Economics.
    5. Rodríguez-Álvarez, María Xosé & Lee, Dae-Jin & Kneib, Thomas & Durbán, María & Eilers, Paul, 2013. "Fast algorithm for smoothing parameter selection in multidimensional generalized P-splines," DES - Working Papers. Statistics and Econometrics. WS ws133026, Universidad Carlos III de Madrid. Departamento de Estadística.
    6. Faisal Maqbool Zahid & Gerhard Tutz, 2013. "Proportional Odds Models with High‐Dimensional Data Structure," International Statistical Review, International Statistical Institute, vol. 81(3), pages 388-406, December.
    7. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    8. Longhi, Christian & Musolesi, Antonio & Baumont, Catherine, 2014. "Modeling structural change in the European metropolitan areas during the process of economic integration," Economic Modelling, Elsevier, vol. 37(C), pages 395-407.
    9. Basile, Roberto & Durbán, María & Mínguez, Román & María Montero, Jose & Mur, Jesús, 2014. "Modeling regional economic dynamics: Spatial dependence, spatial heterogeneity and nonlinearities," Journal of Economic Dynamics and Control, Elsevier, vol. 48(C), pages 229-245.
    10. Morteza Amini & Mahdi Roozbeh & Nur Anisah Mohamed, 2024. "Separation of the Linear and Nonlinear Covariates in the Sparse Semi-Parametric Regression Model in the Presence of Outliers," Mathematics, MDPI, vol. 12(2), pages 1-17, January.
    11. Pei Wang & Shunjie Chen & Sijia Yang, 2022. "Recent Advances on Penalized Regression Models for Biological Data," Mathematics, MDPI, vol. 10(19), pages 1-24, October.
    12. Takuma Yoshida, 2019. "Two stage smoothing in additive models with missing covariates," Statistical Papers, Springer, vol. 60(6), pages 1803-1826, December.
    13. Christian Schellhase & Göran Kauermann, 2012. "Density estimation and comparison with a penalized mixture approach," Computational Statistics, Springer, vol. 27(4), pages 757-777, December.
    14. Hübler, Olaf, 2017. "Health and Body Mass Index: No Simple Relationship," IZA Discussion Papers 10620, Institute of Labor Economics (IZA).
    15. Minh Pham & Xiaodong Lin & Andrzej Ruszczyński & Yu Du, 2021. "An outer–inner linearization method for non-convex and nondifferentiable composite regularization problems," Journal of Global Optimization, Springer, vol. 81(1), pages 179-202, September.
    16. Bang, Sungwan & Jhun, Myoungshic, 2012. "Simultaneous estimation and factor selection in quantile regression via adaptive sup-norm regularization," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 813-826.
    17. Giampiero Marra & Rosalba Radice & Till Bärnighausen & Simon N. Wood & Mark E. McGovern, 2017. "A Simultaneous Equation Approach to Estimating HIV Prevalence With Nonignorable Missing Responses," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 484-496, April.
    18. Musolesi Antonio & Mazzanti Massimiliano, 2014. "Nonlinearity, heterogeneity and unobserved effects in the carbon dioxide emissions-economic development relation for advanced countries," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 18(5), pages 1-21, December.
    19. Chen, Shunjie & Yang, Sijia & Wang, Pei & Xue, Liugen, 2023. "Two-stage penalized algorithms via integrating prior information improve gene selection from omics data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 628(C).
    20. Nicole H. Augustin & Stefan Lang & Monica Musio & Klaus Von Wilpert, 2007. "A spatial model for the needle losses of pine‐trees in the forests of Baden‐Württemberg: an application of Bayesian structured additive regression," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 56(1), pages 29-50, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:79:y:2014:i:3:p:357-376. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.