IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v22y2011i4p790-807.html

A Hidden Markov Model of Developer Learning Dynamics in Open Source Software Projects

Author

Listed:
  • Param Vir Singh

    (Tepper School of Business, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213)

  • Yong Tan

    (Foster School of Business, University of Washington, Seattle, Washington 98195)

  • Nara Youn

    (School of Business, Hongik University, Seoul 121-791, Korea)

Abstract

This study develops a stochastic model to capture developer learning dynamics in open source software projects (OSS). A hidden Markov model (HMM) is proposed that allows us to investigate (1) the extent to which individuals learn from their own experience and from interactions with peers, (2) whether an individual's ability to learn from these activities varies as she evolves/learns over time, and (3) to what extent individual learning persists over time. We calibrate the model based on six years of detailed data collected from 251 developers working on 25 OSS projects hosted at Sourceforge. Using the HMM, three latent learning states (high, medium, and low) are identified, and the marginal impact of learning activities on moving the developer between these states is estimated. Our findings reveal different patterns of learning in different learning states. Learning from peers appears to be the most important source of learning for developers across the three states. Developers in the medium learning state benefit the most through discussions that they initiate. On the other hand, developers in the low and the high states benefit the most by participating in discussions started by others. While in the low state, developers depend entirely upon their peers to learn, whereas in the medium or high state, they can also draw upon their own experiences. Explanations for these varying impacts of learning activities on the transitions of developers between the three learning states are provided. The HMM is shown to outperform the classical learning curve model. The HMM modeling of this study contributes to the development of a theoretically grounded understanding of learning behavior of individuals. Such a theory and associated findings have important managerial and operational implications for devising interventions to promote learning in a variety of settings.

Suggested Citation

  • Param Vir Singh & Yong Tan & Nara Youn, 2011. "A Hidden Markov Model of Developer Learning Dynamics in Open Source Software Projects," Information Systems Research, INFORMS, vol. 22(4), pages 790-807, December.
    • Handle: RePEc:inm:orisre:v:22:y:2011:i:4:p:790-807
    DOI: 10.1287/isre.1100.0308
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.1100.0308
    Download Restriction: no
    File URL: https://libkey.io/10.1287/isre.1100.0308?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Josh Lerner & Jean Tirole, 2002. "Some Simple Economics of Open Source," Journal of Industrial Economics, Wiley Blackwell, vol. 50(2), pages 197-234, June.
    2. Wai Fong Boh & Sandra A. Slaughter & J. Alberto Espinosa, 2007. "Learning from Experience in Software Development: A Multilevel Analysis," Management Science, INFORMS, vol. 53(8), pages 1315-1331, August.
    3. Greene, William H. & Hensher, David A., 2003. "A latent class model for discrete choice analysis: contrasts with mixed logit," Transportation Research Part B: Methodological, Elsevier, vol. 37(8), pages 681-698, September.
    4. Heckman, James J. & Singer, Burton, 1984. "Econometric duration analysis," Journal of Econometrics, Elsevier, vol. 24(1-2), pages 63-132.
    5. Andrew H. Van de Ven & Douglas Polley, 1992. "Learning While Innovating," Organization Science, INFORMS, vol. 3(1), pages 92-116, February.
    6. Dennis Epple & Linda Argote & Kenneth Murphy, 1996. "An Empirical Investigation of the Microstructure of Knowledge Acquisition and Transfer Through Learning by Doing," Operations Research, INFORMS, vol. 44(1), pages 77-86, February.
    7. Tridas Mukhopadhyay & ParamVir Singh & Seung Hyun Kim, 2011. "Learning Curves of Agents with Diverse Skills in Information Technology-Enabled Physician Referral Systems," Information Systems Research, INFORMS, vol. 22(3), pages 586-605, September.
    8. Scott M. Shafer & David A. Nembhard & Mustafa V. Uzumeri, 2001. "The Effects of Worker Learning, Forgetting, and Heterogeneity on Assembly Line Productivity," Management Science, INFORMS, vol. 47(12), pages 1639-1653, December.
    9. Eric D. Darr & Linda Argote & Dennis Epple, 1995. "The Acquisition, Transfer, and Depreciation of Knowledge in Service Organizations: Productivity in Franchises," Management Science, INFORMS, vol. 41(11), pages 1750-1762, November.
    10. Argote, L. & Epple, D., 1990. "Learning Curves In Manufacturing," GSIA Working Papers 89-90-02, Carnegie Mellon University, Tepper School of Business.
    11. Melissa A. Schilling & Patricia Vidal & Robert E. Ployhart & Alexandre Marangoni, 2003. "Learning by Doing Something Else: Variation, Relatedness, and the Learning Curve," Management Science, INFORMS, vol. 49(1), pages 39-56, January.
    12. Ray Reagans & Linda Argote & Daria Brooks, 2005. "Individual Experience and Experience Working Together: Predicting Learning Rates from Knowing Who Knows What and Knowing How to Work Together," Management Science, INFORMS, vol. 51(6), pages 869-881, June.
    13. Jeffrey A. Roberts & Il-Horn Hann & Sandra A. Slaughter, 2006. "Understanding the Motivations, Participation, and Performance of Open Source Software Developers: A Longitudinal Study of the Apache Projects," Management Science, INFORMS, vol. 52(7), pages 984-999, July.
    14. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    15. Altman, Rachel MacKay, 2007. "Mixed Hidden Markov Models: An Extension of the Hidden Markov Model to the Longitudinal Data Setting," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 201-210, March.
    16. Linda Argote & Sara L. Beckman & Dennis Epple, 1990. "The Persistence and Transfer of Learning in Industrial Settings," Management Science, INFORMS, vol. 36(2), pages 140-154, February.
    17. Rajdeep Grewal & Gary L. Lilien & Girish Mallapragada, 2006. "Location, Location, Location: How Network Embeddedness Affects Project Success in Open Source Systems," Management Science, INFORMS, vol. 52(7), pages 1043-1056, July.
    18. Linda Argote & Bill McEvily & Ray Reagans, 2003. "Managing Knowledge in Organizations: An Integrative Framework and Review of Emerging Themes," Management Science, INFORMS, vol. 49(4), pages 571-582, April.
    19. Heckman, James J, 1991. "Identifying the Hand of the Past: Distinguishing State Dependence from Heterogeneity," American Economic Review, American Economic Association, vol. 81(2), pages 75-79, May.
    20. Lakhani, Karim R. & von Hippel, Eric, 2003. "How open source software works: "free" user-to-user assistance," Research Policy, Elsevier, vol. 32(6), pages 923-943, June.
    21. Georg von Krogh & Eric von Hippel, 2006. "The Promise of Research on Open Source Software," Management Science, INFORMS, vol. 52(7), pages 975-983, July.
    22. Lee Fleming, 2001. "Recombinant Uncertainty in Technological Search," Management Science, INFORMS, vol. 47(1), pages 117-132, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tridas Mukhopadhyay & ParamVir Singh & Seung Hyun Kim, 2011. "Learning Curves of Agents with Diverse Skills in Information Technology-Enabled Physician Referral Systems," Information Systems Research, INFORMS, vol. 22(3), pages 586-605, September.
    2. Fan, Terence & Schwab, Andreas & Geng, Xuesong, 2021. "Habitual entrepreneurship in digital platform ecosystems: A time-contingent model of learning from prior software project experiences," Journal of Business Venturing, Elsevier, vol. 36(5).
    3. Robert S. Huckman & Bradley R. Staats, 2008. "Variation in Experience and Team Familiarity: Addressing the Knowledge Acquisition-Application Problem," Harvard Business School Working Papers 09-035, Harvard Business School.
    4. Linda Argote & Sunkee Lee & Jisoo Park, 2021. "Organizational Learning Processes and Outcomes: Major Findings and Future Research Directions," Management Science, INFORMS, vol. 67(9), pages 5399-5429, September.
    5. Linda Argote & Ella Miron-Spektor, 2011. "Organizational Learning: From Experience to Knowledge," Organization Science, INFORMS, vol. 22(5), pages 1123-1137, October.
    6. Eelke Wiersma, 2007. "Conditions That Shape the Learning Curve: Factors That Increase the Ability and Opportunity to Learn," Management Science, INFORMS, vol. 53(12), pages 1903-1915, December.
    7. Amit Mehra & Rajiv Dewan & Marshall Freimer, 2011. "Firms as Incubators of Open-Source Software," Information Systems Research, INFORMS, vol. 22(1), pages 22-38, March.
    8. Carolyn D. Egelman & Dennis Epple & Linda Argote & Erica R.H. Fuchs, 2013. "Learning by Doing in a Multi-Product Manufacturing Environment: Product Variety, Customizations, and Overlapping Product Generations," NBER Working Papers 19674, National Bureau of Economic Research, Inc.
    9. Christoph Riedl & Victor P. Seidel, 2018. "Learning from Mixed Signals in Online Innovation Communities," Organization Science, INFORMS, vol. 29(6), pages 1010-1032, December.
    10. Shirish Sundaresan & Isin Guler, 2025. "Algorithmic Recommendation Tools and Experiential Learning in Clinical Care," Organization Science, INFORMS, vol. 36(5), pages 1786-1802, September.
    11. Christina Fang, 2012. "Organizational Learning as Credit Assignment: A Model and Two Experiments," Organization Science, INFORMS, vol. 23(6), pages 1717-1732, December.
    12. Megan Lawrence, 2018. "Taking Stock of the Ability to Change: The Effect of Prior Experience," Organization Science, INFORMS, vol. 29(3), pages 489-506, June.
    13. Moon, Sangkil, 2011. "An Empirical Investigation of Dual Network Effects in Innovation Project Development," Journal of Interactive Marketing, Elsevier, vol. 25(4), pages 215-225.
    14. Ray Reagans & Linda Argote & Daria Brooks, 2005. "Individual Experience and Experience Working Together: Predicting Learning Rates from Knowing Who Knows What and Knowing How to Work Together," Management Science, INFORMS, vol. 51(6), pages 869-881, June.
    15. Wen Wen & Chris Forman & Stuart J. H. Graham, 2013. "Research Note ---The Impact of Intellectual Property Rights Enforcement on Open Source Software Project Success," Information Systems Research, INFORMS, vol. 24(4), pages 1131-1146, December.
    16. Nilanjana Dutt & Megan Lawrence, 2022. "Learning to Manage Breadth: Experience as Repetition and Adaptation," Organization Science, INFORMS, vol. 33(4), pages 1300-1318, July.
    17. Anindya Ghosh & Xavier Martin & Johannes M. Pennings & Filippo Carlo Wezel, 2014. "Ambition Is Nothing Without Focus: Compensating for Negative Transfer of Experience in R&D," Organization Science, INFORMS, vol. 25(2), pages 572-590, April.
    18. Sheen S. Levine & Michael J. Prietula, 2012. "How Knowledge Transfer Impacts Performance: A Multilevel Model of Benefits and Liabilities," Organization Science, INFORMS, vol. 23(6), pages 1748-1766, December.
    19. Amit Jain & Will Mitchell, 2022. "Specialization as a double‐edged sword: The relationship of scientist specialization with R&D productivity and impact following collaborator change," Strategic Management Journal, Wiley Blackwell, vol. 43(5), pages 986-1024, May.
    20. Scott F. Rockart & Nilanjana Dutt, 2015. "The rate and potential of capability development trajectories," Strategic Management Journal, Wiley Blackwell, vol. 36(1), pages 53-75, January.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:22:y:2011:i:4:p:790-807. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.