IDEAS home Printed from https://ideas.repec.org/a/ags/ajaeau/22286.html
   My bibliography  Save this article

A Review Of The Estimation Of Transition Probabilities In Markov Chains

Author

Listed:
  • Dent, Warren Thomas
  • Ballintine, Richard

Abstract

A chronological review of the development of estimation procedures for unknown constant Markovian transition probabilities is presented with emphasis on applications involving the availability of macrodata, as opposed to microdata. Monte Carlo results comparing various estimation methods are analysed and several suggestions for estimating non-stationary probabilities are made.

Suggested Citation

  • Dent, Warren Thomas & Ballintine, Richard, 1971. "A Review Of The Estimation Of Transition Probabilities In Markov Chains," Australian Journal of Agricultural Economics, Australian Agricultural and Resource Economics Society, vol. 15(2), pages 1-13, August.
  • Handle: RePEc:ags:ajaeau:22286
    DOI: 10.22004/ag.econ.22286
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/22286/files/15020069.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.22004/ag.econ.22286?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kelley, Allen C & Weiss, Leonard W, 1969. "Markov Processes and Economic Analysis: The Case of Migration," Econometrica, Econometric Society, vol. 37(2), pages 280-297, April.
    2. M. C. Hallberg, 1969. "Projecting the Size Distribution of Agricultural Firms—An Application of a Markov Process with Non-Stationary Transition Probabilities," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 51(2), pages 289-302.
    3. Timothy McGuire, 1969. "More on least squares estimation of the transition matrix in a stationary first-order markov process from sample proportions data," Psychometrika, Springer;The Psychometric Society, vol. 34(3), pages 335-345, September.
    4. Albert Madansky, 1959. "Least squares estimation in finite Markov processes," Psychometrika, Springer;The Psychometric Society, vol. 24(2), pages 137-144, June.
    5. T. C. Lee & G. G. Judge & T. Takayama, 1965. "On Estimating the Transition Probabilities of a Markov Process," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 47(3), pages 742-762.
    6. George Miller, 1952. "Finite markov processes in psychology," Psychometrika, Springer;The Psychometric Society, vol. 17(2), pages 149-167, June.
    7. Krenz, Ronald D., 1964. "Projection of Farm Numbers for North Dakota With Markov Chains," Journal of Agricultural Economics Research, United States Department of Agriculture, Economic Research Service, vol. 16(3), pages 1-7, July.
    8. Richard Kao, 1953. "Note on Miller's “Finite Markov Processes in Psychology”," Psychometrika, Springer;The Psychometric Society, vol. 18(3), pages 241-243, September.
    9. Judge, George G. & Swanson, E.R., 1962. "Markov Chains: Basic Concepts And Suggested Uses In Agricultural Economics," Australian Journal of Agricultural Economics, Australian Agricultural and Resource Economics Society, vol. 6(2), pages 1-13, December.
    10. T. C. Lee & G. G. Judge & R. L. Cain, 1969. "A Sampling Study of the Properties of Estimators of Transition Probabilities," Management Science, INFORMS, vol. 15(7), pages 374-398, March.
    11. H. Theil & Guido Rey, 1966. "A Quadratic Programming Approach to the Estimation of Transition Probabilities," Management Science, INFORMS, vol. 12(9), pages 714-721, May.
    12. Dryden, Myles M, 1969. "Share Price Movements: A Markovian Approach," Journal of Finance, American Finance Association, vol. 24(1), pages 49-60, March.
    13. Robert Summers, 1959. "A Capital-Intensive Approach to the Small Sample Properties of Various Simultaneous Equation Estimators," Cowles Foundation Discussion Papers 64, Cowles Foundation for Research in Economics, Yale University.
    14. Guido Rey, 1966. "A Markov chain prediction of value added and expenditure shares, Italy 1861–1956," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 20(1), pages 71-86, March.
    15. Daniel I. Padberg, 1962. "The Use of Markov Processes in Measuring Changes in Market Structure," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 44(1), pages 189-199.
    16. Bernard F. Stanton & Lauri Kettunen, 1967. "Potential Entrants and Projections in Markov Process Analysis," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 49(3), pages 633-642.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Libbin, James D., 1982. "Projections of US farm numbers by Markov processes," ISU General Staff Papers 198201010800008508, Iowa State University, Department of Economics.
    2. Villacorta, Pablo J. & Verdegay, José L., 2016. "FuzzyStatProb: An R Package for the Estimation of Fuzzy Stationary Probabilities from a Sequence of Observations of an Unknown Markov Chain," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 71(i08).
    3. Eldosouky, AbdelRahman & Saad, Walid & Mandayam, Narayan, 2021. "Resilient critical infrastructure: Bayesian network analysis and contract-Based optimization," Reliability Engineering and System Safety, Elsevier, vol. 205(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Piet, Laurent, 2008. "The evolution of farm size distribution: revisiting the Markov chain model," 2008 International Congress, August 26-29, 2008, Ghent, Belgium 44269, European Association of Agricultural Economists.
    2. Legrand D. F, Saint-Cyr, 2017. "Farm heterogeneity and agricultural policy impacts on size dynamics: evidence from France," Working Papers SMART 17-04, INRAE UMR SMART.
    3. Burnham, Bruce O., 1973. "Markov Intertemporal Land Use Simulation Model," Southern Journal of Agricultural Economics, Southern Agricultural Economics Association, vol. 5(1), pages 1-6, July.
    4. Christina M. L. Kelton, 1984. "Nonstationary Markov Modeling: An Application to Wage-Influenced Industrial Relocation," International Regional Science Review, , vol. 9(1), pages 75-90, September.
    5. Alexander Gocht & Norbert Röder & Sebastian Neuenfeldt & Hugo Storm & Thomas Heckelei, 2012. "Modelling farm structural change: A feasibility study for ex-post modelling utilizing FADN and FSS data in Germany and developing an ex-ante forecast module for the CAPRI farm type layer baseline," JRC Research Reports JRC75524, Joint Research Centre.
    6. Smith, Matthew G., 1988. "A Conditional Approach To Projecting Farm Structure," Staff Reports 278025, United States Department of Agriculture, Economic Research Service.
    7. Saint-Cyr, Legrand D. F., 2016. "Accounting for farm heterogeneity in the assessment of agricultural policy impacts on structural change," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 235778, Agricultural and Applied Economics Association.
    8. Saint-Cyr, Legrand D. F., 2016. "Farm segmentation and agricultural policy impacts on structural change: evidence from France," 149th Seminar, October 27-28, 2016, Rennes, France 244789, European Association of Agricultural Economists.
    9. Stokes, Jeffrey R., 2006. "Entry, Exit, and Structural Change in Pennsylvania's Dairy Sector," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 35(2), pages 1-17, October.
    10. Ethridge, Don E. & Roy, Sujit K. & Myers, David W., 1983. "Changes in the Structure of the Texas High Plains Cotton Ginning Industry, 1967-1999," Archive 259788, Texas Tech University, Department of Agricultural and Applied Economics.
    11. Davis, Ernest E., 1971. "Future Structure Of The Texas Cattle Feeding Industry As Projected By Transition Probabilities Utilizing A Convex Program," Southern Journal of Agricultural Economics, Southern Agricultural Economics Association, vol. 3(1), pages 1-7, December.
    12. Disney, W. Terry & Duffy, Patricia A. & Hardy, William E., Jr., 1988. "A Markov Chain Analysis Of Pork Farm Size Distributions In The South," Southern Journal of Agricultural Economics, Southern Agricultural Economics Association, vol. 20(2), pages 1-8, December.
    13. Florence Lindsay W & Fellingham Gilbert W & Vehrs Pat R. & Mortensen Nina P., 2008. "Skill Evaluation in Women's Volleyball," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 4(2), pages 1-16, April.
    14. Lin, William W. & Coffman, George & Penn, J. B., 1980. "U.S. Farm Numbers, Sizes, and Related Structural Dimensions: Projections to Year 2000," Technical Bulletins 157730, United States Department of Agriculture, Economic Research Service.
    15. Karantininis, Kostas, 2002. "Information-based estimators for the non-stationary transition probability matrix: an application to the Danish pork industry," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 275-290, March.
    16. Stavins, R. N. & Stanton, B. F., 1980. "Alternative Procedures For Estimating The Size Distribution Of Farms," Journal of the Northeastern Agricultural Economics Council, Northeastern Agricultural and Resource Economics Association, vol. 9(2), pages 1-6, October.
    17. Jeffrey M. Gillespie & Joan R. Fulton, 2001. "A Markov chain analysis of the size of hog production firms in the United States," Agribusiness, John Wiley & Sons, Ltd., vol. 17(4), pages 557-570.
    18. Legrand D. F. Saint-Cyr & Laurent Piet, 2017. "Movers and stayers in the farming sector: accounting for unobserved heterogeneity in structural change," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(4), pages 777-795, August.
    19. Madior Fall & Laurent Piet & Muriel Roger, 2010. "Trends in the French commercial farm population," Review of Agricultural and Environmental Studies - Revue d'Etudes en Agriculture et Environnement, INRA Department of Economics, vol. 91(3), pages 279-295.
    20. Miller, Douglas J., 1994. "Entropy Methods For Recovering Information From Economic Models," 1994 Quantifying Long Run Agricultural Risks and Evaluating Farmer Responses Risk, Technical Committee Meeting, March 24-26, 1994, Gulf Shores State Park, Alabama 271680, Regional Research Projects > S-232: Quantifying Long Run Agricultural Risks and Evaluating Farmer Responses to Risk.

    More about this item

    Keywords

    Research Methods/ Statistical Methods;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:ajaeau:22286. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/aaresea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.