IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v536y2019ics0378437119305631.html
   My bibliography  Save this article

The perfect marriage and much more: Combining dimension reduction, distance measures and covariance

Author

Listed:
  • Kashyap, Ravi

Abstract

We develop a novel methodology based on the marriage between the Bhattacharyya distance, a measure of similarity across distributions of random variables, and the Johnson–Lindenstrauss Lemma, a technique for dimension reduction. The resulting technique is a simple yet powerful tool that allows comparisons between data-sets representing any two distributions. The degree to which different entities, (markets, universities, hospitals, cities, groups of securities, etc.), have different distance measures of their corresponding distributions tells us the extent to which they are different, aiding participants looking for diversification or looking for more of the same thing. We demonstrate a relationship between covariance and distance measures based on a generic extension of Stein’s Lemma. We consider an asset pricing application and then briefly discuss how this methodology lends itself to numerous market–structure studies and even applications outside the realm of finance / social sciences by illustrating a biological application. We provide numerical illustrations using security prices, volumes and volatilities of both these variables from six different countries.

Suggested Citation

  • Kashyap, Ravi, 2019. "The perfect marriage and much more: Combining dimension reduction, distance measures and covariance," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 536(C).
  • Handle: RePEc:eee:phsmap:v:536:y:2019:i:c:s0378437119305631
    DOI: 10.1016/j.physa.2019.04.174
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437119305631
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2019.04.174?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kon, Stanley J, 1984. "Models of Stock Returns-A Comparison," Journal of Finance, American Finance Association, vol. 39(1), pages 147-165, March.
    2. Constantinides, George M & Duffie, Darrell, 1996. "Asset Pricing with Heterogeneous Consumers," Journal of Political Economy, University of Chicago Press, vol. 104(2), pages 219-240, April.
    3. Benoit Mandelbrot & Howard M. Taylor, 1967. "On the Distribution of Stock Price Differences," Operations Research, INFORMS, vol. 15(6), pages 1057-1062, December.
    4. Richardson, Matthew & Smith, Tom, 1993. "A Test for Multivariate Normality in Stock Returns," The Journal of Business, University of Chicago Press, vol. 66(2), pages 295-321, April.
    5. Rubinstein, Mark E, 1973. "A Comparative Statics Analysis of Risk Premiums," The Journal of Business, University of Chicago Press, vol. 46(4), pages 605-615, October.
    6. Mehra, Rajnish, 1988. "On the Existence and Representation of Equilibrium in an Economy with Growth and Nonstationary Consumption," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 29(1), pages 131-135, February.
    7. John Y. Campbell & John Cochrane, 1999. "Force of Habit: A Consumption-Based Explanation of Aggregate Stock Market Behavior," Journal of Political Economy, University of Chicago Press, vol. 107(2), pages 205-251, April.
    8. Weil, Philippe, 1989. "The equity premium puzzle and the risk-free rate puzzle," Journal of Monetary Economics, Elsevier, vol. 24(3), pages 401-421, November.
    9. Robert J. Barro, 2006. "Rare Disasters and Asset Markets in the Twentieth Century," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 121(3), pages 823-866.
    10. K. C. John Wei & Cheng F. Lee, 1988. "The Generalized Stein/Rubinstein Covariance Formula and Its Application to Estimate Real Systematic Risk," Management Science, INFORMS, vol. 34(10), pages 1266-1270, October.
    11. Peter Frankl & Hiroshi Maehara, 1990. "Some geometric applications of the beta distribution," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 42(3), pages 463-474, September.
    12. James E. Smith, 1993. "Moment Methods for Decision Analysis," Management Science, INFORMS, vol. 39(3), pages 340-358, March.
    13. Losq, Etienne & Chateau, John Peter D., 1982. "A Generalization of the CAPM Based on a Property of the Covariance Operator," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 17(5), pages 783-797, December.
    14. Engle, Robert F., 1984. "Wald, likelihood ratio, and Lagrange multiplier tests in econometrics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 13, pages 775-826, Elsevier.
    15. Clark, Peter K, 1973. "A Subordinated Stochastic Process Model with Finite Variance for Speculative Prices," Econometrica, Econometric Society, vol. 41(1), pages 135-155, January.
    16. Hansen, Lars Peter & Jagannathan, Ravi, 1991. "Implications of Security Market Data for Models of Dynamic Economies," Journal of Political Economy, University of Chicago Press, vol. 99(2), pages 225-262, April.
    17. Jurgen A. Doornik & Henrik Hansen, 2008. "An Omnibus Test for Univariate and Multivariate Normality," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(s1), pages 927-939, December.
    18. Glen, Andrew G. & Leemis, Lawrence M. & Drew, John H., 2004. "Computing the distribution of the product of two continuous random variables," Computational Statistics & Data Analysis, Elsevier, vol. 44(3), pages 451-464, January.
    19. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    20. Mehra, Rajnish & Prescott, Edward C., 1985. "The equity premium: A puzzle," Journal of Monetary Economics, Elsevier, vol. 15(2), pages 145-161, March.
    21. Hansen, Lars Peter & Richard, Scott F, 1987. "The Role of Conditioning Information in Deducing Testable," Econometrica, Econometric Society, vol. 55(3), pages 587-613, May.
    22. J. M. Keynes, 1937. "The General Theory of Employment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 51(2), pages 209-223.
    23. Tauchen, George E & Pitts, Mark, 1983. "The Price Variability-Volume Relationship on Speculative Markets," Econometrica, Econometric Society, vol. 51(2), pages 485-505, March.
    24. Lawson, Tony, 1985. "Uncertainty and Economic Analysis," Economic Journal, Royal Economic Society, vol. 95(380), pages 909-927, December.
    25. Rietz, Thomas A., 1988. "The equity risk premium a solution," Journal of Monetary Economics, Elsevier, vol. 22(1), pages 117-131, July.
    26. Mark Rubinstein, 1976. "The Valuation of Uncertain Income Streams and the Pricing of Options," Bell Journal of Economics, The RAND Corporation, vol. 7(2), pages 407-425, Autumn.
    27. Donald L. Keefer & Samuel E. Bodily, 1983. "Three-Point Approximations for Continuous Random Variables," Management Science, INFORMS, vol. 29(5), pages 595-609, May.
    28. Horrace, William C., 2005. "Some results on the multivariate truncated normal distribution," Journal of Multivariate Analysis, Elsevier, vol. 94(1), pages 209-221, May.
    29. Lucas, Robert E, Jr, 1978. "Asset Prices in an Exchange Economy," Econometrica, Econometric Society, vol. 46(6), pages 1429-1445, November.
    30. Allen C. Miller, III & Thomas R. Rice, 1983. "Discrete Approximations of Probability Distributions," Management Science, INFORMS, vol. 29(3), pages 352-362, March.
    31. Kumar Kattumannil, Sudheesh, 2009. "On Stein's identity and its applications," Statistics & Probability Letters, Elsevier, vol. 79(12), pages 1444-1449, June.
    32. Ravi Bansal & Amir Yaron, 2004. "Risks for the Long Run: A Potential Resolution of Asset Pricing Puzzles," Journal of Finance, American Finance Association, vol. 59(4), pages 1481-1509, August.
    33. Martin L. Weitzman, 2007. "Subjective Expectations and Asset-Return Puzzles," American Economic Review, American Economic Association, vol. 97(4), pages 1102-1130, September.
    34. Kiani, M & Panaretos, J & Psarakis, S & Saleem, M, 2008. "Approximations to the Normal Distribution Function and An Extended Table for the Mean Range of the Normal Variables," MPRA Paper 68045, University Library of Munich, Germany.
    35. Liu, Jun S., 1994. "Siegel's formula via Stein's identities," Statistics & Probability Letters, Elsevier, vol. 21(3), pages 247-251, October.
    36. Mehra, Rajnish & Prescott, Edward C., 1988. "The equity risk premium: A solution?," Journal of Monetary Economics, Elsevier, vol. 22(1), pages 133-136, July.
    37. Minxian Yang, 2008. "Normal log-normal mixture, leptokurtosis and skewness," Applied Economics Letters, Taylor & Francis Journals, vol. 15(9), pages 737-742.
    38. Szekely, Gábor J. & Rizzo, Maria L., 2005. "A new test for multivariate normality," Journal of Multivariate Analysis, Elsevier, vol. 93(1), pages 58-80, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kashyap Ravi, 2020. "The Economics of Enlightenment: Time Value of Knowledge and the Net Present Value (NPV) of Knowledge Machines, A Proposed Approach Adapted from Finance," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 20(2), pages 1-23, April.
    2. Kashyap, Ravi, 2021. "Artificial Intelligence: A Child’s Play," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    3. Kashyap Ravi, 2020. "The Economics of Enlightenment: Time Value of Knowledge and the Net Present Value (NPV) of Knowledge Machines, A Proposed Approach Adapted from Finance," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 20(2), pages 1-23, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ravi Kashyap, 2016. "The Perfect Marriage and Much More: Combining Dimension Reduction, Distance Measures and Covariance," Papers 1603.09060, arXiv.org, revised Jul 2019.
    2. Ravi Kashyap, 2016. "Solving the Equity Risk Premium Puzzle and Inching Towards a Theory of Everything," Papers 1604.04872, arXiv.org, revised Sep 2019.
    3. Li, Minqiang, 2010. "Asset Pricing - A Brief Review," MPRA Paper 22379, University Library of Munich, Germany.
    4. George M. Constantinides, 2006. "Market Organization And The Prices Of Financial Assets," Manchester School, University of Manchester, vol. 74(s1), pages 1-23, September.
    5. Luca De Gennaro Aquino & Xuedong He & Moris Simon Strub & Yuting Yang, 2024. "Reference-dependent asset pricing with a stochastic consumption-dividend ratio," Papers 2401.12856, arXiv.org.
    6. Borovička, Jaroslav & Stachurski, John, 2021. "Stability of equilibrium asset pricing models: A necessary and sufficient condition," Journal of Economic Theory, Elsevier, vol. 193(C).
    7. George M. Constantinides, 2002. "Rational Asset Prices," NBER Working Papers 8826, National Bureau of Economic Research, Inc.
    8. John Donaldson & Rajnish Mehra, 2007. "Risk Based Explanations of the Equity Premium," NBER Working Papers 13220, National Bureau of Economic Research, Inc.
    9. Knut K. Aase, 2016. "Recursive utility using the stochastic maximum principle," Quantitative Economics, Econometric Society, vol. 7(3), pages 859-887, November.
    10. Bakshi, Gurdip & Skoulakis, Georgios, 2010. "Do subjective expectations explain asset pricing puzzles?," Journal of Financial Economics, Elsevier, vol. 98(3), pages 462-477, December.
    11. Anisha Ghosh & Christian Julliard & Alex P. Taylor, 2017. "What Is the Consumption-CAPM Missing? An Information-Theoretic Framework for the Analysis of Asset Pricing Models," Review of Financial Studies, Society for Financial Studies, vol. 30(2), pages 442-504.
    12. Juan Carlos Parra‐Alvarez & Olaf Posch & Andreas Schrimpf, 2022. "Peso problems in the estimation of the C‐CAPM," Quantitative Economics, Econometric Society, vol. 13(1), pages 259-313, January.
    13. Gurdip Bakshi, 2009. "Du subjectiv expectations explain asset pricing puzzles?," 2009 Meeting Papers 1234, Society for Economic Dynamics.
    14. George M. Constantinides, 2002. "Rational Asset Prices," Journal of Finance, American Finance Association, vol. 57(4), pages 1567-1591, August.
    15. Rajnish Mehra, 2003. "The Equity Premium: Why is it a Puzzle?," NBER Working Papers 9512, National Bureau of Economic Research, Inc.
    16. George M. Constantinides, 2017. "Asset Pricing: Models and Empirical Evidence," Journal of Political Economy, University of Chicago Press, vol. 125(6), pages 1782-1790.
    17. Ludvigson, Sydney C., 2013. "Advances in Consumption-Based Asset Pricing: Empirical Tests," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 799-906, Elsevier.
    18. Jerry Tsai & Jessica A. Wachter, 2015. "Disaster Risk and its Implications for Asset Pricing," NBER Working Papers 20926, National Bureau of Economic Research, Inc.
    19. Committee, Nobel Prize, 2013. "Understanding Asset Prices," Nobel Prize in Economics documents 2013-1, Nobel Prize Committee.
    20. Rui Albuquerque & Martin Eichenbaum & Victor Xi Luo & Sergio Rebelo, 2016. "Valuation Risk and Asset Pricing," Journal of Finance, American Finance Association, vol. 71(6), pages 2861-2904, December.

    More about this item

    Keywords

    Dimension reduction; Johnson–Lindenstrauss; Bhattacharyya; Distance measure; Covariance; Distribution; Uncertainty;
    All these keywords.

    JEL classification:

    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory
    • C43 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Index Numbers and Aggregation
    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:536:y:2019:i:c:s0378437119305631. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.