IDEAS home Printed from https://ideas.repec.org/a/spr/jglopt/v82y2022i4d10.1007_s10898-021-01042-x.html
   My bibliography  Save this article

A binary search algorithm for univariate data approximation and estimation of extrema by piecewise monotonic constraints

Author

Listed:
  • Ioannis C. Demetriou

    (National and Kapodistrian University of Athens)

Abstract

The piecewise monotonic approximation problem makes the least changes to n univariate noisy data so that the piecewise linear interpolant to the new values is composed of at most k monotonic sections. The term “least changes” is defined in the sense of a global sum of strictly convex functions of changes. The main difficulty in this calculation is that the extrema of the interpolant have to be found automatically, but the number of all possible combinations of extrema can be $${\mathcal {O}}(n^{k-1})$$ O ( n k - 1 ) , which makes not practicable to test each one separately. It is known that the case $$k=1$$ k = 1 is straightforward, and that the case $$k>1$$ k > 1 reduces to partitioning the data into at most k disjoint sets of adjacent data and solving a $$k=1$$ k = 1 problem for each set. Some ordering relations of the extrema are studied that establish three quite efficient algorithms by using a binary search method for partitioning the data. In the least squares case the total work is only $${\mathcal {O}}(n \sigma +k\sigma \log _2\sigma )$$ O ( n σ + k σ log 2 σ ) computer operations when $$k \ge 3$$ k ≥ 3 and is only $${\mathcal {O}}(n)$$ O ( n ) when $$k=1$$ k = 1 or 2, where $$\sigma -2$$ σ - 2 is the number of sign changes in the sequence of the first differences of the data. Fortran software has been written for this case and the numerical results indicate superior performance to existing algorithms. Some examples with real data illustrate the method. Many applications of the method arise from bioinformatics, energy, geophysics, medical imaging, and peak finding in spectroscopy, for instance.

Suggested Citation

  • Ioannis C. Demetriou, 2022. "A binary search algorithm for univariate data approximation and estimation of extrema by piecewise monotonic constraints," Journal of Global Optimization, Springer, vol. 82(4), pages 691-726, April.
  • Handle: RePEc:spr:jglopt:v:82:y:2022:i:4:d:10.1007_s10898-021-01042-x
    DOI: 10.1007/s10898-021-01042-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10898-021-01042-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10898-021-01042-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wenyu Sun & Ya-Xiang Yuan, 2006. "Optimization Theory and Methods," Springer Optimization and Its Applications, Springer, number 978-0-387-24976-6, September.
    2. Ioannis C. Demetriou, 2019. "A Decomposition Theorem for the Least Squares Piecewise Monotonic Data Approximation Problem," Springer Optimization and Its Applications, in: Ioannis C. Demetriou & Panos M. Pardalos (ed.), Approximation and Optimization, pages 119-134, Springer.
    3. Davies, Laurie & Höhenrieder, Christian & Krämer, Walter, 2012. "Recursive computation of piecewise constant volatilities," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3623-3631.
    4. Vassiliou, E. & Demetriou, I.C., 2005. "An adaptive algorithm for least squares piecewise monotonic data fitting," Computational Statistics & Data Analysis, Elsevier, vol. 49(2), pages 591-609, April.
    5. Nelson, Charles R. & Plosser, Charles I., 1982. "Trends and random walks in macroeconmic time series : Some evidence and implications," Journal of Monetary Economics, Elsevier, vol. 10(2), pages 139-162.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kandil, Magda & Woods, Jeffrey G., 1995. "A cross-industry examination of the Lucas misperceptions model," Journal of Macroeconomics, Elsevier, vol. 17(1), pages 55-76.
    2. Herrera, Santiago, 2000. "Determinantes y composición del endeudamiento público en Colombia," IDB Publications (Working Papers) 2110, Inter-American Development Bank.
    3. Antoine d'Autume, 1992. "Coïntégration et modèles dynamiques," Économie et Prévision, Programme National Persée, vol. 106(5), pages 71-83.
    4. John Barkoulas & Christopher Baum & Mustafa Caglayan, 1999. "Fractional monetary dynamics," Applied Economics, Taylor & Francis Journals, vol. 31(11), pages 1393-1400.
    5. Manuel Gonzalez-Astudillo & John M. Roberts, 2016. "When Can Trend-Cycle Decompositions Be Trusted?," Finance and Economics Discussion Series 2016-099, Board of Governors of the Federal Reserve System (U.S.).
    6. Cem Ertur & Antonio Musolesi, 2017. "Weak and Strong Cross‐Sectional Dependence: A Panel Data Analysis of International Technology Diffusion," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(3), pages 477-503, April.
    7. Heinemann, Friedrich, 1994. "Central Europe and European monetary integration: a strategy for catching up," ZEW Discussion Papers 94-21, ZEW - Leibniz Centre for European Economic Research.
    8. Froyen, Richard T & Waud, Roger N, 1988. "Real Business Cycles and the Lucas Paradigm," Economic Inquiry, Western Economic Association International, vol. 26(2), pages 183-201, April.
    9. Apostolos Serletis & Ricardo Rangel-Ruiz, 2007. "Testing for Common Features in North American Energy Markets," World Scientific Book Chapters, in: Quantitative And Empirical Analysis Of Energy Markets, chapter 14, pages 172-187, World Scientific Publishing Co. Pte. Ltd..
    10. Rocha, Roberto de Rezende, 1991. "Inflation and stabilization in Yugoslavia," Policy Research Working Paper Series 752, The World Bank.
    11. J.P.G. Reijnders, 2007. "Impulse or propagation? How the tides turned in Business Cycle Theory," Working Papers 07-07, Utrecht School of Economics.
    12. Steven Cook, 2008. "More uncertainty: on the trending nature of real GDP in the US and UK," Applied Economics Letters, Taylor & Francis Journals, vol. 15(9), pages 667-670.
    13. Mehdi Abid & Rafaa Mraihi, 2015. "Energy Consumption and Industrial Production: Evidence from Tunisia at Both Aggregated and Disaggregated Levels," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 6(4), pages 1123-1137, December.
    14. Michelacci, Claudio & Zaffaroni, Paolo, 2000. "(Fractional) beta convergence," Journal of Monetary Economics, Elsevier, vol. 45(1), pages 129-153, February.
    15. Brittle, Shane, 2009. "Ricardian Equivalence and the Efficacy of Fiscal Policy in Australia," Economics Working Papers wp09-10, School of Economics, University of Wollongong, NSW, Australia.
    16. Marin, Dalia, 1992. "Is the Export-Led.Growth Hypothesis Valid for Industrialized Countries?," The Review of Economics and Statistics, MIT Press, vol. 74(4), pages 678-688, November.
    17. Tang, Chor Foon & Tan, Eu Chye, 2015. "Does tourism effectively stimulate Malaysia's economic growth?," Tourism Management, Elsevier, vol. 46(C), pages 158-163.
    18. Yong Glasure & Aie-Rie Lee & James Norris, 1999. "Level of economic development and political democracy revisited," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 5(4), pages 466-477, November.
    19. Mingotti, Nicola & Lillo Rodríguez, Rosa Elvira & Romo, Juan, 2015. "A Random Walk Test for Functional Time Series," DES - Working Papers. Statistics and Econometrics. WS ws1506, Universidad Carlos III de Madrid. Departamento de Estadística.
    20. Olivier J. Blanchard & Mark W. Watson, 1986. "Are Business Cycles All Alike?," NBER Chapters, in: The American Business Cycle: Continuity and Change, pages 123-180, National Bureau of Economic Research, Inc.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jglopt:v:82:y:2022:i:4:d:10.1007_s10898-021-01042-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.