IDEAS home Printed from https://ideas.repec.org/p/osf/thesis/4j3fu.html
   My bibliography  Save this paper

A Discriminative Approach to Bayesian Filtering with Applications to Human Neural Decoding

Author

Listed:
  • Burkhart, Michael C.

Abstract

Given a stationary state-space model that relates a sequence of hidden states and corresponding measurements or observations, Bayesian filtering provides a principled statistical framework for inferring the posterior distribution of the current state given all measurements up to the present time. For example, the Apollo lunar module implemented a Kalman filter to infer its location from a sequence of earth-based radar measurements and land safely on the moon. To perform Bayesian filtering, we require a measurement model that describes the conditional distribution of each observation given state. The Kalman filter takes this measurement model to be linear, Gaussian. Here we show how a nonlinear, Gaussian approximation to the distribution of state given observation can be used in conjunction with Bayes’ rule to build a nonlinear, non-Gaussian measurement model. The resulting approach, called the Discriminative Kalman Filter (DKF), retains fast closed-form updates for the posterior. We argue there are many cases where the distribution of state given measurement is better-approximated as Gaussian, especially when the dimensionality of measurements far exceeds that of states and the Bernstein—von Mises theorem applies. Online neural decoding for brain-computer interfaces provides a motivating example, where filtering incorporates increasingly detailed measurements of neural activity to provide users control over external devices. Within the BrainGate2 clinical trial, the DKF successfully enabled three volunteers with quadriplegia to control an on-screen cursor in real-time using mental imagery alone. Participant “T9” used the DKF to type out messages on a tablet PC. Nonstationarities, or changes to the statistical relationship between states and measurements that occur after model training, pose a significant challenge to effective filtering. In brain-computer interfaces, one common type of nonstationarity results from wonkiness or dropout of a single neuron. We show how a robust measurement model can be used within the DKF framework to effectively ignore large changes in the behavior of a single neuron. At BrainGate2, a successful online human neural decoding experiment validated this approach against the commonly-used Kalman filter.

Suggested Citation

  • Burkhart, Michael C., 2019. "A Discriminative Approach to Bayesian Filtering with Applications to Human Neural Decoding," Thesis Commons 4j3fu, Center for Open Science.
  • Handle: RePEc:osf:thesis:4j3fu
    DOI: 10.31219/osf.io/4j3fu
    as

    Download full text from publisher

    File URL: https://osf.io/download/5e5495998d876501ff81120c/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/4j3fu?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. J. T. Chang & D. Pollard, 1997. "Conditioning as disintegration," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 51(3), pages 287-317, November.
    2. Rong Chen & Jun S. Liu, 2000. "Mixture Kalman filters," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(3), pages 493-508.
    3. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    4. Eric A Pohlmeyer & Babak Mahmoudi & Shijia Geng & Noeline W Prins & Justin C Sanchez, 2014. "Using Reinforcement Learning to Provide Stable Brain-Machine Interface Control Despite Neural Input Reorganization," PLOS ONE, Public Library of Science, vol. 9(1), pages 1-12, January.
    5. Maryam M. Shanechi & Amy L. Orsborn & Helene G. Moorman & Suraj Gowda & Siddharth Dangi & Jose M. Carmena, 2017. "Rapid control and feedback rates enhance neuroprosthetic control," Nature Communications, Nature, vol. 8(1), pages 1-10, April.
    6. J. C. Naylor & A. F. M. Smith, 1982. "Applications of a Method for the Efficient Computation of Posterior Distributions," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 31(3), pages 214-225, November.
    7. Mathieu Gerber & Nicolas Chopin, 2015. "Sequential quasi Monte Carlo," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 77(3), pages 509-579, June.
    8. Koyama, Shinsuke & Castellanos Pérez-Bolde, Lucia & Shalizi, Cosma Rohilla & Kass, Robert E., 2010. "Approximate Methods for State-Space Models," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 170-180.
    9. Liangliang Wang & Alexandre Bouchard-Côté & Arnaud Doucet, 2015. "Bayesian Phylogenetic Inference Using a Combinatorial Sequential Monte Carlo Method," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1362-1374, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    2. James M. Nason & Gregor W. Smith, 2021. "Measuring the slowly evolving trend in US inflation with professional forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(1), pages 1-17, January.
    3. Mengheng Li & Siem Jan Koopman, 2021. "Unobserved components with stochastic volatility: Simulation‐based estimation and signal extraction," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(5), pages 614-627, August.
    4. Nicolas Chopin & Mathieu Gerber, 2017. "Sequential quasi-Monte Carlo: Introduction for Non-Experts, Dimension Reduction, Application to Partly Observed Diffusion Processes," Working Papers 2017-35, Center for Research in Economics and Statistics.
    5. Karamé, Frédéric, 2018. "A new particle filtering approach to estimate stochastic volatility models with Markov-switching," Econometrics and Statistics, Elsevier, vol. 8(C), pages 204-230.
    6. Bhattacharya, Arnab & Wilson, Simon P., 2018. "Sequential Bayesian inference for static parameters in dynamic state space models," Computational Statistics & Data Analysis, Elsevier, vol. 127(C), pages 187-203.
    7. Gael M. Martin & David T. Frazier & Christian P. Robert, 2021. "Approximating Bayes in the 21st Century," Monash Econometrics and Business Statistics Working Papers 24/21, Monash University, Department of Econometrics and Business Statistics.
    8. Rimstad, Kjartan & Omre, Henning, 2013. "Approximate posterior distributions for convolutional two-level hidden Markov models," Computational Statistics & Data Analysis, Elsevier, vol. 58(C), pages 187-200.
    9. Crucinio, Francesca R. & Johansen, Adam M., 2023. "Properties of marginal sequential Monte Carlo methods," Statistics & Probability Letters, Elsevier, vol. 203(C).
    10. Frank Schorfheide & Dongho Song & Amir Yaron, 2018. "Identifying Long‐Run Risks: A Bayesian Mixed‐Frequency Approach," Econometrica, Econometric Society, vol. 86(2), pages 617-654, March.
    11. Golightly, Andrew & Bradley, Emma & Lowe, Tom & Gillespie, Colin S., 2019. "Correlated pseudo-marginal schemes for time-discretised stochastic kinetic models," Computational Statistics & Data Analysis, Elsevier, vol. 136(C), pages 92-107.
    12. Rutger Jan Lange, 2020. "Bellman filtering for state-space models," Tinbergen Institute Discussion Papers 20-052/III, Tinbergen Institute, revised 19 May 2021.
    13. Elmar Mertens & James M. Nason, 2020. "Inflation and professional forecast dynamics: An evaluation of stickiness, persistence, and volatility," Quantitative Economics, Econometric Society, vol. 11(4), pages 1485-1520, November.
    14. Duan, Jin-Chuan & Fulop, Andras & Hsieh, Yu-Wei, 2020. "Data-cloning SMC2: A global optimizer for maximum likelihood estimation of latent variable models," Computational Statistics & Data Analysis, Elsevier, vol. 143(C).
    15. Fulop, Andras & Li, Junye, 2019. "Bayesian estimation of dynamic asset pricing models with informative observations," Journal of Econometrics, Elsevier, vol. 209(1), pages 114-138.
    16. Johan Dahlin & Thomas B. Schon, 2015. "Getting Started with Particle Metropolis-Hastings for Inference in Nonlinear Dynamical Models," Papers 1511.01707, arXiv.org, revised Mar 2019.
    17. Pierre E. Jacob & John O’Leary & Yves F. Atchadé, 2020. "Unbiased Markov chain Monte Carlo methods with couplings," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(3), pages 543-600, July.
    18. Fabian Goessling, 2018. "Randomized Quasi Sequential Markov Chain Monte Carlo²," CQE Working Papers 7018, Center for Quantitative Economics (CQE), University of Muenster.
    19. repec:wyi:journl:002173 is not listed on IDEAS
    20. Bournakis, Ioannis & Tsionas, Mike G., 2023. "A Non-Parametric Estimation of Productivity with Idiosyncratic and Aggregate Shocks: The Role of Research and Development (R&D) and Corporate Tax," MPRA Paper 118100, University Library of Munich, Germany.
    21. Benjamin Christoffersen & David Lando & Søren Feodor Nielsen, 2022. "Estimating volatility in the Merton model: The KMV estimate is not maximum likelihood," Mathematical Finance, Wiley Blackwell, vol. 32(4), pages 1214-1230, October.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:thesis:4j3fu. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://thesiscommons.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.