IJIS  Vol.5 No.2 , January 2015
Modeling Neuromorphic Persistent Firing Networks
ABSTRACT
Neurons are believed to be the brain computational engines of the brain. A recent discovery in neurophysiology reveals that interneurons can slowly integrate spiking, share the output across a coupled network of axons and respond with persistent firing even in the absence of input to the soma or dendrites, which has not been understood and could be very important for exploring the mechanism of human cognition. The conventional models are incapable of simulating the important newly-discovered phenomenon of persistent firing induced by axonal slow integration. In this paper, we propose a computationally efficient model of neurons through modeling the axon as a slow leaky integrator, which captures almost all-known neural behaviors. The model controls the switching of axonal firing dynamics between passive conduction mode and persistent firing mode. The interplay between the axonal integrated potential and its multiple thresholds in axon precisely determines the persistent firing dynamics of neurons. We also present a persistent firing polychronous spiking network which exhibits asynchronous dynamics indicating that this computationally efficient model is not only bio-plausible, but also suitable for large scale spiking network simulations. The implications of this network and the analog circuit design for exploring the relationship between working memory and persistent firing enable developing a spiking network-based memory and bio-inspired computer systems.

Cite this paper
Ning, N. , Li, G. , He, W. , Huang, K. , Pan, L. , Ramanathan, K. , Zhao, R. and Shi, L. (2015) Modeling Neuromorphic Persistent Firing Networks. International Journal of Intelligence Science, 5, 89-101. doi: 10.4236/ijis.2015.52009.
References
[1]   Lapicque, L. (1907) Recherches quantitatives sur l’excitation electrique des nerfs traitee comme une polarization. Journal of Physiol Pathol Générale, 9, 620-635.

[2]   Sandberg, A. and Bostrom, N. (2008) Whole Brain Emulation: A Roadmap. Future of Humanity Institute, Oxford University, Technical Report #2008-3.

[3]   Hodgkin, A.L. and Huxley, A.F. (1952) A Quantitative Description of Membrane Current and Its Application to Conduction and Excitation in Nerve. The Journal of Physiology, 117, 500-544.
http://dx.doi.org/10.1113/jphysiol.1952.sp004764

[4]   Brette, R., Rudolph, M., Carnevale, T., Hines, M., Beeman, D., Bower, J.M., Diesmann, M., Morrison, A., Goodman, P.H., Harris Jr., F.C, et al. (2007) Simulation of Networks of Spiking Neurons: A Review of Tools and Strategies. Journal of Computational Neuroscience, 23, 349-398.
http://dx.doi.org/10.1007/s10827-007-0038-6

[5]   Mihalas, S. and Niebur, E. (2009) A Generalized Linear Integrate-and-Fire Neural Model Produces Diverse Spiking Behaviors. Neural Computation, 21, 704-718.
http://dx.doi.org/10.1162/neco.2008.12-07-680

[6]   Fitzhugh, R. (1961) Impulses and Physiological States in Theoretical Models of Nerve Membrane. Biophysical Journal, 1, 445-466.
http://dx.doi.org/10.1016/S0006-3495(61)86902-6

[7]   Morris, C. and Lecar, H. (1981) Voltage Oscillations in the Barnacle Giant Muscle Fiber. Biophysical Journal, 35, 193-213.
http://dx.doi.org/10.1016/S0006-3495(81)84782-0

[8]   Rose, R.M. and Hindmarsh, J.L. (1989) The Assembly of Ionic Currents in a Thalamic Neuron I. The Three-Dimensional Model. Proceedings of the Royal Society of London. Series B. Biological Sciences, 237, 267-288.
http://dx.doi.org/10.1098/rspb.1989.0049

[9]   Wilson, H.R. (1999) Simplified Dynamics of Human and Mammalian Neocortical Neurons. Journal of Theoretical Biology, 200, 375-388.
http://dx.doi.org/10.1006/jtbi.1999.1002

[10]   Izhikevich, E.M. (2001) Resonate-and-Fire Neurons. Neural Networks, 14, 883-894.
http://dx.doi.org/10.1016/S0893-6080(01)00078-8

[11]   Izhikevich, E.M. (2003) Simple Model of Spiking Neurons. IEEE Transactions on Neural Networks, 14, 1569-1572.
http://dx.doi.org/10.1109/TNN.2003.820440

[12]   Sheffield, M.E.J., Best, T.K., Mensh, B.D., Kath, W.L. and Spruston, N. (2011) Slow Integration Leads to Persistent Action Potential Firing in Distal Axons of Coupled Interneurons. Nature Neuroscience, 14, 200-207.
http://dx.doi.org/10.1038/nn.2728

[13]   Izhikevich, E.M. (2006) Polychronization: Computation with Spikes. Neural Computation, 18, 245-282.
http://dx.doi.org/10.1162/089976606775093882

[14]   Ning, N., Yi, K.J., Huang, K.J. and Shi, L.P. (2011) Axonal Slow Integration Induced Persistent Firing Neuron Model. Lecture Notes in Computer Science, 7062, 469-476.
http://dx.doi.org/10.1007/978-3-642-24955-6_56

[15]   Izhikevich, E.M. (2007) Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting. The MIT Press, Cambridge.

[16]   Wijekoon, J.H. and Dudek, P. (2008) Compact Silicon Neuron Circuit with Spiking and Bursting Behaviour. Neural Networks, 21, 524-534.
http://dx.doi.org/10.1016/j.neunet.2007.12.037

[17]   Wijekoon, J.H. and Dudek, P. (2008) Integrated Circuit Implementation of a Cortical Neuron. Proceedings of the IEEE International Symposium on Circuits and Systems, Seattle, 18-21 May 2008, 1784-1787.

[18]   Swadlow, H.A. (1985) Physiological Properties of Individual Cerebral Axons Studied in Vivo for as Long as One Year. Journal of Neurophysiology, 54, 1346-1362.

[19]   Song, S., Miller, K.D. and Abbott, L.F. (2000) Competitive Hebbian Learning through Spike-Timing-Dependent Synaptic Plasticity. Nature Neuroscience, 3, 919-926.
http://dx.doi.org/10.1038/78829

[20]   Bartos, M., Vida, I. and Jonas, P. (2007) Synaptic Mechanisms of Synchronized Gamma Oscillations in Inhibitory Interneuron Networks. Nature Reviews Neuroscience, 8, 45-56.
http://dx.doi.org/10.1038/nrn2044

[21]   Baddeley, A. (1992) Working Memory. Science, 255, 556-559.
http://dx.doi.org/10.1126/science.1736359

[22]   Durstewitz, D., Seamans, J.K. and Sejnowski, T.J. (2000) Neurocomputational Models of Working Memory. Nature Neuroscience, 3, 1184-1191.
http://dx.doi.org/10.1038/81460

[23]   Egorov, A.V., Hamam, B.N., Fransen, E., Hasselmo, M.E. and Alonso, A.A. (2002) Graded Persistent Activity in Entorhinal Cortex Neurons. Nature, 420, 173-178.
http://dx.doi.org/10.1038/nature01171

[24]   Miller, G.A. (1956) The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. Psychological Review, 63, 81-97.
http://dx.doi.org/10.1037/h0043158

[25]   D’Esposito, M., Detre, J.A., Alsop, D.C., Shin, R.K., Atlas, S. and Grossman, M. (1995) The Neural Basis of the Central Executive System of Working Memory. Nature, 378, 279-281.
http://dx.doi.org/10.1038/378279a0

[26]   Goldman-Rakic, P.S. (1995) Cellular Basis of Working Memory. Neuron, 14, 477-485.
http://dx.doi.org/10.1016/0896-6273(95)90304-6

[27]   Miller, E.K., Erickson, C.A. and Desimone, R. (1996) Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque. The Journal of Neuroscience, 16, 5154-5167.

[28]   Amit, D. and Mongillo, G. (2003) Spike-Driven Synaptic Dynamics Generating Working Memory States. Neural Computation, 15, 565-596.
http://dx.doi.org/10.1162/089976603321192086

[29]   O’Reilly, R.C. and Frank, M.J. (2006) Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia. Neural Computation, 18, 283-328.
http://dx.doi.org/10.1162/089976606775093909

[30]   Szatmary, B. and Izhikevich, E.M. (2010) Spike-Timing Theory of Working Memory. PLoS Computational Biology, 6, e1000879.
http://dx.doi.org/10.1371/journal.pcbi.1000879

[31]   Ramanathan, K., Ning, N., Dhanasekar, D., Li, G., Shi, L.P. and Vadakkepat, P. (2012) Presynaptic Learning and Memory with a Persistent Firing Neuron and a Habituating Synapse: A Model of Short Term Persistent Habituation. International Journal of Neural Systems, 22, Article ID: 1250015. http://dx.doi.org/10.1142/S0129065712500153

[32]   Shi, L.P., Yi, K.J., Ramanathan, K., Zhao, R., Ning, N., Ding, D. and Chong, T.C. (2011) Artificial Cognitive Memory—Changing from Density Driven to Functionality Driven. Applied Physics A, 102, 865-875.
http://dx.doi.org/10.1007/s00339-011-6297-0

[33]   Ning, N., Huang, K.J. and Shi, L.P. (2012) Artificial Neuron with Somatic and Axonal Computation Units: Mathematical and Neuromorphic Models of Persistent Firing Neurons. Proceedings of the 2012 International Joint Conference on Neural Networks (IJCNN), Brisbane, 10-15 June 2012, 1-7.

[34]   van Schaik, A., Jin, C., McEwan, A. and Hamilton, T.J. (2010) A Log-Domain Implementation of the Izhikevich Neuron Model. Proceedings of 2010 IEEE International Symposium on Circuits and Systems (ISCAS), Paris, 30 May-2 June 2010, 4253-4256.

[35]   Li, G.Q., Ning, N., Ramanathan, K., Wei, H., Pan, L. and Shi, L.P. (2013) Behind the Magical Numbers: Hierarchical Chunking and the Human Working Memory Capacity. International Journal of Neural Systems, 23, Article ID: 1350019.
http://dx.doi.org/10.1142/S0129065713500196

[36]   Li, G.Q., Wen, C.Y., Li, Z.G., Zhang, A.M., Yang, F. and Mao, K.Z. (2013) Model-Based Online Learning with Kernels. IEEE Transactions on Neural Networks and Learning Systems, 24, 356-369.
http://dx.doi.org/10.1109/TNNLS.2012.2229293

 
 
Top