Yıl: 2023 Cilt: 31 Sayı: 2 Sayfa Aralığı: 462 - 480 Metin Dili: İngilizce DOI: 10.55730/1300-0632.3995 İndeks Tarihi: 12-06-2023

SPAYK: an environment for spiking neural network simulation

Öz:
In research areas such as mobile robotics and computer vision, energy and computational efficiency have become critical. This has greatly increased interest in high-efficiency neuromorphic hardware and spiking neural networks. Because neuromorphic hardware is not yet widely available, spiking neural network studies are conducted by simulations. There are numerous simulators available today, each designed for a specific purpose. In this paper, a novel and open- source package (SPAYK) for simulating spiking neural networks is presented. SPAYK has been proposed to speed up spiking neural network research. In the majority of simulators, networks are expressed with differential equations and require advanced neuroscience knowledge since such simulators are generally designed for brain and neuroscience research. SPAYK, on the other hand, is specifically designed as a framework to easily design spiking neural networks for practical problems. SPAYK is an easy-to-use Python package. There are three fundamental classes in the core: the model class for creating neuron groups, the organization class for simulating tissues, and the learning class for synaptic plasticity. While developing and testing the SPAYK environment, various experiments were carried out. This study includes three of these experiments. In the first experiment, we investigated the behavior of a group of Izhikevich neurons for visual stimuli. Also, a single Izhikevich neuron has been trained to respond to a particular label in a supervised manner with synaptic plasticity. In the second experiment, a well-known experiment was repeated to validate SPAYK. In this experiment, a neuron trained by synaptic plasticity can recognize repetitive patterns in a spike train. In the third experiment, a similar neuron was simulated with stimuli with multiple labels adapted from the MNIST dataset. It has been shown that the neuron can classify a particular label by synaptic plasticity. All these experiments and the SPAYK environment are presented as open-source tools.
Anahtar Kelime: Spiking neural network STDP based learning supervised classification unsupervised pattern recognition

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık
  • [1] Maass W. Networks of spiking neurons: The third generation of neural network models. Neural Networks 1997; 10 (9): 1659–1671. doi:10.1016/s0893-6080(97)00011-7
  • [2] Cao Z, Cheng L, Zhou C, Gu N, Wang X et al. Spiking neural network-based target tracking control for autonomous mobile robots. Neural Computing and Applications 2015; 26 (8): 1839–1847. doi:10.1007/s00521-015-1848-5
  • [3] Cheng X, Hao Y, Xu J, Xu B. LISNN: Improving spiking neural networks with lateral interactions for robust object recognition. In: Twenty-Ninth International Joint Conference on Artificial Intelligence; Yokohama, Japan; 2020. doi:10.24963/ijcai.2020/211
  • [4] Kim S, Park S, Na B, Yoon S. Spiking-YOLO: Spiking neural network for energy-efficient object detection. In: Proceedings of the AAAI Conference on Artificial Intelligence; New York, USA; 2020. pp. 11270–11277. doi:10.1609/aaai. v34i07.6787
  • [5] Wu J, Chua Y, Zhang M, Li H, Tan KC. A spiking neural network framework for robust sound classification. Frontiers in Neuroscience 2018;12 doi:10.3389/fnins.2018.00836
  • [6] Yan Z, Zhou J, Wong WF. Energy efficient ECG classification with spiking neural network. Biomedical Signal Processing and Control 2021; 63: 102170. doi:10.1016/j.bspc.2020.102170
  • [7] Tikidji-Hamburyan RA, Narayana V, Bozkus Z, El-Ghazawi TA. Software for brain network simulations: A comparative study. Frontiers in Neuroinformatics 2017;11 doi:10.3389/fninf.2017.00046
  • [8] Goodman D. Brian: a simulator for spiking neural networks in python. Frontiers in Neuroinformatics 2 2008; doi:10.3389/neuro.11.005.2008
  • [9] Gewaltig MO, Diesmann M. Nest (neural simulation tool). Scholarpedia 2007;2 (4) :1430
  • [10] Hines ML, Carnevale NT. Neuron: A tool for neuroscientists. The Neuroscientist 2001; (7): 123–135. doi:10.1177/107385840100700207
  • [11] Wilson MA, Bhalla US, Uhley JD, Bower JM. GENESIS: A System for Simulating Neural Networks. Morgan Kaufmann Publishers Inc. San Francisco, CA, USA: 1989, pp. 485–492.
  • [12] Chou TS, Kashyap HJ, Xing J, Listopad S, Rounds EL et al . CARLsim 4: An open source library for large scale, biologically detailed spiking neural network simulation using heterogeneous clusters. In: International Joint Conference on Neural Networks (IJCNN) 2018; doi:10.1109/ijcnn.2018.8489326
  • [13] Eliasmith C, Anderson CH. Neural Engineering (Computational Neuroscience Series): Computational Representa- tion and Dynamics in Neurobiological Systems. Cambridge, MA, USA: MIT Press, 2002.
  • [14] Bekolay T, Bergstra J, Hunsberger E, DeWolf T, Stewart TC et al. Nengo: a python tool for building large-scale functional brain models. Frontiers in Neuroinformatics 2014;7 doi:10.3389/fninf.2013.00048
  • [15] Vitay J, Dinkelbach HU, Hamker FH. ANNarchy: a code generation approach to neural simulations on parallel hardware. Frontiers in Neuroinformatics 2015;9 doi:10.3389/fninf.2015.00019
  • [16] Mozafari M, Ganjtabesh M, Nowzari-Dalini A, Masquelier T. SpykeTorch: Efficient simulation of convo- lutional spiking neural networks with at most one spike per neuron. Frontiers in Neuroscience 13 2019; doi:10.3389/fnins.2019.00625
  • [17] Fang W, Chen Y, Ding J, Chen D, Yu Z et al. Spikingjelly. https://github.com/fangwei123456/spikingjelly, accessed: 2022-11-01.
  • [18] Lee JH, Delbruck T, Pfeiffer M. Training deep spiking neural networks using backpropagation. Frontiers in Neuro- science 10 2016; doi:10.3389/fnins.2016.00508.18
  • [19] Neftci EO, Mostafa H, Zenke F. Surrogate gradient learning in spiking neural networks: Bringing the power of gradient-based optimization to spiking neural networks. IEEE Signal Processing Magazine 2019; 36 (6): 51–63. doi:10.1109/msp.2019.2931595
  • [20] Wang X, Lin X, Dang X. Supervised learning in spiking neural networks: A review of algorithms and evaluations. Neural Networks 2020;125 :258–280. doi:10.1016/j.neunet.2020.02.011
  • [21] Li X, Yi H, Luo S. Pattern recognition of spiking neural networks based on visual mechanism and supervised synaptic learning. Neural Plasticity 2020; 1–11. doi:10.1155/2020/8851351
  • [22] Liu J, Huo H, Hu W, Fang T. Brain-inspired hierarchical spiking neural network using unsupervised STDP rule for image classification. In: 10th International Conference on Machine Learning and Computing 2018; doi:10.1145/3195106.3195115
  • [23] Masquelier T, Guyonneau R, Thorpe SJ. Spike timing dependent plasticity finds the start of repeating patterns in continuous spike trains. PLoS ONE 2018;3 (1): e1377. doi:10.1371/journal.pone.0001377
  • [24] Hodgkin AL, Huxley AF. A quantitative description of membrane current and its application to conduction and excitation in nerve. The Journal of Physiology 1952;117 (4): 500–544. doi:10.1113/jphysiol.1952.sp004764
  • [25] Skocik MJ, Long LN. On the capabilities and computational costs of neuron models. IEEE Transactions on Neural Networks and Learning Systems 2015; 25 (8): 1474–1483. doi:10.1109/tnnls.2013.2294016
  • [26] Izhikevich E. Simple model of spiking neurons. IEEE Transactions on Neural Networks 2003;14 (6): 1569–1572. doi:10.1109/tnn.2003.820440
  • [27] Gerstner W, Kistler WM, Naud R, Paninski L. Neuronal Dynamics: From Single Neurons to Networks and Models of Cognition. Cambridge: Cambridge University Press, 2014. doi:10.1017/CBO9781107447615
  • [28] Gerstner W. Spike-response model. Scholarpedia 2018;3 (12): 1343. doi:10.4249/scholarpedia.1343
  • [29] Hebb DO. The organization of behavior: A neuropsychological theory. Brain Res Bull, New York, USA: Wiley, 1949.
APA Gelen A, Atasoy A (2023). SPAYK: an environment for spiking neural network simulation. , 462 - 480. 10.55730/1300-0632.3995
Chicago Gelen Aykut Görkem,Atasoy Ayten SPAYK: an environment for spiking neural network simulation. (2023): 462 - 480. 10.55730/1300-0632.3995
MLA Gelen Aykut Görkem,Atasoy Ayten SPAYK: an environment for spiking neural network simulation. , 2023, ss.462 - 480. 10.55730/1300-0632.3995
AMA Gelen A,Atasoy A SPAYK: an environment for spiking neural network simulation. . 2023; 462 - 480. 10.55730/1300-0632.3995
Vancouver Gelen A,Atasoy A SPAYK: an environment for spiking neural network simulation. . 2023; 462 - 480. 10.55730/1300-0632.3995
IEEE Gelen A,Atasoy A "SPAYK: an environment for spiking neural network simulation." , ss.462 - 480, 2023. 10.55730/1300-0632.3995
ISNAD Gelen, Aykut Görkem - Atasoy, Ayten. "SPAYK: an environment for spiking neural network simulation". (2023), 462-480. https://doi.org/10.55730/1300-0632.3995
APA Gelen A, Atasoy A (2023). SPAYK: an environment for spiking neural network simulation. Turkish Journal of Electrical Engineering and Computer Sciences, 31(2), 462 - 480. 10.55730/1300-0632.3995
Chicago Gelen Aykut Görkem,Atasoy Ayten SPAYK: an environment for spiking neural network simulation. Turkish Journal of Electrical Engineering and Computer Sciences 31, no.2 (2023): 462 - 480. 10.55730/1300-0632.3995
MLA Gelen Aykut Görkem,Atasoy Ayten SPAYK: an environment for spiking neural network simulation. Turkish Journal of Electrical Engineering and Computer Sciences, vol.31, no.2, 2023, ss.462 - 480. 10.55730/1300-0632.3995
AMA Gelen A,Atasoy A SPAYK: an environment for spiking neural network simulation. Turkish Journal of Electrical Engineering and Computer Sciences. 2023; 31(2): 462 - 480. 10.55730/1300-0632.3995
Vancouver Gelen A,Atasoy A SPAYK: an environment for spiking neural network simulation. Turkish Journal of Electrical Engineering and Computer Sciences. 2023; 31(2): 462 - 480. 10.55730/1300-0632.3995
IEEE Gelen A,Atasoy A "SPAYK: an environment for spiking neural network simulation." Turkish Journal of Electrical Engineering and Computer Sciences, 31, ss.462 - 480, 2023. 10.55730/1300-0632.3995
ISNAD Gelen, Aykut Görkem - Atasoy, Ayten. "SPAYK: an environment for spiking neural network simulation". Turkish Journal of Electrical Engineering and Computer Sciences 31/2 (2023), 462-480. https://doi.org/10.55730/1300-0632.3995