| 3/2018 - 11 |
Implementation of High Speed Tangent Sigmoid Transfer Function Approximations for Artificial Neural Network Applications on FPGAKOYUNCU, I.   |
Extra paper information in    |
| Click to see author's profile in SCOPUS, IEEE Xplore, Web of Science |
Download PDF  (1,589 KB) | Citation | Downloads: 1,454 | Views: 3,655 |
Author keywords
real-time systems, field programmable gate arrays, artificial neural networks, approximation methods, transfer functions
References keywords
neural(15), fpga(9), chaotic(9), artificial(9), network(7), networks(6), implementation(6), hardware(4), computing(4)
Blue keywords are present in both the references section and the paper title.
About this article
Date of Publication: 2018-08-31
Volume 18, Issue 3, Year 2018, On page(s): 79 - 86
ISSN: 1582-7445, e-ISSN: 1844-7600
Digital Object Identifier: 10.4316/AECE.2018.03011
Web of Science Accession Number: 000442420900011
SCOPUS ID: 85052056771
Abstract
Tangent Sigmoid (TanSig) Transfer Function (TSTF) is one of the nonlinear functions used in Artificial Neural Networks (ANNs). As TSTF includes exponential function operations, hardware-based implementation of this function is difficult. Thus, various methods have been proposed in the literature for the hardware implementation of TSTF. In this study, four different TSTF approaches on FPGA have been implemented using 32-bit IEEE 7541985 floating point number standard, and their performance analyses and FPGA chip statistics are presented. The Van der Pol system ANN application was carried out using four different FPGA-based TSTF units presented. The Multilayer feed-forward neural network structure was used in the study. The FPGA chip statistics and sensitivity analyses were carried out by applying each TSTF structure to the exemplary ANN. The maximum operating frequency of ANNs designed on FPGA using the four different TSTF units varied between 184362 MHz. The CORDIC-LUT-based ANN on FPGA was able to calculate 1 billion results in 3.284 s. According to the Van der Pol system ANN application carried out on FPGA, the CORDIC-LUT-based approach most closely reflected the reference ANN results. This study has a reference and key research for real-time artificial neural network applications used of tangent sigmoid one of the nonlinear transfer functions. |
| References | | | Cited By «-- Click to see who has cited this paper |
| [1] O. Geman, H. Costin, "Automatic Assessing of Tremor Severity Using Nonlinear Dynamics, Artificial Neural Networks and Neuro-Fuzzy Classifier," Advances in Electrical and Computer Engineering, vol. 14(1), pp. 133-138. 2014. [CrossRef] [Full Text] [Web of Science Times Cited 28] [SCOPUS Times Cited 28] [2] E. Betiku, A. E. Taiwo, "Modeling and optimization of bioethanol production from breadfruit starch hydrolyzate response surface methodology and artificial neural network," Renewable Energy, In vivo thermography-based image for early detection of breast cancer using two-tier segmentation algorithm and artificial neural network vol. 74, pp. 87-94, 2015. [CrossRef] [Web of Science Times Cited 148] [SCOPUS Times Cited 171] [3] M. Alcin, I. Pehlivan, I. Koyuncu, "Hardware design and implementation of a novel ANN-based chaotic generator in FPGA," Optik-International Journal for Light and Electron Optics, vol. 127, pp. 5500-5505, 2016. [CrossRef] [Web of Science Times Cited 60] [SCOPUS Times Cited 78] [4] W. Zang, X. Liu, W. Bi, "An artificial neural network classification model based on DNA computing," Human Centered Computing Lecture Notes in Computer Science, vol. 8944, pp. 880-889, 2015. [CrossRef] [Web of Science Times Cited 1] [SCOPUS Times Cited 3] [5] G. Zhang, Y. Shen, "Exponential synchronization of delayed memristor-based chaotic neural networks via periodically intermittent control," Neural Networks, vol. 55, pp. 1-10, 2014. [CrossRef] [Web of Science Times Cited 214] [SCOPUS Times Cited 231] [6] M. Tuna, C. B. Fidan, "A Study on the importance of chaotic oscillators based on FPGA for true random number generating (TRNG) and chaotic systems," Journal of the Faculty of Engineering and Architecture of Gazi University, vol. 33, pp. 469-486, 2018. [CrossRef] [SCOPUS Times Cited 24] [7] S. Roy, R. Banerjee, P. K. Bose, "Performance and exhaust emissions prediction of a CRDI assisted single cylinder diesel engine coupled with EGR using artificial neural network," Applied Energy, vol. 119, pp. 330-340, 2014. [CrossRef] [Web of Science Times Cited 183] [SCOPUS Times Cited 209] [8] M. Alcin, I. Pehlivan, I. Koyuncu, "The Performance Analysis of Artificial Neural Network Based Shimizu-Morioka Chaotic System with Respect to Sample Numbers," Balkan Journal of Electrical and Computer Engineering, vol. 3(4), pp. 252-255, 2015. [CrossRef] [9] M. Tuna, C. B. Fidan, "Electronic circuit design, implementation and FPGA-based realization of a new 3D chaotic system with single equilibrium point," Optik-International Journal for Light and Electron Optics, vol. 127(24), pp. 11786-11799, 2016. [CrossRef] [Web of Science Times Cited 43] [SCOPUS Times Cited 50] [10] A. Melnyk, V. Melnyk, "Self-Configurable FPGA-Based Computer Systems," Advances in Electrical and Computer Engineering, vol. 13(2), pp. 33-38. 2013. [CrossRef] [Full Text] [Web of Science Times Cited 10] [SCOPUS Times Cited 19] [11] M. Tuna, I. Koyuncu, C. B. Fidan, I. Pehlivan, "Real time implementation of a novel chaotic generator on FPGA," 23nd Signal Processing and Communications Applications Conference (SIU), pp. 698-701, 2015. [CrossRef] [SCOPUS Times Cited 11] [12] I. Koyuncu, A. T. Ozcerit, "The design and realization of a new high speed FPGA-based chaotic true random number generator," Computers and Electrical Engineering, vol. 58, pp. 203-214, 2017. [CrossRef] [Web of Science Times Cited 74] [SCOPUS Times Cited 83] [13] M. A. Cavuslu, C. Karakuzu, S. Sahin, M. Yakut, "Neural network training based on FPGA with floating point number format and it's performance," Neural Computing and Applications, vol. 20, pp. 195-202, 2011. [CrossRef] [Web of Science Times Cited 23] [SCOPUS Times Cited 27] [14] A. Saad, K. Hany, A. Amin, "Three-dimensional turbulent swirling flow reconstruction using artificial neural networks," Journal of Mechanical Engineering and Automation, vol. 4, pp. 1-9, 2014. [CrossRef] [15] S. Brezetskyi, D. Dudkowski, T. Kapitaniak, "Rare and hidden attractors in Van der Pol-Duffing oscillators," The European Physical Journal Special Topics, vol. 224, pp. 1459-1467, 2015. [CrossRef] [Web of Science Times Cited 85] [SCOPUS Times Cited 95] [16] D. Suzuki, M. Natsui, A. Mochizuki, S. Miura, H. Honjo, H. Sato, S. Fukami, S. Ikeda, T. Endoh, H. Ohno, T. Hanyu, "Fabrication of a 3000-6-input-LUTs embedded and block-level power-gated nonvolatile FPGA chip using p-MTJ-based logic-in-memory structure," IEEE Symposium on VLSI Circuits Digest of Technical Paper, pp. 172-173, 2015. [CrossRef] [SCOPUS Times Cited 33] [17] P. Nilsson, A. U. R. Shaik, Gangarajaiah R., Hertz E., "Hardware implementation of the exponential function using Taylor series," 32nd NORCHIP Conference, pp. 1-4, 2014. [CrossRef] [SCOPUS Times Cited 55] [18] I. Koyuncu, I. Sahin, C. Gloster, N. K. Saritekin, "A Neuron Library for Rapid Realization of Artificial Neural Networks on FPGA: A Case Study of Rossler Chaotic System," Journal of Circuits, Systems and Computers, vol. 26(01), pp. 1750015, 2017. [CrossRef] [Web of Science Times Cited 21] [SCOPUS Times Cited 22] [19] V. Tiwari, N. Khare, "Hardware implementation of neural network with sigmoidal activation functions using CORDIC," Microprocessors and Microsyststems, vol. 39, pp. 373-381, 2015. [CrossRef] [Web of Science Times Cited 45] [SCOPUS Times Cited 58] [20] D. Baptista, D. F. Morgado, "Low-resource hardware implementation of the hyperbolic tangent for artificial neural networks," Neural Computing and Applications, vol. 23, pp. 601-607, 2013. [CrossRef] [Web of Science Times Cited 20] [SCOPUS Times Cited 19] Web of Science® Citations for all references: 955 TCR SCOPUS® Citations for all references: 1,216 TCR Web of Science® Average Citations per reference: 45 ACR SCOPUS® Average Citations per reference: 58 ACR TCR = Total Citations for References / ACR = Average Citations per Reference We introduced in 2010 - for the first time in scientific publishing, the term "References Weight", as a quantitative indication of the quality ... Read more Citations for references updated on 2024-12-16 11:59 in 146 seconds. Note1: Web of Science® is a registered trademark of Clarivate Analytics. Note2: SCOPUS® is a registered trademark of Elsevier B.V. Disclaimer: All queries to the respective databases were made by using the DOI record of every reference (where available). Due to technical problems beyond our control, the information is not always accurate. Please use the CrossRef link to visit the respective publisher site. |
Copyright ©2001-2024
Faculty of Electrical Engineering and Computer Science
Stefan cel Mare University of Suceava, Romania
All rights reserved: Advances in Electrical and Computer Engineering is a registered trademark of the Stefan cel Mare University of Suceava. No part of this publication may be reproduced, stored in a retrieval system, photocopied, recorded or archived, without the written permission from the Editor. When authors submit their papers for publication, they agree that the copyright for their article be transferred to the Faculty of Electrical Engineering and Computer Science, Stefan cel Mare University of Suceava, Romania, if and only if the articles are accepted for publication. The copyright covers the exclusive rights to reproduce and distribute the article, including reprints and translations.
Permission for other use: The copyright owner's consent does not extend to copying for general distribution, for promotion, for creating new works, or for resale. Specific written permission must be obtained from the Editor for such copying. Direct linking to files hosted on this website is strictly prohibited.
Disclaimer: Whilst every effort is made by the publishers and editorial board to see that no inaccurate or misleading data, opinions or statements appear in this journal, they wish to make it clear that all information and opinions formulated in the articles, as well as linguistic accuracy, are the sole responsibility of the author.
Faculty of Electrical Engineering and Computer Science
Stefan cel Mare University of Suceava, Romania
All rights reserved: Advances in Electrical and Computer Engineering is a registered trademark of the Stefan cel Mare University of Suceava. No part of this publication may be reproduced, stored in a retrieval system, photocopied, recorded or archived, without the written permission from the Editor. When authors submit their papers for publication, they agree that the copyright for their article be transferred to the Faculty of Electrical Engineering and Computer Science, Stefan cel Mare University of Suceava, Romania, if and only if the articles are accepted for publication. The copyright covers the exclusive rights to reproduce and distribute the article, including reprints and translations.
Permission for other use: The copyright owner's consent does not extend to copying for general distribution, for promotion, for creating new works, or for resale. Specific written permission must be obtained from the Editor for such copying. Direct linking to files hosted on this website is strictly prohibited.
Disclaimer: Whilst every effort is made by the publishers and editorial board to see that no inaccurate or misleading data, opinions or statements appear in this journal, they wish to make it clear that all information and opinions formulated in the articles, as well as linguistic accuracy, are the sole responsibility of the author.
