New Neural Network Corresponding to the Evolution Process of the Brain
Issue:
Volume 7, Issue 1, June 2021
Pages:
1-6
Received:
21 January 2021
Accepted:
28 January 2021
Published:
9 February 2021
Abstract: In this paper, the logic is developed assuming that all parts of the brain are composed of a combination of modules that basically have the same structure. The fundamental function is the feeding behavior searching for food while avoiding the dangers. This is most necessary function of animals in the early stages of evolution and the basis of time series data processing. The module is presented by a neural network with learning capabilities based on Hebb's law and is called the basic unit. The basic units are placed on layers and the information between the layers is bidirectional. This new neural network is an extension of the traditional neural network that evolved from pattern recognition. The biggest feature is that in the process of processing time series data, the activated part in the neural network changes according to the context structure of the data. Predicts events from the context of learned behavior and selects best way. It is important to incorporate higher levels of intelligence such as learning, imitation functions furthermore long-term memory and object symbolization. A new neural network that deals the "descriptive world" that expresses past and future events to the neural network that deals the "real world" related to the familiar events is added. The scheme of neural network's function is shown using concept of category theory
Abstract: In this paper, the logic is developed assuming that all parts of the brain are composed of a combination of modules that basically have the same structure. The fundamental function is the feeding behavior searching for food while avoiding the dangers. This is most necessary function of animals in the early stages of evolution and the basis of time ...
Show More
Chaotic Recurrent Neural Networks for Financial Forecast
Issue:
Volume 7, Issue 1, June 2021
Pages:
7-14
Received:
2 February 2021
Accepted:
10 February 2021
Published:
23 February 2021
Abstract: In the past few decades, with the development of artificial intelligence and computer hardware, machine learning has been widely used in various applications including industrial, healthcare, education, finance, etc. Predicting financial time series sequences with effective AI tools for more accurate results has always been one of the hottest topics in finance and AI community. In this paper, the author introduces a new type of recurrent neural network algorithm, called Chaotic Recurrent Neural Network (CRNN), which is based on Dr. Raymond’s original research on Lee-Oscillator and Recurrent Neural Network (RNN) for worldwide financial prediction. We replaced the traditional activation function with a Lee Oscillator Neural Network, which not only can solve the vanishing gradient problem of traditional recurring neural networks during algorithm training, but can also provide an excellent memory correlation mechanism during long-term time series processing. The Experimental results reveal that CRNN outperforms than some popular neural network which widely applied to predict financial data, such as FFBPN, RNN, LSTM, in terms of forecast accuracy in certain cases. The experimental environment is based on Pytorch and Python 3.8, using 10 years (2010-2020) major financial index data, including DJI, HSI, IXIC, SPX, SSE, SZSE, APPL, to forecast 31th day closing price with previous 30 days closing price. Besides financial forecasting, our CRNN algorithm also has many potential applications, such as Natural Language Processing, weather forecasting, etc.
Abstract: In the past few decades, with the development of artificial intelligence and computer hardware, machine learning has been widely used in various applications including industrial, healthcare, education, finance, etc. Predicting financial time series sequences with effective AI tools for more accurate results has always been one of the hottest topic...
Show More
Early Stages of Automatic Speech Recognition (ASR) in Non-english Speaking Countries and Factors That Affect the Recognition Process
Issue:
Volume 7, Issue 1, June 2021
Pages:
15-22
Received:
22 April 2021
Accepted:
17 May 2021
Published:
31 May 2021
Abstract: There has been a considerable stream in ASR over the past few decades, but it may seem strange why this field is still a subject for researchers to work on. There are many reasons, but somewhat because the discipline is created with the promise of human-level performance under pragmatic states and this is an inextricable problem. In addition, the increasing advancement of technology in various fields has caused a more compelling need for this field. Especially the establishment of such a system in the security sector in insecure third world countries such as Afghanistan is an urgent need. This paper began with the reflection of all the necessary knowledge about speech recognition and then suggested an unprecedented method for building an automated speech recognition (ASR) system in the Dari language using the two most powerful open source engines CMUSphinx, from Carnegie Mellon University and DeepSpeech v0.9.3 /. These systems are much more impressive than early speech recognition systems. Using my own collected dataset, a speech-to-text model has been trained for the Dari language. Firstly, the dataset is filtered according to the task, then demonstrated the possible compatibility from the hidden Markov (HMM) models, the phoneme concept to RNN training. The system surpassed previously predicted results, as CMUSphinx stated, “for a typical 10-hour operation, the WER should be around 10%." Finally, 3.3% WER was achieved with 10.3-hours of audio recording using CMUSphinx. 1% WER with DeepSpeech.
Abstract: There has been a considerable stream in ASR over the past few decades, but it may seem strange why this field is still a subject for researchers to work on. There are many reasons, but somewhat because the discipline is created with the promise of human-level performance under pragmatic states and this is an inextricable problem. In addition, the i...
Show More