Journal of Bionic Engineering ›› 2022, Vol. 19 ›› Issue (5): 1504-1521.doi: 10.1007/s42235-022-00216-x

• • 上一篇    下一篇

An Efficient Hybrid Model Based on Modified Whale Optimization Algorithm and Multilayer Perceptron Neural Network for Medical Classification Problems

Saeid Raziani1, Sajad Ahmadian2, Seyed Mohammad Jafar Jalali3, Abdolah Chalechale1   

  1. 1 Department of Computer Engineering, Razi University, Kermanshah 6714414971, Iran  2 Faculty of Information Technology, Kermanshah University of Technology, Kermanshah 6715685420, Iran  3 Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Waurn Ponds, Melbourne 3217, Australia
  • 收稿日期:2021-06-21 修回日期:2022-04-22 接受日期:2022-04-26 出版日期:2022-09-10 发布日期:2022-09-25
  • 通讯作者: Saeid Raziani, Sajad Ahmadian, Seyed Mohammad Jafar Jalali & Abdolah Chalechale E-mail:s.ahmadian@kut.ac.ir, saeidraziani@gmail.com, sjalali@deakin.edu.au, chalechale@razi.ac.ir
  • 作者简介:Saeid Raziani1, Sajad Ahmadian2, Seyed Mohammad Jafar Jalali3, Abdolah Chalechale1

An Efficient Hybrid Model Based on Modified Whale Optimization Algorithm and Multilayer Perceptron Neural Network for Medical Classification Problems

Saeid Raziani1, Sajad Ahmadian2, Seyed Mohammad Jafar Jalali3, Abdolah Chalechale1   

  1. 1 Department of Computer Engineering, Razi University, Kermanshah 6714414971, Iran  2 Faculty of Information Technology, Kermanshah University of Technology, Kermanshah 6715685420, Iran  3 Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Waurn Ponds, Melbourne 3217, Australia
  • Received:2021-06-21 Revised:2022-04-22 Accepted:2022-04-26 Online:2022-09-10 Published:2022-09-25
  • Contact: Saeid Raziani, Sajad Ahmadian, Seyed Mohammad Jafar Jalali & Abdolah Chalechale E-mail:s.ahmadian@kut.ac.ir, saeidraziani@gmail.com, sjalali@deakin.edu.au, chalechale@razi.ac.ir
  • About author:Saeid Raziani1, Sajad Ahmadian2, Seyed Mohammad Jafar Jalali3, Abdolah Chalechale1

摘要: Feedforward Neural Network (FNN) is one of the most popular neural network models that is utilized to solve a wide range of nonlinear and complex problems. Several models such as stochastic gradient descent have been developed to train FNNs. However, they mainly suffer from falling into local optima leading to reduce the accuracy of FNNs. Moreover, the convergence speed of training process depends on the initial values of weights and biases in FNNs. Generally, these values are randomly determined by most of the training models. To deal with these issues, in this paper, we develop a novel evolutionary algorithm by modifying the original version of Whale Optimization Algorithm (WOA). To this end, a nonlinear function is introduced to improve the exploration and exploitation phases in the search process of WOA. Then, the modified WOA is applied to automatically obtain the initial values of weights and biases in FNN leading to reduce the probability of falling into local optima. In addition, the FNN model trained by the modified WOA is used to develop a classification approach for medical diagnosis problems. Ten medical diagnosis datasets are utilized to evaluate the efficiency of the proposed method. Also, four evaluation metrics including accuracy, AUC, specificity, and sensitivity are used in the experiments to compare the performance of classification models. The experimental results demonstrate that the proposed method is better than other competing classification models due to achieving higher values of accuracy, AUC, specificity, and sensitivity metrics for the used datasets.

关键词: Feed forward neural network , · Meta-heuristic algorithm , · Whale optimization algorithm , · Optimization , · Classification , · Bionic algorithm

Abstract: Feedforward Neural Network (FNN) is one of the most popular neural network models that is utilized to solve a wide range of nonlinear and complex problems. Several models such as stochastic gradient descent have been developed to train FNNs. However, they mainly suffer from falling into local optima leading to reduce the accuracy of FNNs. Moreover, the convergence speed of training process depends on the initial values of weights and biases in FNNs. Generally, these values are randomly determined by most of the training models. To deal with these issues, in this paper, we develop a novel evolutionary algorithm by modifying the original version of Whale Optimization Algorithm (WOA). To this end, a nonlinear function is introduced to improve the exploration and exploitation phases in the search process of WOA. Then, the modified WOA is applied to automatically obtain the initial values of weights and biases in FNN leading to reduce the probability of falling into local optima. In addition, the FNN model trained by the modified WOA is used to develop a classification approach for medical diagnosis problems. Ten medical diagnosis datasets are utilized to evaluate the efficiency of the proposed method. Also, four evaluation metrics including accuracy, AUC, specificity, and sensitivity are used in the experiments to compare the performance of classification models. The experimental results demonstrate that the proposed method is better than other competing classification models due to achieving higher values of accuracy, AUC, specificity, and sensitivity metrics for the used datasets.

Key words: Feed forward neural network , · Meta-heuristic algorithm , · Whale optimization algorithm , · Optimization , · Classification , · Bionic algorithm