Kai MENG,Chen CHEN,Bin XIN
1School of Automation,Beijing Institute of Technology,Beijing 100081,China
2State Key Laboratory of Intelligent Control and Decision of Complex Systems,Beijing 100081,China
Abstract:The sparrow search algorithm(SSA)is a recent meta-heuristic optimization approach with the advantages of simplicity and flexibility.However,SSA still faces challenges of premature convergence and imbalance between exploration and exploitation,especially when tackling multimodal optimization problems.Aiming to deal with the above problems,we propose an enhanced variant of SSA called the multi-strategy enhanced sparrow search algorithm(MSSSA)in this paper.First,a chaotic map is introduced to obtain a high-quality initial population for SSA,and the opposition-based learning strategy is employed to increase the population diversity.Then,an adaptive parameter control strategy is designed to accommodate an adequate balance between exploration and exploitation.Finally,a hybrid disturbance mechanism is embedded in the individual update stage to avoid falling into local optima.To validate the effectiveness of the proposed MSSSA,a large number of experiments are implemented,including 40 complex functions from the IEEE CEC2014 and IEEE CEC2019 test suites and 10 classical functions with different dimensions.Experimental results show that the MSSSA achieves competitive performance compared with several state-of-the-art optimization algorithms.The proposed MSSSA is also successfully applied to solve two engineering optimization problems.The results demonstrate the superiority of the MSSSA in addressing practical problems.
Key words:Swarm intelligence;Sparrow search algorithm;Adaptive parameter control strategy;Hybrid disturbance mechanism;Optimization problems
Optimization problems exist in many fields,such as industrial production,artificial intelligence,and medical applications(Deng and Wang,2017;Ding et al.,2018;Wang MJ and Chen,2020).Because these problems are multi-peak,highly dimensional,and highly nonlinear,it is difficult to reach the best solution in a limited time period using traditional optimization methods(Gao and Xin,2019).In addition,traditional methods tend to generate inaccurate solutions.Hence,it is still a great challenge to develop desirable and efficient optimization algorithms to cope with increasingly diverse and complicated problems.
In recent years,meta-heuristic algorithms that imitate natural phenomena,physical laws,and animal’s social and life behaviors have attracted widespread attention due to their strong exploration and exploitation abilities in addressing complex engineering and scientific research problems(Xin et al.,2010;Heidari et al.,2020;Ruan and Duan,2020).Although the optimal solution cannot be guaranteed,meta-heuristic algorithms can still yield an approximate answer to the question in a relatively short time period because they are stochastic and indeterminate.In general,meta-heuristic algorithms can be classified roughly into four categories(Fister et al.,2013).The first one is swarm intelligence based algorithms such as particle swarm optimization(PSO)(Poli et al.,2007),grey wolf optimization(GWO)(Zhang XQ et al.,2021),the slime mold algorithm(SMA)(Li SM et al.,2020),hunger games search(HGS)(Yang et al.,2021),the RUNge Kutta optimizer(RUN)(Ahmadianfar et al.,2021),colony predation algorithm(CPA)(Tu et al.,2021),Harris hawks optimization(HHO)(Heidari et al.,2019),the dolphin swarm algorithm(DSA)(Wu et al.,2016),and the chimp optimization algorithm(ChOA)(Khishe and Mosavi,2020).These algorithms update the population by integrating the foraging or other social behaviors of creatures into the individuals’mutual collaboration.The second category is bio-inspired algorithms which update the population through biological operators,such as selection,crossover,mutation,and migration operators.The representative algorithms in this category are the genetic algorithm(GA)(Srinivas and Patnaik,1994),differential evolution(DE)(Storn and Price,1997),and biogeography-based optimization(BBO)(Simon,2008).The third category is physical-or chemical-based algorithms,such as gravitational search algorithm(GSA)(Rashedi et al.,2009),Archimedes optimization algorithm(AOA)(Hashim et al.,2021),equilibrium optimizer(EO)(Faramarzi et al.,2020),synergistic fibroblast optimization(SFO)(Dhivyaprabha et al.,2018),Henry gas solubility optimization(HGSO)(Hashim et al.,2019),and water cycle algorithm(WCA)(Eskandar et al.,2012).The mechanism used to update individuals in these algorithms generally adopts physical or chemical laws.The last category is social or humanbased algorithms.These algorithms are inspired by the social and cultural interactions seen in human behaviors,including teaching–learning based optimization(TLBO)(Rao et al.,2011),poor and rich optimization(PRO)(Moosavi and Bardsiri,2019),the political optimizer(PO)(Askari et al.,2020b),and the heap-based optimizer(HBO)(Askari et al.,2020a).
The sparrow search algorithm(SSA)is a swarm intelligence based meta-heuristic algorithm developed by Xue and Shen(2020).It mimics the foraging and anti-predation behaviors of sparrows in nature.Compared with other meta-heuristic algorithms,SSA possesses the advantages of simple structure,flexibility,and few parameters.Thus,SSA has been applied to solve various real-life application problems.For instance,Gai et al.(2021)proposed to use SSA for parameter optimization of a deep belief network and then applied it to address the fault diagnosis problem.In Abdulhammed(2022),SSA was used to handle a load-balancing problem.Wang X et al.(2021)introduced SSA to optimize the backpropagation neural network and combined it with a bi-directional long short-term memory network to predict potential threats.
The“no free lunch”theorem(Wolpert and Macready,1997)states that no one optimization technique is suitable for all optimization problems.SSA is no exception,and it still has some drawbacks in dealing with complex optimization problems,such as low accuracy,premature convergence,difficulty in balancing exploration and exploitation,and a tendency to get stuck in local optima.Therefore,scholars have been devoted to designing enhancement strategies to alleviate these drawbacks or tailor the SSA to solve a specific issue.As shown in Table 1,Tian and Chen(2021)proposed a modified SSA combining multiple strategies and applied it to parameter optimization of long shortterm memory neural networks.Zhang Z et al.(2022)presented an improved SSA that performs well for mobile robot path planning in a complex environment.An elite opposite strategy SSA was proposed by Fang et al.(2022)to address the fault diagnosis problem.In Chang et al.(2022),a random walk was integrated with SSA to improve the performance of global search and local search.The developed SSA was employed to optimize the deployment of a fifth-generation wireless communication(5G)network base station.In Zhang CL and Ding(2021),aiming at optimizing the stochastic configuration network,SSA was modified to include a logistic mapping,two self-adaptive hyper-parameters,and a mutation operator.Li XJ et al.(2022)combined chaos,student’st-distribution,and Lévy flight with an SSA and introduced it into a study on identifying robot parameters.Zhu and Yousefi(2021)developed a new technique for optimal parameter identification based on adaptive SSA.Theyintroduced the adaptive learning factor,DE/best/1,and crossover operation to enrich the search power of the original SSA.
Table 1 A summary of key works on sparrow search algorithm(SSA)
Nevertheless,the standard SSA also suffers from the same shortcomings as meta-heuristic algorithms,including poor initial solution quality,low convergence speed,and ease of falling into local optima when addressing complex and multimodal problems.First,because the initial SSA populations are initialized at random without rules,the initial population cannot be appropriately assigned in the searching space of practical problems,which limits the accuracy of initial solutions.Second,a fixed ratio of producers to scroungers does not accurately reflect the actual optimization searching process and strikes a limited balance between exploration and exploitation.Third,insufficient population diversity causes the SSA to fall into local optima.Therefore,in this study we propose a multi-strategy enhanced sparrow search algorithm(MSSSA)to deal with these problems.First,a modified sparrow generation mechanism,which incorporates chaotic maps and opposition-based learning(OBL),is proposed to overcome the weakness of the poor initial solution quality of the standard SSA.It allows the SSA to rapidly enlarge its searching range in the early stage of the algorithm iteration and generate the initial solution with high quality.Second,adopting the idea of adaptive transformation,a novel evolution operator based on the nonlinear function is designed to replace the fixed ratio of producers to scroungers in the update process,and a better balance between global search and local search is achieved.Third,a hybrid disturbance mechanism,combined with Gaussian mutation(GM)and a firefly algorithm,is incorporated into SSA to enhance the local searching capability by a sudden random jump to choose a more proper solution in the neighboring regions and avoid getting trapped in the local optima.
The main contributions of this paper are as follows:
1.A modified sparrow generation mechanism based on a chaotic map and OBL is developed to generate a high-quality population while increasing the population diversity.
2.An adaptive parameter control strategy,which can dynamically adjust the ratio of producers to scroungers,is adopted to achieve a better balance between intensification and diversification.In addition,the hybrid disturbance mechanism is incorporated into the SSA to improve the ability to jump out of local optima and to improve the convergence speed.
3.The performance of MSSSA is investigated on 50 benchmark functions and two real-world engineering optimization problems.Experimental results demonstrate the effectiveness and superiority of the proposed MSSSA.
SSA(Xue and Shen,2020)is a new swarm intelligence optimization algorithm that mimics the foraging and anti-predation behaviors of sparrows.In the SSA,sparrow population is generally separated into two classes:producers and scroungers.Sparrows with better fitness values are called producers.They are responsible for providing foraging areasor directions for the scroungers due to their wide searching range.The others belong to the scrounger group and follow the producer to forage.In addition,reconnaissance and early-warning mechanisms will be adopted by sparrows when suffering attacks from predators.The SSA implementation process can be described as follows:
Step 1:initialize some important parameters,including the size of the sparrow populationn,the maximum iteration numberTmax,the dimension of searching spaced,the number of producersN?P,and the number of scoutersn2.The initial position of each sparrow is expressed as follows:
At the end of the initialization phase,sparrows are evaluated based on the fitness functions,and the entire group is divided into producers and scroungers.
Step 2:update the producer’s position according to
wherei=1,2,···,n,tis the current iteration number,βis a uniformly distributed random number in the range(0,1],Ris a random number obeying normal distribution,Ldenotes a matrix of size 1×dand each element is equal to 1,andq∈[0,1]and st∈[0.5,1]are the alarm value and safety threshold,respectively.
Step 3:update the scrounger’s position in accordance with the following formula:
whereGworstis the worst position of sparrows,Sbestdenotes the current optimal position of producers,andCis a 1×drandom vector with element values defined as?1 or 1,
Step 4:update the position of scouters by
whereGbestrepresents the current global optimal position,τis a random number that obeys normal distribution with a mean value of 0 and a variance of 1,f(xti)denotes the fitness value of sparrowi,Sis a random number in[?1,1],andδdenotes the minimal constant.Whenf(xti)>f(Gbest),sparrows are at the group’s edge and are highly vulnerable to predators.Whenf(xti)=f(Gbest),sparrows are in the middle of the population and need to approach the other individuals to reduce the predation risk.
Step 5:compare the new sparrows with the parent sparrows.If the offspring performs better,the parent sparrows will be replaced.Through this approach,the quality of the current sparrow population is gradually improved.
Step 6:output the optimal population and its fitness value if the maximum iterative numberTmaxis satisfied;otherwise,repeat steps 2–5.
This section describes the proposed MSSSA,which combines three effective strategies,as illustrated in Fig.1.In the MSSSA,we first introduce a modified sparrow generation mechanism based on a tent map(TM)and OBL(TMOM),which is beneficial for building a high-quality initial population.Then,an adaptive parameter control strategy is adopted to balance the exploration and exploitation trends.Finally,the hybrid disturbance mechanism helps the SSA avoid premature convergence by providing a random jump during the searching process.
Fig.1 Flowchart of the proposed multi-strategy enhanced sparrow search algorithm(MSSSA)
The quality of the initial population is of crucial significance in meta-heuristic algorithms because it can affect the accuracy and convergence speed of the algorithm.However,the standard SSA randomly generates the initial population,leading to the problem that the ergodicity and diversity of the swarmare not guaranteed.Considering the shortcoming of random initialization in the SSA,we propose a modified sparrow generation mechanism based on a chaotic map and OBL.
Chaotic maps(Li CH et al.,2017),which possess properties of non-repetition,stochasticity,and ergodicity,are a powerful and fruitful paradigm developed as a way to enhance searching capability and prevent premature convergence.Therefore,it is feasible to replace such randomness by employing a chaotic map.There are various chaotic maps,such as TMs,cubic maps,and logistic maps.Considering that a TM offers higher computational efficiency and better dynamic behavior than the other maps(Fan et al.,2021),it is employed to initialize the sparrow population.The TM is defined as follows:
wherei=1,2,···,nis the sparrow index,j=1,2,···,dis the dimension index,andsrepresents the iteration counter of the TM.chi,j(s)∈(0,1)with an initial value chi,j(0)=0.152.Then,the chaotic variable chi,j(s+1)is combined with the optimization variable to form the initial value,which is expressed as
wherexlb,jandxub,jrepresent the lower and upper bounds ofxi,j,respectively.
Fig.2 shows the comparison curve of the TM and random map initialization strategies for 200 iterations in the range[0,1].It is noticeable that the TM initialization based line distribution is more uniform in extensive ranges than the one generated by the random initialization,which signifies the higher initial population quality of the TM initialization strategy.
Fig.2 Comparison of tent map and random map
OBL(Tizhoosh,2005)is a new technique that chooses the fittest solutions between estimates and counter-estimates.Here,aiming to diversify the sparrow population,OBL is applied to increase the exploration of the searching space on the basis of the high-quality population obtained from TM.According toxi,jobtained from Eq.(6),the related matching opposite solution oxi,jis calculated as follows:
In the end,the bestnsparrows are selected from 2nsparrows generated by Eqs.(6)and(7)as the initial population.The mechanism of population initialization using TMOM is shown in Algorithm 1.
In the standard SSA,the ratio of producers to scroungers is an essential parameter that influencesthe optimization of the objective function.With many producers,the chances of finding new areas through strong global searching capability are increased,while with many scroungers,the algorithm would be capable of exploiting promising regions near the optimal solution through powerful local searching capability.However,the standard SSA adopts a fixed value to control the ratio of producers to scroungers,which makes it difficult to ensure a smooth transition from the global search to the local search in some cases.Therefore,to balance the global exploration and local exploitation abilities,a nonlinear control parameter strategy is designed to adaptively adjust the ratio of producers to scroungers according to the number of iterations.It is formulated as follows:whereg(t)is an adaptive controlling parameter.
Then,by introducing the adaptive controlling parameter,the numbers of producers and scroungers can be calculated as
Algorithm 1 Pseudo-code of the TMOM 1:Initialize the parameters:population size n,the maximum iteration number of TM smax,and the lower(xlb,j)and upper(xub,j)bounds of xi,j 2:for i≤n do 3: for j≤d do 4: Set the initial variables chi,j(0)=0.152 5: for s≤smax do 6: Execute the tent map(TM)operation based on Eq.(5)7: end for 8: Generate the initial value xi,j based on Eq.(6)9: end for 10:end for 11:for i≤n do 12: for j≤d do 13: Compute the value of oxi,j based on Eq.(7)14: end for 15:end for 16:Merge TM population xi,j and OBL population oxi,j 17:Choose the best n sparrows from the produced population as the initial population
Fig.3 shows the curve of the parameter adaptive transformation strategy.From Fig.3,it is clear to see that with the increase oft,g(t)gradually decreases.In addition,at the early stage of evolution,the adaptive control parameterg(t)remains large,and the relationship betweenN?PandN?Stends to beN?P>N?Saccording to Eqs.(9)and(10),which facilitates the exploration ability of the SSA.Toward the end of the evolution,g(t)is small and decreases slowly,resulting inN?P Fig.3 Fluctuation range of the control parameterg(t) The interaction between the producers and scroungers determines the performance of the SSA to some extent.Specifically,when getting stuck in local optima,individuals would escape from the local minimum with the assistance of the fittest producers.Nevertheless,if a majority of sparrows fall into the same local optimum,stagnation of the SSA will be unavoidable.Hence,a hybrid disturbance mechanism,which provides the algorithm with a sudden random jump,is introduced to avoid falling into local optima.The GM and the firefly disturbance(FD)cooperate to realize the hybrid disturbance mechanism,as shown in Fig.4.The new positions of sparrows are calculated by Fig.4 Flowchart of the hybrid disturbance mechanism whereris a uniformly distributed random number from 0 to 1,andpdenotes the selection probability for the mutation strategy and FD strategy,which is described as follows: In Eq.(11),ifpis larger thanr,then the GM strategy would be chosen;otherwise,the FD strategywould be adopted.In the following,GM and FD will be separately described in detail. GM,proposed by B?ck and Schwefel(1993),has been applied to various meta-heuristic algorithms,such as BBO(Zhang XM et al.,2020),EO(Gupta et al.,2020),and the backtracking search algorithm(Nama et al.,2022).Considering that GM can search for valuable information in the vicinity of the current position,it is integrated into SSA to increase the diversity of the population,thereby helping the individuals escape from the local optimal region.The Gaussian density function is defined as follows: whereμis the mean of the distribution andσ2is the variance of each sparrow.Subsequently,μis set to 0,and the varianceσ2is set as wherea0is the initial variance with a value of 1. By Eqs.(13)and(14),a Gaussian distribution operator with variances of varying scalesG(z)is obtained.It could be used to interact with two randomly selected locations,thus creating a novel GM operator.Then,each individual in the population mutates according to wherextr1,jandxtr2,jare thejth-dimensional locations of two randomly selected sparrows. From Eq.(15),the difference of two random individuals is added to the current sparrow’s position to obtain the new position.Generally,these differences enable the information of individuals within the population to be shared and increase the information exchange among sparrows.In addition,the developed GM operator dynamically alters the variances with an increasing number of iterations,which allows for a global solution space to be explored in the early searching phase and a local solution space to be explored in the late searching phase.Therefore,the developed GM operators combined with the difference vector can increase the likelihood of sparrows jumping out of the local optima. FDs(Yelghi and K?se,2018)are primarily inspired by fireflies’flashing and attraction behaviors.In general,all fireflies approach the firefly that is brighter than themselves.In the proposed FD strategy,the current optimal individual is used to exchange information with other individuals,which is formulated as follows: where“‖·‖”stands for theL2norm,xbest,jis thejth-dimensional position of the best individual,xbestrepresents the optimal individual,θ0=1 is the attractiveness atr=0,γrepresents a light absorption coefficient,αis a random value in the range[0,1],andε0means a random value obeying a uniform distribution.The cooperation of GM and FD strategies contributes to the improvement of the searching effi-ciency and effectiveness of the proposed MSSSA. To sum up,the pseudo-code of the MSSSA is illustrated in Algorithm 2. The computational complexity of an algorithm is a vital criterion for evaluating its performance.In this work,the computational complexity of MSSSA is determined mainly by four parts:initialization,individual position update,hybrid disturbance mechanism,and the best location selection.Suppose that the population size isn,the number of iterations isT,and the dimension of the problem isd.The computational complexity of the initialization isO(nd+nd),counting the chaotic map andOBL.The computational complexity of the individual position update isO(ndT).The hybrid disturbance mechanism includes GM and FD,so the complexity isO(ndT+ndT).The time required to select sparrows with the best position isO(nT).Hence,the final computational complexity of MSSSA isO(MSSSA)=O(nd+nd)+O(ndT)+O(ndT+ndT)+O(nT)=O(n(2d+3dT+T)).The complexity of the SSA isO(SSA)=O(nd)+O(ndT)+O(nT)=O(n(d+dT+T)).While the complexity of the MSSSA is slightly larger than that of the SSA,both are in the same order of magnitude.Considering the performance improvement,the increase in computational complexity is acceptable and negligible. Algorithm 2 Pseudo-code of the proposed MSSSA Input:the number of sparrows n,the maximum number of iterations Tmax,the number of producers N?P,the number of scouters n2,and the alarm value q Output:the global best position and its optimal fitness value 1:Generate a high-quality initialized population using Algorithm 1 2:Calculate the fitness value for each sparrow 3:Sort all the sparrows according to their fitness values and select the current best and worst individuals 4:while t To investigate the performance of the MSSSA,we conduct extensive experiments on 40 complex functions from the IEEE CEC2014 and IEEE CEC2019 test suites,as well as 10 classical functions with different dimensions.The specific descriptions of these functions are shown in Tables S1–S3 in the supplementary materials. The mean value(Mean)and the standard deviation(Std)are employed to compare the potential performance of the MSSSA with other algorithms.In addition,a non-parametric statistical test of the Wilcoxon signed-rank test is carried out at a 5%significance level to check if the MSSSA outperforms the competitive algorithms.Furthermore,the symbols“+/=/–”are used to denote these statistical results,meaning that the proposed MSSSA is better than,similar to,or worse than the competitive optimization algorithms,respectively.Finally,the Friedman test is used to rank the multiple algorithms. To test the performance of the developed method,several state-of-the-art algorithms are introduced for comparison,including the SSA,HFPSO(Aydilek,2018),ALCPSO(Chen WN et al.,2013),CLPSO(Liang et al.,2006),SADE(Qin et al.,2009),RDWOA(Chen HL et al.,2020),I-GWO(Nadimi-Shahraki et al.,2021),SOGWO(Dhargupta et al.,2020),AOSMA(Naik et al.,2021),CKGSA(Mittal et al.,2016),and MSBSO(Liu JN et al.,2020).HFPSO is an enhanced PSO that embeds firefly algorithm mechanisms into PSO to effectively keep a better balance between exploration and exploitation.I-GWO and SOGWO are GWO variants;SOGWO uses an OBL mechanism that is similar to that in the MSSSA.CKGSA is an improved GSA using a chaotic map mechanism.ALCPSO and CLPSO are two canonical PSO variants applied to the CEC2014 test set in related papers and have competitive optimization performances.SADE is an enhanced DE that incorporates an adaptive learning strategy to reduce the computational costs of the standard DE.In the proposed MSSSA,the parameter adaptation strategy is inspired by RDWOA,AOSMA,and MSBSO.Therefore,these three algorithms are employed for comparison.The parameter settings of these algorithms are listed in Table S4 in the supplementary materials.For fair comparison,the population size and the maximum number of iterations of all algorithms are set to 30 and 1000,respectively.For each benchmark test function,each algorithm is run 30 times to mitigate randomness effects.All algorithms are run in MATLAB R2018b on a server with 8.00 GB of RAM and a 2.60 GHz CPU. As mentioned earlier,three modifications,namely,the TMOM,the adaptive parameter control strategy,and the hybrid disturbance mechanism,are integrated to improve the performance of the standard SSA in the MSSSA.The goal of this subsection is to see if there is synergy between the different modifications.For this purpose,we compare the MSSSA with its three kinds of degradations and the SSA on CEC2014 benchmark functions.Specifically,MSSSAwt means MSSSA without TMOM,MSSSAwa denotes MSSSA without the adaptive parameter control strategy,and MSSSAwh is MSSSA without the hybrid disturbance mechanism.The incomplete variants use the same parameters as the MSSSA.The comparison results provided by the Wilcoxon signedrank test are shown in Table S5 in the supplementary materials.Moreover,for intuitive comparison,the average ranking bar of the MSSSA and its comparison algorithms is plotted in Fig.5. Fig.5 Ranking statistical bar of MSSSA and its degradative variants From Table S5,the numbers of functions whose MSSSA optimization effects are better than those of MSSSAwt,MSSSAwa,MSSSAwh,and SSA are 12,17,23,and 25 out of 30 functions,respectively.Although the MSSSA generates a worse result than MSSSAwt on F2,it is superior to the other comparison methods on all unimodal functions.It indicates that the adaptive parameter control strategy and the hybrid disturbance mechanism contribute significantly to the exploitation ability of the MSSSA.The MSSSA performs worse than the MSSSAwt,MSSSAwa,MSSSAwh,and SSA on 3,1,0,and 0 out of 13 simple multimodal functions,respectively,which shows that the hybrid disturbance mechanism contributes most to the improvement of exploration ability.On the remaining 14 complex test functions,the performance of the MSSSA is worse than those of the MSSSAwt,MSSSAwa,MSSSAwh,and SSA on 4,2,1,and 0 test functions,respectively.This proves that the hybrid disturbance mechanism is more conducive to improving the ability to address the complex problems of the MSSSA,followed by the adaptive parameter control strategy and TMOM. From Fig.5,the average ranking of the SSA is inferior to that of any of the MSSSA and its degradative variants,indicating that each enhancement strategy is effective and boosts the performance of the SSA to some degree.Among the three degradative variants,MSSSAwh achieves the worst ranking,which means that the hybrid disturbance mechanism is the most responsible for the MSSSA.In addition,the rank from the best to the worst is MSSSA,MSSSAwt,MSSSAwa,MSSSAwh,and SSA,which implies that the MSSSA provides the best optimization performance.It also means that the absence of any of these strategies will negatively affect the algorithm’s optimization capability.In conclusion,all enhancement strategies presented in this work are effective and indispensable. 4.4.1 Accuracy analysis Table S6 in the supplementary materials presents the comparison test results of the proposed MSSSA with other algorithms on the 30-dimensional CEC2014 benchmark suite.All the best results in the current test problem are in bold.From the perspective of the mean value,the MSSSA performs optimally on unimodal functions F1 and F3,far exceeding the performances of the other algorithms.On multimodal functions F4–F16,MSSSA providesthe best solutions for eight test problems out of this set.Even though the results obtained by the MSSSA are not optimal on F5,F6,F9,F14,and F15,they still remain at the forefront.On hybrid functions F17–F22,MSSSA significantly outperforms its rivals on F19–F22.MSBSO shows good performance on F17,and SADE and CKGSA perform well on F18.Compared with the first three classes of functions,the composition function is more complicated.Except for ranking second on F24,MSSSA still has the best performance for the remaining test problems.In addition,we evaluate the stability of these algorithms in all the above cases and record the Std values of the objective functions,also shown in Table S6.From the perspective of the Std value,MSSSA is significantly superior to the other counterparts for most of the examples except MSBSO on F9,F17,and F26,CLPSO on F8 and F11,SADE on F14 and F18,CKGSA on F5,and AOSMA on F24,which verifies the strong stability of the MSSSA. 4.4.2 Statistical analysis To understand the statistical difference in the results of the MSSSA and the comparison algorithms,a Friedman test and a Wilcoxon signed-rank test are performed.Detailed results are listed in Table S6.Fig.6 shows the ranking statistics based on Table S6.It can be observed that the MSSSA ranks first with 21 times,second with 7 times,and third with 2 times.As a result,the MSSSA ranks first among the compared algorithms with a mean ranking of 1.3700.The average ranking of MSBSOis 4.8000,second only to MSSSA.SADE,RDWOA,HFPSO,I-GWO,SSA,ALCPSO,AOSMA,CLPSO,SOGWO,and CKGSA rank from third to twelfth,in terms of the total ranking. Fig.6 Ranking statistics on the CEC2014 benchmark functions:(a)ranking statistical bars of 12 algorithms;(b)average ranking bar of 12 algorithms According to the data in the column“+/=/–”in Table S6,the outcomes of the MSSSA in solving all test functions are significantly superior to those generated by the HFPSO,ALCPSO,and CLPSO.In addition,the numbers of test functions on which the MSSSA outperforms SSA,SADE,RDWOA,IGWO,SOGWO,AOSMA,CKGSA,and MSBSO are 24,28,26,28,29,25,28,and 26 out of 30,respectively.Therefore,these results strongly indicate that the best performance achieved by the MSSSA is statistically significant. 4.4.3 Convergence analysis To intuitively investigate the convergence speed and optimization accuracy of the proposed algorithm,Fig.7 displays the convergence graphs of the MSSSA,SSA,HFPSO,ALCPSO,CLPSO,SADE,RDWOA,I-GWO,SOGWO,AOSMA,CKGSA,and MSBSO for some representative test functions.For the unimodal functions F2 and F3,MSSSA exhibits significant superiority in terms of the convergence speed and optimization accuracy compared with its opponents.For the multimodal functions F8 and F10,MSSSA can rapidly find the optimum solution.On F11,MSSSA converges slower than RDWOA,CKGSA,and SSA at the first 100 iterations,but after that,both the convergence speed and optimization accuracy are superior to those of these three algorithms.On F16,although the convergence of the MSSSA slows down at some moments,its final optimization accuracy is the best.At the beginning iterations of the hybrid function F20,the convergence speed of the MSSSA is superior to those of all the other algorithms,and it stays in first place until the end.On F29,MSSSA achieves significantly higher convergence speed than any of its rivals.This is owing to the collaboration of the parameter adaptive transformation strategy and the hybrid disturbance mechanism,where the former is conducive to accelerating the convergence and the latter is capable of escaping from the local optima.In general,the convergence performance of the MSSSA is far superior to those of its comparison methods. Fig.7 Convergence curves of the MSSSA and the other algorithms on some selected CEC2014 functions:(a)F2;(b)F3;(c)F8;(d)F10;(e)F11;(f)F16;(g)F20;(h)F29 To further assess the capability of the MSSSA in dealing with more complex problems,a series of experiments are conducted on 10 functions from the CEC2019 test set in this part.The experimental results are shown in Table S7 in the supplementary materials.From Table S7,we can observe that the MSSSA achieves almost the best overall performance.In detail,MSSSA outperforms all the opponents on F31–F33,F36,and F40,and has the secondbest position on F34,F37,and F39.Although slightly underperformed on F35 and F38,within the error range,the searching accuracy of the MSSSA is still satisfactory.In terms of the Std,MSSSA is significantly superior to the other counterparts for most examples except CKGSA on F35,CLPSO on F37,and HFPSO on F40,which indicates the strong stability of the MSSSA.Moreover,according to the statistical results in Table S7,the proposed MSSSA achieves the best ranking and performs better than its opponents in most test functions.In conclusion,MSSSA has outstanding capability in dealing with the highly challenging CEC2019 test functions. To analyze the balance between exploration and exploitation and the diversity of the MSSSA in the entire iteration process compared to the SSA,we conduct balance and diversity tests on CEC2014 and CEC2019 test functions.Due to space constraints,not all the test results are displayed.The results are analyzed on four representative test functions,including the unimodal function F1,the simple multimodal function F12,the hybrid function F18,and the expanded Schaffer’s F6 function(F38).The study results are plotted in Figs.8 and 9. Fig.8 shows the balance analysis of the two algorithms.The incremental-decremental curve exhibits an upward trend when the exploration percentage is bigger than the exploitation percentage at some point during the searching process;otherwise,a downward trend emerges.When the incremental-decremental curve reaches its peak,it indicates that exploration and exploitation achieve a state of balance. In Fig.8,the exploration behavior of the two algorithms dominates in the initial stage,but theexploitation behavior quickly dominates afterward.A reasonable explanation for this phenomenon is that meta-heuristic algorithms usually implement the diversification mechanism before conducting the intensification mechanism.As can be observed from the curves of exploration and exploitation,the percentage of exploration of the standard MSSSA is smaller than that of the SSA on F1,F12,F18,and F38,suggesting that the MSSSA enters the local searching phase more rapidly than the SSA.At this time,the local searching capability of the MSSSA increases quickly,which is conducive to digging deep into a more promising region to find high-quality results.As can be observed from the incrementaldecremental curves,the speeds of rising and reaching the peak points of the MSSSA are higher than those of the SSA,indicating that the MSSSA can keep a balance of exploration and exploitation earlier than the SSA.With the combination of the adaptive parameter control strategy and hybrid disturbance mechanism,the local searching capability is strengthened and the convergence speed is improved.Therefore,we can conclude that MSSSA can maintain a better balance of exploration and exploitation,so that the convergence speed and optimization accuracy of MSSSA are superior to those of the SSA. Fig.8 Balance analysis of the MSSSA and SSA on F1,F12,F18,and F38:(a)MSSSA on F1;(b)SSA on F1;(c)MSSSA on F12;(d)SSA on F12;(e)MSSSA on F18;(f)SSA on F18;(g)MSSSA on F38;(h)SSA on F38 Fig.9 shows the diversity of the MSSSA and SSA algorithms,where the horizontal axis represents the number of iterations and the ordinate denotes the average Euclidean distance between searching agents.As can be observed from the figure,the diversity value of the MSSSA is lower than that of the SSA in the early searching phase,due to the TMOM strategy used in the initialization.This strategy ensures that the MSSSA can obtain high-quality initialization individuals and enter the local searching phase faster.Then,the diversity curve gradually decreases as the number of iterations increases and stabilizes in the end.The trend of stabilization of the MSSSA appears to be much earlier than the standard SSA,indicating that the combination of three strategies effectively upsurges SSA’s convergence. Fig.9 Diversity analysis of the MSSSA and SSA on F1(a),F12(b),F18(c),and F38(d) To measure the capability of the proposed algorithm in dealing with different dimensional problems,the MSSSA is compared with the SSA on 30-,50-,100-,200-,500-,and 1000-dimensional functions.The test cases selected for the experiments are 10 representative classical benchmark functions.The experimental results are shown in Table S8 in the supplementary materials.As can be observed from Table S8,the performance of the SSA decreases significantly with the increase of dimension,while the capability of the MSSSA is steadily enhanced.Compared with the SSA,the MSSSA obtains better accuracy and greater stability on problems of varying complexity,indicating the strength and potential of the MSSSA in dealing with high-dimensional optimization problems.Therefore,it can be concluded that the proposed MSSSA has better scalability. In this section,two classical constrained engineering problems,including pressure vessel design(PVD)and speed reducer design(SRD),are employed to investigate the effectiveness of the MSSSA in practical applications.The death penalty is adopted to deal with constraints in this study.The parameter settings of all the experiments are the same as in Section 4.2. The first engineering problem,depicted in Fig.10,is to obtain the minimum cost of the pressure vessel by optimizing four related variables,including the thickness of the shellTs,thickness of the headTh,inner radiusR,and length of the cylindrical section of the vesselL.The mathematical model is described as follows: Fig.10 Pressure vessel design problem For the PVD problem,the best solutions and statistical results of comparing the MSSSA with the other algorithms are recorded in Tables 2 and 3,respectively,where“Best”represents the optimal value and“Worst”is the worst result.As can be observed in Table 2,the MSSSA is superior to the other algorithms and acquires an optimalvalue of 5885.3328 corresponding to the optimal solution[0.7782,0.3846,40.3196,200.0000].In addition,SADE and MSBSO obtain the best stability,with I-GWO ranking the third and MSSSA ranking the fourth,as shown in Table 3.The“no free lunch”theorem states that the MSSSA cannot solve all problems successfully.Even though the stability of the MSSSA is not the best,it is still very competitive.Therefore,the MSSSA has superior performance in addressing the PVD optimization problem. Table 2 Best solutions of all the methods on the pressure vessel design problem Table 3 Statistical results of all the methods on the pressure vessel design problem Another engineering problem optimized in this study is the SRD problem,as shown in Fig.11.This problem aims to minimize the total weight determined by decision variables,i.e.,the number of teeth on a pinionz,face widthb,module of teethm,length of the first shaftl1,diameter of the first shaftd1,length of the second shaftl2,and diameter of the second shaftd2.The mathematical model is described as follows: Fig.11 Speed reducer design problem subject to For the SRD problem,the optimal results and statistical indices obtained by the involved methods are recorded in Tables 4 and 5,respectively.From these tables,we can observe that the best and mean values of the MSSSA are superior to those of its opponents,with the Std slightly larger than those of SADE,MSBSO,RDWOA,CLPSO,and I-GWO,indicating that the MSSSA has an advantage on the SRD problem. Table 4 Best solutions of all the methods on the speed reducer design problem Table 5 Statistical results of all the methods on the speed reducer design problem From these two engineering cases,we can conclude that the MSSSA is capable of dealing with constrained engineering design problems well. In this paper,we propose an enhanced SSA by integrating TMOM,an adaptive parameter control strategy,and a hybrid disturbance mechanism.Specifically,TMOM combines the TM and OBL to generate high-quality initial sparrow populations.The adaptive parameter control strategy is designed to adjust the ratio of producers to scroungers with an increased number of iterations,which contributes to establishing a balance between exploration and exploitation.The hybrid disturbance mechanism aims to facilitate the MSSSA,strengthening local exploration capability,and effectively jumping out of the local optimal region.The ablation experiments are conducted to investigate the promotion effect of the three strategies on the SSA.Experimental results verify the effectiveness of integrating TMOM,anadaptive parameter control strategy,and a hybrid disturbance mechanism to improve the SSA.In addition,compared with some advanced algorithms in two benchmark function sets,the MSSSA obtains the expected results and shows superior performance.The optimization accuracy and convergence speed are more prominent regardless of the IEEE CEC2014 and IEEE CEC2019.The balanced diversity experimental results show that the MSSSA has an excellent capacity to avoid getting stuck at the local optima,which is conducive to obtaining a high-quality solution.Furthermore,the MSSSA obtains satisfactory results on two engineering optimization problems,indicating that the proposed algorithm is of great practical value. Nevertheless,the MSSSA still has some deficiencies in particular aspects.First of all,the convergence speed of the MSSSA still has space for improvement when addressing multimodal functions.Also,the computation time of the MSSSA is slightly higher than that of the conventional SSA.Hence,when handling some practical problems,there must be a good balance between accuracy and computational cost.In the future,the MSSSA can also be applied to other real-world problems,such as fault detection(Long et al.,2022),scheduling(Zhang GH et al.,2021),and medical diagnosis(Liu JC et al.,2022). In this study,a novel MSSSA is proposed to solve global optimization problems.In the MSSSA,the TM and OBL are first combined to generate a high-quality initial population.Then,an adaptive parameter control strategy is applied to balance exploration and exploitation.Finally,a hybrid disturbance mechanism is embedded in the SSA to increase the probability of jumping out of local optima.Two benchmark function sets(IEEE CEC2014 and IEEE CEC2019)and 10 classical functions are used to evaluate the performance of the proposed MSSSA.Compared with the SSA and 10 state-ofthe-art algorithms,the MSSSA has superior performance in terms of solution accuracy,convergence speed,scalability,and stability.Moreover,the proposed MSSSA is applied to deal with two real-world optimization problems.Experimental results indicate that the MSSSA is a practicable and efficient method for complex engineering optimization problems.Although the MSSSA has been demonstratedto be a highly effective single-objective algorithm for continuous optimization problems,the potential for multi-objective optimization is still waiting to be developed as a future attempt.In addition,the MSSSA could be hybridized with other meta-heuristic algorithms to enhance its overall performance. Contributors Kai MENG designed the research and drafted the paper.Chen CHEN guided the research.Bin XIN revised and finalized the paper. Compliance with ethics guidelines Kai MENG,Chen CHEN,and Bin XIN declare that they have no conflict of interest.3.3 Hybrid disturbance mechanism
3.4 Computational complexity
4 Numerical results and comparison
4.1 Test functions and evaluation criteria
4.2 Comparison algorithms and parameter settings
4.3 Ablation study of the MSSSA
4.4 Performance comparisons on the CEC2014 benchmark suite
4.5 Performance comparisons on the CEC2019 benchmark suite
4.6 Balance and diversity analysis
4.7 Scalability test on the MSSSA
5 MSSSA for solving constrained engineering optimization problems
5.1 PVD problem
5.2 SRD problem
6 Discussions
7 Conclusions and future work
Frontiers of Information Technology & Electronic Engineering2022年12期