Xiong Pengwen Zhou Xueting Li Qian Song Aiguo Liu Peter Xiaoping
(1School of Advanced Manufacturing, Nanchang University, Nanchang 330031, China)(2School of Instrument Science and Engineering, Southeast University, Nanjing 210096, China)(3Department of Systems and Computer Engineering, Carleton University, Ottawa KIS5B6, Canada)
Abstract:Path prediction of flexible needles based on the Fokker-Planck equation and disjunctive Kriging model is proposed to improve accuracy and consider the nonlinearity and anisotropy of soft tissues.The stochastic differential equation is developed into the Fokker-Planck equation with Gaussian noise, and the position and orientation probability density function of flexible needles are then optimized by the stochastic differential equation.The probability density function obtains the mean and covariance of flexible needle movement and helps plan puncture paths by combining with the probabilistic path algorithm.The weight coefficients of the ordinary Kriging are extended to nonlinear functions to optimize the planned puncture path, and the Hermite expansion is used to calculate nonlinear parameter values of the disjunctive Kriging optimization model.Finally, simulation experiments are performed.Detailed comparison results under different path planning maps show that the kinematics model can plan optimal puncture paths under clinical requirements with an error far less than 2 mm.It can effectively optimize the path prediction model and help improve the target rate of soft tissue puncture with flexible needles through data analysis and processing of the mean value and covariance parameters derived by the probability density and disjunctive Kriging algorithms.
Key words:flexible needle puncture; nonlinear; Fokker-Planck equation; disjunctive Kriging; error analysis
Minimally invasive surgery has been substantially improved through percutaneous punctures in the past decades, and flexible needle puncture has been widely used for biopsy, brachytherapy, seed implantation, and anesthesia[1].However, performing the percutaneous puncture operation for some refined procedures is still difficult due to the lack of sufficient accuracy on motion control of puncture.The accuracy requirement for general operations is approximately at the millimeter level, while the accuracy requirement for the needle is quite crucial considering eye or infant surgery[2].
Many research achievements have been realized by flexible needle movement modeling in the past years[3].Park et al.[4-5]proposed a probability density equation to calculate the reachable probability density of the needle tip for the random performance of bevel-tip flexible needles during puncture.Furthermore, the random movement is planned in accordance with the probability that the needle tip would reach the predetermined state.Alterovitz et al.[6]considered the uncertain factors caused by individual differences between patients as well as the difficulty in predicting the interaction between the needle and the tissue and described these uncertain factors with a random probability distribution.Zhao et al.[7]established a needle-tissue interaction model that considers the nonlinear and anisotropic characteristics of soft tissues.However, the accuracy of these methods is insufficiently high due to the assumption of linear models for complex nonlinear human tissues.
Many algorithms have also been proposed to plan a suitable puncture path for flexible needles.Huo et al.[8]designed a puncture path plan based on the target particle swarm algorithm and regarded the flexible needle path planning problem as a multi-objective optimization problem.Arora et al.[9]used the Markov decision process to carry out robust path planning and guidance in a complex organization as well as the needle interaction environment.Gao et al.[10]planned the puncture path of flexible needles by using a geometric approximation method and established a forward and inverse kinematics model of flexible needles through D-H parameters and accessibility conditions to pierce the target point accurately.
A bevel-tip flexible needle is constructed to analyze model parameters.The needle comprises an insertion speedυ, a rotation speedω, and a rotation angleα.When the flexible needle is inserted into human tissue, the soft tissue will exert a reaction force on the oblique surface of the needle tip, which deflects the flexible needle and facilitates its movement along a certain arc.The bending curvature of the flexible needle is approximately constant during the puncture movement; that is, the flexible needle moves along an arc of a fixed radiusr.
As shown in Fig.1, the D-H parameter method[10]is used to establish the forward motion model of the puncture needle, and the coordinate(r,L1,L2)is used to obtain the pose transformation of the needle tip relative to the global coordinate system.
Fig.1 Establishment of puncture needle model in the turning process
Assume that the functionf(t)considers the time of flexible needle movement, and the vectorζcontains angular velocityωand linear velocityυin the fixed reference framef(t).The special orthogonal vector set SO(3)represents the space rotation matrixR3×3, and the Euclidean motion group SE(3)represents the three-dimensional motion of a rigid body[5].SO(3)can then be expressed as Euler anglesα,β, andγby the following:
R=RZ(γ)RX(α)RY(β)
(1)
(2)
Suppose the input observation points in the experiment areS={S1,S2,…,Sm} andSi∈D?Rn, and the corresponding output response points areZ={Z1,Z2,…,Zm} andZi?Rq.
The puncturing process of the needle into the soft tissue can be regarded as quasi-static, which is discretized to establish a model of the interaction between the needle and the soft tissue.Owing to the uncertainty of the needle insertion system, a simple way to capture random phenomena is to add a noise term such that the designed model can search for a reachable workspace with probability.The relational expression of the nonlinear functionY(Si)under Gaussian random noise is as follows:
ω(t)=ω0(t)+λn(t)
(3)
dN(t)=N(t+Δt)-N(t)=n(t)dt
(4)
whereλis the noise parameter;n(t)is Gaussian white noise.
(5)
Assume that a flexible needle is inserted at a constant speedυ(t)with a rotation at an angular velocityω(t)and finally reaches the desired posture(position and direction).Withkas the curvature of the needle trajectory, an incomplete stochastic differential model with noise(3)can be established
ζdt=[kυ00ω0(t)0 0υ0]Tdt+[0 0λ0 0 0]TdN=
h(t)dt+HdN(t)
(6)
The Fokker-Planck equation is the development of the stochastic differential equation, which describes the probability density distribution function of the flexible needle position and its orientation with timet[5-6]
(7)
(8)
The new functionF(g,t)can be described as shown below to obtain an approximate functional form off(g,t)in Eq.(8):
ρ(g,t)=F(m-1(t)g,t)
(9)
Suppose that the initial state of flexible needle movement can be expressed asρ(g0|g,0)=ζ(g-g0), andD1(g,t)andD2(g,t)are respectively the growth rate of the mean and standard deviation of the probability distribution function, i.e., the drift and diffusion terms of the Fokker-Planck equation[5].
The following formulas can be obtained considering the Brownian motion of molecular collision to calculate the growth rate of the mean and standard deviation:
(10)
(11)
(12)
whereMandTare the Brownian coefficients;uis the growth rate of the mean;γrepresents the particle radius;kis medium viscosity.
The following equation can be derived from Eq.(12):
(13)
Assuming the presence of some diffusion in the model, the Fokker-Planck equation can be approximated as a Gaussian distribution function:
(14)
(15)
(16)
The probability density functionρ(g,t)lasts for a short period of timet.Meanwhile, the Fourier transform, which lasts for a long period of time, is used to convert the convolution in the time domain to the product in the frequency domain.
ρ(g,t1+t2)=ρ(g,t1)*ρ(g,t2)
(17)
Kriging is used to predict spatial modeling and the regression algorithm of random processes based on the covariance function, and its model considers the global certainty and local uncertainty in the experimental process[11].This model is also widely used in prediction, sensitivity analysis, and optimization conditions.However, the ordinary Kriging method is mainly used for linear models and ignores the uncontrollable factors, such as the nonlinearity and anisotropy of flexible needle movements in the soft tissue in puncture environments.Thus, this method produces inevitable errors in needle movement.The innovative point aims to extend the weight coefficient in ordinary Kriging into a nonlinear function and is used for nonlinear estimation on the random motion field of flexible needles.Therefore, this model mainly discusses the establishment of a prediction model based on the disjunctive Kriging method.
The deterministic responseZi∈Rof ordinary Kriging[12]for anySi∈D?Rncan be expressed as a sum ofFi(t)andNi(t).Fi(t)describes the motion of flexible needle tips involving position and velocity.Ni(t)is the deviation of Gaussian white noise, which can be defined as:
Zi(t)=Fi(t)+Ni(t)i=0,1,…,q
(18)
(19)
(20)
The sample set in this model is assumed to obey the joint normal distribution.Among them,Z(Si)corresponds to the standard normal distributionY(Si), and the normal deformation function isψ; therefore,Z(Si)=ψ[Y(Si)], and the equation can be obtained from Eqs.(19)and(20):
(21)
If the function is satisfied, then
(22)
Using the orthogonality of Hermite polynomials,ψ(y)can be expressed as
(23)
(24)
whereηk(y)is a Hermitian polynomial;Ckis a coefficient;kis an integer.
As in Eqs.(20)and(21), the equation can be obtained by using thek-order Hermitian polynomial to convert the above equation:
(25)
wherefikis the coefficient of determination;ηkis thek-order Hermitian polynomial;iandkare both integers.
The following equations are obtained in accordance with the conditions of unbiasedness and minimum variance estimated by disjunctive Kriging:
(26)
whereZ(S0)represents the true value at the observation pointS0;Eis the mathematical expectation; VAR is the variance.The following can be deduced from the above formula:
(27)
whereψ0jis the correlation coefficient betweenY(S0)andY(Sj).
(28)
(29)
The disjunctive Kriging variance can be obtained as shown below to solve the error assessment after Hermite polynomial expansion in Eq.(29):
(30)
Finally, the parameters obtained by the disjunctive Kriging algorithm(DKA)are evaluated, and the flexible needle puncture path model predicted by the probabilistic path algorithm(PPA)is simultaneously optimized.The errors due to uncertainty and nonlinearity are also reduced.
Many path planning algorithms are available for flexible needle puncture[13].The proposed model can improve the adaptability of puncture areas and avoidance of obstacles considering the nonlinearity and uncertainty of flexible needle puncture environments.Moreover, the model introduces Gaussian noise into the Fokker-Planck equation, optimizes the probability density function, obtains the mean value and covariance, and plans the puncture path with the PPA.The same starting and target points are provided for this simulation experiment in the current study, and the weight coefficient in the ordinary Kriging is extended into a nonlinear function.The nonlinear variance, mean square error, mean, and weighted mean of the disjunction Kriging optimization model are calculated on the basis of Hermitian expansion.The puncture path planned by the PPA based on the Fokker-Planck equation can then be optimized, thereby determining whether the path is optimal.Finally, the results based on the Fokker-Planck equation and DKA are used to predict the flexible needle path.
Flexible needle trajectory is assumed to be close to a perfect arc with determinate insertion position and direction to simulate the probabilistic path planning of the flexible needle in an ideal(no obstacle)situation.The unideal situations, including those involving obstacles or the insertion position and direction errors in the system, are also considered.
Errors will occur in the actual operation of the flexible needle due to the uncertainty of the needle position system.Fig.2 shows the path error caused by the insertion position and direction of the flexible needle, and Fig.2(a)demonstrates the prediction of the successful arrival path generated by the PPA for various starting positions near the optimal position.Fig.2(b)shows various starting directions.Fig.2(c)reveals probabilistic path simulation prediction from the starting to the target point under the uncertain situation with random obstacles, and the needle trajectory close to arcs avoids the obstacles.
(a)
The current study evaluates and predicts factors, such as global certainty, local uncertainty, nonlinearity, and anisotropy, according to the covariance function and continuously optimizes puncture path based on the random probability path planning process to obtain the result of modeling random data using disjunctive Kriging.Assuming that the input is random white noise, the parameter values of the flexible needle puncture process are obtained through multiple simulation verifications.
The variance VAR, mean square error MSE, mean EI, and weighted mean WEI calculated by the DKA with random noise input of the flexible needle are used to evaluate the error simulation effect of flexible needle puncture, as shown in Fig.3.Among the 25 sets of test values, some inherent variability abnormal values caused by irregular muscle tissues are eliminated.VAR is the variance of model evaluation, and the range of all test values after removing outlier values is between 0.4 and 0.8 mm2, which is used to estimate the error of the simulation results of flexible needle puncture.The clinical requirements of flexible needle puncture surgery indicate that the error should not exceed 4 mm2and the abnormal value is also 1.16 mm2<4 mm2; thus, the simulation results meet the clinical requirements.MSE calculates the average error of the model by evaluating the MSE of multiple points.The measurement range after removing the outlier value is between 0.30 and 0.05 mm2, which is a small error value obtained after several optimizations.EI, which is the expected improvement value of the prediction model, is used to optimize the model continuously, and the range of measurement results after removing outlier values is between 0.02 and 0.08 mm.WEI is based on EI and forecasts the weighted expected value according to the level of different influencing factors, thereby reducing errors.
(a)
Fig.4 shows that the simulation tests of the interpolation process have a good fitting effect based on the puncture experiment of the optimal planning path and the error comparison between test and training values under the DKA.The system error of the flexible needle puncture model is much less than 2 mm, which meets the clinical requirements of interventional surgery.This model also increases the probability of reaching the target and reduces errors in an uncertain nonlinear environment, which verifies the effectiveness of the proposed model.
Fig.4 Error distribution map between the test and training values under the DKA
The prediction model, which is based on the DKA as well as the insertion position, insertion direction, and irregularity of inserted tissues and obstacles, reduces the errors in the process of flexible needle puncture.Some previous studies are available in[14-15].The current study used the path planning diagram in the two-dimensional environment to demonstrate the path of the flexible needle puncture soft tissue.The simulation path diagrams under the PPA are shown in Fig.5.Meanwhile, Figs.5(a)to 5(d)present a continuous optimization process plan by the PPA under definite starting and target points and similar obstacle environments.The red line represents the puncture path.The result indicates that the optimization process performed by disjunctive Kriging via continuous interpolation obtains optimized training values based on the test results of the above-mentioned parameters, such as variance and mean, thus allowing the gradual planning of the optimal path based on the PPA.This process also improves the targeting rate of flexible puncture needles.
(a)
The parameter values that must be optimized for puncture simulation are obtained from the formula derived in module three.Meanwhile, the parameters in the program are optimized through the PPA+DKA and data processing, such as box plots, to obtain the parameter values for the soft tissue puncture optimization of the flexible needle continuously.
Four different organization maps with obstacles in a nonlinear and uneven environment under the same starting and target point are designed to further verify the proposed model.A comparison simulation with the PPA and PPA + DKA models based on the path model is also performed, as shown in Fig.6.
(a)
As shown in Fig.6 and Tab.1, path planning by the PPA+DKA is more flexible than that of the PPA under the same uncertain simulated map environment.The path planning time is slightly increased under the PPA+DKA, but the optimal path length is reduced, and the uncertainty and nonlinearity of the environment are fully considered.The puncture path length of flexible needles in a random environment should be considered for nonlinear soft tissue with different obstacles.A total of 32 experiments on 4 different maps were performed, and each group performed 8 tests.The simulation results are still consistent with the above conclusions.The simulation path planning time and puncture path length value based on the random selection of eight sets of the test are shown in Fig.7.
Tab.1 Simulation data contrast of the PPA and PPA+DKA
Fig.7 indicates that the path training time of most groups of the PPA is longer than that of the PPA+DKA.Meanwhile, the time difference of the selected training groups between the PPA and PPA+DKA after the data filtering process is negligible.The path length of the PPA+DKA is significantly better than that of the PPA.Considering the damage to the human body by flexible needles and the complex environment of nonlinear soft tissues, the PPA+DKA is effective because it can reduce the puncture error and the length of the puncture path and finally reach the target point despite its slightly long calculation time.
(a)
The simulation test path diagram is imitated as a flexible needle tip puncture process shown in Fig.8, which is recorded as the path planning diagram of the PPA and PPA+DKA.The detailed needle tip path planning diagram in Fig.8 shows that the path length of Fig.8(b)is significantly smaller than that of Fig.8(a).The simulation test times of Figs.8(a)and 8(b)are 6.14 and 6.08 ms, respectively, which again verifies the simulation test results in Figs.6 and 7.The above comparative simulation experiment shows that flexible needles can accurately reach target points with the shortest path under the proposed model.
(a)
1)The flexible needle path prediction model effectively improves the target accuracy in needle surgery.The prediction model can reduce uncertainty errors in body membrane tissues.Thus, the proposed model is crucial for biopsy, brachytherapy, and other medical procedures that require accurate needle implantation.
2)This model combines the Fokker-Planck equation to plan the probabilistic path of flexible needles, analyzes the nonlinearity and uncertainty through disjunctive Kriging interpolation, continuously optimizes the model according to test parameter values, and obtains the predicted path error of flexible needles.The results prove that this model improves the target rate and obtains the optimal path in an uncertain environment during the insertion.
3)The proposed algorithm model can also effectively optimize puncture paths under uncertain conditions.Compared with other algorithms, the proposed model uses the Fokker-Planck equation combined with disjunctive Kriging to predict external conditions, thus avoiding the assumption errors caused by the ideal state of linearity and uniformity in soft tissue puncture.This model can effectively handle the generality, uncertainty, and complexity of the puncture environment; it is also consistent with the application of flexible puncture needles in realistic operations.
Journal of Southeast University(English Edition)2022年2期