OJG  Vol.11 No.10 , October 2021
Nonlinear Inversion for Complex Resistivity Method Based on QPSO-BP Algorithm
Abstract: The significant advantage of the complex resistivity method is to reflect the abnormal body through multi-parameters, but its inversion parameters are more than the resistivity tomography method. Therefore, how to effectively invert these spectral parameters has become the focused area of the complex resistivity inversion. An optimized BP neural network (BPNN) approach based on Quantum Particle Swarm Optimization (QPSO) algorithm was presented, which was able to improve global search ability for complex resistivity multi-parameter nonlinear inversion. In the proposed method, the nonlinear weight adjustment strategy and mutation operator were used to enhance the optimization ability of QPSO algorithm. Implementation of proposed QPSO-BPNN was given, the network had 56 hidden neurons in two hidden layers (the first hidden layer has 46 neurons and the second hidden layer has 10 neurons) and it was trained on 48 datasets and tested on another 5 synthetic datasets. The training and test results show that BP neural network optimized by the QPSO algorithm performs better than the BP neural network without initial optimization on the inversion training and test models, and the mean square error distribution is better. At the same time, a double polarized anomalous bodies model was also used to verify the feasibility and effectiveness of the proposed method, the inversion results show that the QPSO-BP algorithm inversion clearly characterizes the anomalous boundaries and is closer to the values of the parameters.

1. Introduction

CR (Complex resistivity) method, also known as SIP (Spectrum Induced Polarization) method, is one of the geophysical prospecting methods that is based on the different induced polarization characteristics of rocks and ores in the frequency domain. Multi-parameter is the main feature of complex resistivity inversion [1]. The essence of inversion theory is to study the theory and method of mapping the observed data in Geophysics to the corresponding geophysical model [2]. For the complex resistivity inversion problem, its essence is a nonlinear problem. The nonlinear problem is easy to fall into the local extremum by using the traditional linear or quasi-linear method, so it needs to be solved by the nonlinear method.

In the inversion of electrical resistivity tomography, the neural network has become one of the most widely used complete nonlinear inversion methods because of its strong nonlinear mapping ability and easy construction.

Ahmad Neyamadpour et al. used the artificial neural network to study the inversion imaging of 2D DC resistivity data and created a Matlab application. The interpreted result shows that the trained network was able to invert 2D electrical resistivity imaging data obtained by a Wenner-Schlumberger configuration rapidly and accurately [3]. Dai Qian-Wei et al. Completed the Nonlinear inversion for electrical resistivity tomography based on chaotic DE-BP algorithm, and the results show that the proposed method has better performance in stability and accuracy and higher imaging quality than least-square inversion [4]. Trong Long Ho used a back-propagation neural network to research 3D inversion problem of borehole-to-surface electrical data. The result shows that the most successful learning algorithm in this network is the Resilient Propagation (RPROP) [5]. The above researchers have made a lot of contributions in resistivity nonlinear inversion, but they have not introduced the nonlinear method into the complex resistivity inversion.

However, for the complex resistivity method, which requires multi-parameter inversion, the application of a neural network is rare. The inversion methods are mostly linear or quasi-linear methods. Loke et al. introduced the regularization method and adopted the smooth constrained least square method to carry out the inversion of 2.5D complex resistivity method with ignoring the electromagnetic coupling effect, and obtained the parameters of Cole-Cole mode, but the inversion of the boundary is not as expected [6]. Son et al. proposed a new complex resistivity inversion algorithm based on DC resistivity, which was calculated in the complex domain. In order to directly invert the complex resistivity of multi-frequency points, the algorithm decomposes the Cole-Cole model parameters of multi-frequency complex resistivity [7]. Blaschek et al. introduced the minimum gradient regularization algorithm to study the inversion problem of complex resistivity [8]. Routh et al. studied the complex resistivity inversion of the smooth model under the condition of considering electromagnetic coupling [9]. Hönig et al. adopted a forward algorithm similar to DC resistivity, then introduced the zero-frequency smoothing constraint of complex resistivity, and studied the regularization inversion of complex resistivity [10]. Zhang Zhi-Yong et al. used MPI parallel algorithm to study 2D inversion problem of spectral induced polarization data. The tests result suggests that the proposed parallel algorithm is robust and efficient [11].

Based on the above research experience, this paper introduces the optimized neural network to solve the multi-parameters inversion problem of the complex resistivity method and constructs a nonlinear mapping network between apparent complex resistivity and inversion parameters. We also propose a complex resistivity nonlinear inversion algorithm based on QPSO-BP algorithm to try to solve the multi-parameter nonlinear inversion problem.

2. Forward Modeling Theory of 2.5D Complex Resistivity Method

2.1. Forward Modeling Theory

Under the condition of ignoring the electromagnetic coupling effect, the complex resistivity forward calculation is similar to the DC method. The Cole-Cole model is introduced to characterize the induced polarization effect. After Fourier transform, 2D complex potential boundary value problem in wavenumber domain is [12]:

{ ( σ U ) k 2 σ U = I δ ( A ) Ω U n = 0 Γ s U n + k K 1 ( k r ) K 0 ( k r ) c o s ( r , n ) U = 0 Γ (1)

In Equation (1), the area Ω is a three-dimensional study area, Boundary Γ s , Γ is the boundary of a two-dimensional region. Among them, Γ s is the surface boundary of area Ω, and Γ is the underground boundary of area Ω, As shown in Figure 1, σ 2 is the complex conductivity of the polarized medium, r is the distance from the power source to the boundary, n is the outer normal direction of the infinity boundary, k is the wavenumber, K 0 is the zero-order Bessel function, and K 1 is the second kind of first-order Bessel function. The functional of Equation (1) is:

Figure 1. Mode schematic of two-dimensional structure.

F ( U ) = Ω [ σ 2 ( U ) 2 + 1 2 k 2 σ U 2 I δ ( A ) U ] d Ω + 1 2 Γ σ k K 1 ( k r ) K 0 ( k r ) cos ( r , n ) U 2 d Γ (2)

Discrete the calculation area and construct an interpolation function. The discrete form of Equation (2) is:

F ( U ) = 1 2 U Τ K U U Τ P (3)

where P is the column vector related to the excitation point power. Solving the variation of the Equation (3) and making it equal to zero, then we can get the system of linear equations:

K U = P (4)

The wavenumber domain potential U of each point is obtained by solving the linear Equation (4), and the potential is obtained by inverse Fourier transform [13].

u ( r ) = j = 1 n U ( r , k j ) g j (5)

where r is the position of the measuring point, k j is the wavenumber and g j is the weighting coefficient, the values of both are shown in Table 1 [14].

The complex resistivity produced by the induced polarization effect of rock and ore is expressed by Cole-Cole model [15]:

ρ ( i ω ) = ρ 0 { 1 m [ 1 1 1 + ( i ω τ ) c ] } (6)

where, ρ 0 is resistivity (0 Hz); m is charge ability; c is relaxation-constant; τ is a time constant. The complex resistivity forward calculation can be carried out by replacing the conductivity in Equation (1) and Equation (2) with the complex conductivity.

2.2. Accuracy Verification of Forwarding Modeling Algorithm

In order to verify the accuracy of the CR forward algorithm, the two-layer horizontal complex resistivity model is used to verify the calculation accuracy.

For the two-layer horizontal formation, by solving the simplified Laplace equation of the cylindrical coordinate system and power series expansion, the calculation expression of the complex potential U ˜ at each point on the surface can be obtained as:

Table 1. The inverse Fourier transform coefficient.

U ˜ = I ρ 1 ( i ω ) 2 π [ 1 r + n = 1 K 12 n r 2 + ( 2 n h 1 ) 2 ] (7)

In Equation (7), K 12 = [ ρ 2 ( i ω ) ρ 1 ( i ω ) ] / [ ρ 2 ( i ω ) + ρ 1 ( i ω ) ] , ρ 1 ( i ω ) , ρ 2 ( i ω ) is the complex resistivity calculated by Equation (6) for the first and second layers, r is the distance between the measuring point and the origin, h 1 is the thickness of the first stratum. The calculation accuracy of Equation (7) depends on the size of the number of terms n. The larger the n is, the higher accuracy of the calculation is. This calculation takes n = 200. The parameters of the two-layer polarization model are shown in Table 2.

The numerical solution and analytical solution of 2.5D complex potential of the two-layer horizontal layer model are shown in Figure 2(a) and Figure 2(b). Both the amplitude and phase curves of complex potential are consistent with the analytical solution, which shows the accuracy of the finite element algorithm. The finite element algorithm provides a reliable basis for constructing BP neural network training database.


Figure 2. Comparison of analytical solution of complex potential and numerical solution of finite element. (a) Excitation frequency is 1.25 Hz; (b) Excitation frequency is 125 Hz.

Table 2. Parameter table of two-layer polarization model.

3. Quantum Particle Swarm Algorithm for Training BP Neural Network

3.1. Quantum Particle Swarm Optimization Algorithm

Quantum particle swarm optimization (QPSO) absorbs the characteristics and advantages of PSO algorithm and quantum computing, combines the two methods, and presents the solution of the problem to be optimized in the form of qubit probability amplitude [16].

Initialization: The qubit phase θ in the range of [ 0 , 2 π ] is randomly generated by using a random number function, and the qubit can be obtained, which can be expressed as a probability amplitude [ sin θ , cos θ ] Τ . After that, the solution space is transformed by combining the upper and lower limits of each variable set by the algorithm, and the qubit is transformed into the solution space to calculate the appropriate value.

Update: In the QPSO algorithm, with the help of quantum rotation gates operation, the individual and group optimal positions (set as cosine positions) found by the particle p i in the current solution space can be expressed as:

p i l = [ cos ( θ i l 1 ) , cos ( θ i l 2 ) , , cos ( θ i l D ) ] p g = [ cos ( θ g 1 ) , cos ( θ g 2 ) , , cos ( θ g D ) ] (8)

The updated rules of particle state are as follows:

The incremental update of qubit angle on particles is:

Δ θ i j ( t + 1 ) = ω Δ θ i j ( t ) + c 1 r 1 ( Δ θ l ) + c 2 r 2 ( Δ θ g ) (9)


Δ θ l = { 2 π + θ i l j θ i j ( θ i l j θ i j < π ) θ i l j θ i j ( π θ i l j θ i j π ) θ i l j θ i j 2 π ( θ i l j θ i j > π ) , Δ θ g = { 2 π + θ g j θ i j ( θ g j θ i j < π ) θ g j θ i j ( π θ g j θ i j π ) θ g j θ i j 2 π ( θ g j θ i j > π )

And ω is a random number with inertia weight; c 1 , c 2 is a self-factor and a global factor respectively; r 1 , r 2 is a random number of (0, 1).

The probability amplitude of qubit on particles is updated as:

[ cos ( θ i j ( t + 1 ) ) sin ( θ i j ( t + 1 ) ) ] = [ cos ( Δ θ i j ( t + 1 ) ) sin ( Δ θ i j ( t + 1 ) ) sin ( Δ θ i j ( t + 1 ) ) cos ( Δ θ i j ( t + 1 ) ) ] [ cos ( θ i j ( t ) ) sin ( θ i j ( t ) ) ] = [ cos ( θ i j ( t ) + Δ θ i j ( t + 1 ) ) sin ( θ i j ( t ) + Δ θ i j ( t + 1 ) ) ] (10)

Among them i = 1 , 2 , , n ; j = 1 , 2 , , d , n and d are the number of population and the dimension of unknown variables, respectively.

Mutation: In the QPSO algorithm, quantum non-gate is used to mutate particles. First, the mutation probability K m is set, and each particle is given a random number r a n d i between (0, 1). If r a n d i < K m , then [n/2] qubits are randomly selected, and the mutation operation is carried out by using Equation (11), and the memorized optimal position and rotation angle vector remains unchanged.

[ 0 1 1 0 ] [ cos ( θ i j ) sin ( θ i j ) ] = [ sin ( θ i j ) cos ( θ i j ) ] = [ cos ( θ i j + π 2 ) sin ( θ i j + π 2 ) ] (11)

where i = 1 , 2 , , n ; j = 1 , 2 , , d .

Weight adjustment: In particle swarm optimization, inertia weight ω is an important parameter. If the value of ω is increased, the global search ability will be enhanced. If the value of ω is decreased, the local search ability will be enhanced. Equation (12) is used to realize the nonlinear dynamic adjustment of inertia weight:

ϖ = { ϖ min ( ϖ max ϖ min ) ( f f min ) f a v g f min , f f avg ϖ max , f > f a v g (12)

where f represents the real-time objective function value of particles; f min and f avg are the minimum and average moderate values of all particles.

3.2. Back Propagation Neural Network Construction

BP neural network modeling method: take the horizontal position, vertical position, amplitude and phase information of measuring apparent complex resistivity as the input information of neural network, and take the parameter information of model as the output information of the neural network.

In order to adapt to the multi-parameter characteristics of complex resistivity inversion, the BP neural network model obtained through numerical test is shown in Figure 3. The overall neural network has 12 input nodes in the input layer, 56 hidden neurons in two hidden layers (the first hidden layer has 46 neurons and the second hidden layer has 10 neurons), 4 output nodes in the output layer, and the overall topology is 12-46-10-4.

3.3. Training Process of Back Propagation Neural Networks

QPSO-BP algorithm mainly uses the global optimization ability of QPSO to optimize the initial weight and threshold of BP neural network. In order to obtain the best overall effect, BP neural network uses the optimized initial weight and threshold to continue training.

The inversion algorithm flow is as follows:

Figure 3. Schematic diagram of neural network structure.

Step 1: Determine the topology of BP neural network and the number of parameters to be optimized, and set the particle population dimension. Each individual qubit phase θ is a D-dimensional parameter vector corresponding to the weights and thresholds of BP neural network. Initialize the particle population and set the basic parameters of the algorithm, such as ϖ adjustment range [ ω min , ω max ] , self-factor c 1 , global factor c 2 , mutation probability K m .

Step 2: According to the upper and lower limits of each particle, the solution space is transformed. Then, according to Equation (13), calculate the particle fitness value, select and record the individual optimal position and group optimal position found in the solution space.

F k = 1 n j = 1 l ( e k j y k j ) 2 f i = 1 c n k = 1 c n ( F k ) 2 (13)

where, cn is the total number of inversion parameters, k is the number of inversion parameters, k = 1 , 2 , , c n , n is the total number of training samples, j is the number of training samples, j = 1 , 2 , , n . e k j and y k j are the expected output and actual neural network output of the j-th training sample of the k-th parameter, respectively. F k is the mean square error of the k-th parameter. f i is the fitness value of the i-th particle.

Step 3: particle state update, nonlinear dynamic adjustment of inertia weight, and qubit mutation calculation operations.

Step 4: Compare the appropriate value of each particle in order. Then the optimal particle position is recorded and updated as an individual optimal position. At the same time, the optimal position of each generation is sorted forward in the current evolution generation, and the optimal position of the individual is recorded and updated as the global optimal position.

Step 5: Identify whether the iteration meets the end condition, if it is satisfied, exit the algorithm and output the result, otherwise return to step 2 to continue the iterative calculation.

Step 6: The global optimal solution is used as the initial weight and threshold of BP neural network. Then we continue to train the neural network by using the BP elastic algorithm (RPROP). When the number of algorithm iterations reaches the maximum or the output error satisfies the requirements, output and save the network. At the last, we input the data volume which needs to be inverted into the network to obtain the QPSO-BP algorithm inversion result.

3.4. Performance Analysis of Inversion Algorithm

In this paper, we construct an apparent complex resistivity database with 48 single-polarization anomaly models. The forward simulation of the database model was calculated out by the finite element method described in Section 2. All the data are used for QPSO-BP neural network training. There are two sizes of abnormal models in the database; each of them has six different spatial locations. We also set a variety of contrast characteristics for these abnormal bodies, such as low resistance with high polarization, high resistance with low polarization. Five independent models are used to test the generalization ability of the algorithm. The test data is not involved in neural network training. Part of the sample model used for training is shown in Figure 4.

At the same time, QPSO algorithm and basic PSO algorithm are used to optimize the initial value and threshold of BP neural network. Set the particle population size of QPSO algorithm to 80, set the evolution generation to 100, ω max = 0.6 , ω min = 0.4 , c 1 = c 2 = 1.2 , K m = 0.35 . Set the particle population

Figure 4. Schematic diagram of partial training sample model.

size of basic PSO algorithm to 80, set the evolution generation to 100, ω = 0.5 , c 1 = 1.5 , c 2 = 2.5 . The fitness decline curves of the two algorithms are shown in Figure 5(a).

QPSO algorithm is easier to jump out of the local extreme value in the early calculation and converge to the global extreme value in the later calculation than the basic PSO algorithm with fixed weight because it has more particle number (sine solution and cosine solution) and nonlinear dynamic adjustment weight.

Using the global optimal solution as the initial weight and threshold of the BP neural network, and using the BP elastic algorithm (RPROP) to continue training the neural network, finally, the convergence curve of algorithm training error is shown in Figure 5(b). The optimized BP neural network can converge to the global optimal value more quickly, and its final training MSE is lower than that of the non-optimized network. At the same time, Figure 6 shows the difference of MSE distribution histogram between training and test samples under the two algorithms.

The BP neural network optimized by QPSO algorithm performs better than the BP neural network without initial optimization on the inversion training and test models, and the mean square error distribution is better. This shows that the BP neural network optimized by QPSO has a better training effect.


Figure 5. Decline curve of moderate value and training error. (a) Fitness decline curve of different algorithms; (b) Training error convergence curve.


Figure 6. Mean square error distribution Histogram of different algorithms. (a) The QPSO-BP algorithm; (b) The BP elastic algorithm (RPROP).

4. Research on Inversion Imaging of Typical Model

In order to verify the feasibility and accuracy of the QPSO-BP algorithm inversion, we established a model with two complex resistivity anomalies, and input the finite element simulation calculation data of the model as the test data into the algorithm for inversion; Figure 7 shows the model structure. Abnormal body No.1: size is 2 m × 3 m (Length × depth), ρ 0 = 50 Ω m , m = 0.6 , c = 0.2 , τ = 10 s ; Abnormal body No.2: size is 2 m × 3 m (Length × depth), ρ 0 = 500 Ω m , m = 0.4 , c = 0.3 , τ = 20 s , the horizontal distance between the two polarization anomalies is 10 m. A total of 37 electrodes are set on the surface, the electrode spacing is 1m, and the observation frequency points are 10-2 Hz, 10-1 Hz, 1 Hz, 10 Hz, 100 Hz, take the apparent complex resistivity amplitude and phase corresponding to the observed frequency points as the input of the QPSO-BP network and start the inversion calculation.

From the inversion results, as shown in Figure 8, the QPSO-BP inversion algorithm can more accurately describe the spatial shape of the anomaly and the four parameters to be inverted by the complex resistivity method. At the same time, the QPSO-BP inversion algorithm has a clearer description of the boundary of the abnormal body, and the inversion results are more consistent with the model, which reflects the strong nonlinear inversion ability of the algorithm.

In order to analyze the inversion effect of the algorithm more intuitively, we extracted the result data of each parameter in the inversion result data at z = 3.5 m and 8 m x 29 m , and compared them with the model data. As shown in Figure 9, the QPSO-BP inversion result corresponds well to the model value, and the boundary of the inversion result is clearly described, except for the slight deviation of the inversion result near the anomaly.

Figure 7. Schematic diagram of double polarized anomalous bodies model.

Figure 8. Inversion results of single double polarization anomalous body by using QPSO-BP algorithm. (a) The Resistivity; (b) The Chargeability; (c) The Relaxation-constant; (d) The Cole-Cole Time constant.

(a) (b) (c) (d)

Figure 9. Comparison of inversion results of QPSO-BP algorithm at z = −3.5 m. (a) The Resistivity; (b) The Chargeability; (c) The Relaxation-constant; (d) The Cole-Cole Time constant.

5. Conclusions

1) The BP neural network optimized by the QPSO algorithm performs better than the BP neural network without initial optimization on the inversion training and test models, and the mean square error distribution is better. This shows that the BP neural network optimized by QPSO has a better training effect.

2) The QPSO-BP algorithm can effectively invert the four parameters of complex resistivity, which corresponds well to the model value. At the same time, the inversion results clearly describe the abnormal boundary.

3) BP neural network has high recognition and association ability for trained samples or samples with similar characteristics, but poor recognition ability for models with different feature types. For the actual complex data inversion, the method proposed in this paper has limitations. The classical algorithm should be used as the basis for the construction of a neural network training sample database in the early inversion stage.

4) Despite this contribution, there are many remaining challenges for future work. First of all, due to the complexity of multi-parameter inversion of complex resistivity, the selected training samples should be close to the type of model to be inverted as much as possible, and it is essential to choose the right training models with appropriate characteristics. Secondly, the inversion method proposed in this paper has space limitations. The inversion of anomalous bodies outside the observed apparent resistivity profile needs to be further studied. Finally, using the algorithm in this paper to process the inversion of the actual complex resistivity data would be challenging work.


This paper is supported by the National Natural Science Foundation of China (Nos. 41974149, 41804106).

Cite this paper: Zhang, W. , Liu, J. , Yu, L. and Jin, B. (2021) Nonlinear Inversion for Complex Resistivity Method Based on QPSO-BP Algorithm. Open Journal of Geology, 11, 494-508. doi: 10.4236/ojg.2021.1110026.

[1]   Zhang, Z.-Y. and Zhou, F. (2014) 2.5D Modeling of Complex Resistivity Using Finite Element Method. Progress in Geophysics, 29, 2326-2331. (In Chinese)

[2]   Wang, J.Y. (2007) Introduction to Geophysical Inverse Problems. Chinese Journal of Engineering Geophysics, 4, 1-3.

[3]   Neyamadpour, A., Taib, S. and Wan Abdullah, W.A.T. (2009) Using Artificial Neural Networks to Invert 2D DC Resistivity Imaging Data for High Resistivity Contrast Regions: A MATLAB Application. Computers & Geosciences, 35, 2268-2274.

[4]   Dai, Q.-W., Jiang, F.-B. and Dong, L. (2014) Nonlinear Inversion for Electrical Resistivity Tomography Based on Chaotic DE-BP Algorithm. Journal of Central South University, 21, 2018-2025.

[5]   Ho, T.L. (2009) 3-D Inversion of Borehole-to-Surface Electrical Data Using a Back-Propagation Neural Network. Journal of Applied Geophysics, 68, 489-499.

[6]   Loke, M.H., Chambers, J.E. and Ogilvy, R.D. (2006) Inversion of 2D Spectral Induced Polarization Imaging Data. Geophysical Prospecting, 54, 287-301.

[7]   Son, J.S., Kim, J.H. and Yi, M.J. (2007) A New Algorithm for SIP Parameter Estimation from Multi-Frequency IP Data: Preliminary Results. Exploration Geophysics, 38, 60-68.

[8]   Blaschek, R., Hordt, A. and Kemna, A. (2008) A New Sensitivity-Controlled Focusing Regularization Scheme for the Inversion of Induced Polarization Data Based on the Minimum Gradient Support. Geophysics, 73, F45-F54.

[9]   Routh, P.S. and Oldenburg, D.W. (2001) Electromagnetic Coupling in Frequencydomain Induced Polarization Data: A Method for Removal. Geophysical Journal International, 145, 59-76.

[10]   Honig, M. and Tezkan, B. (2007) 1D and 2D Cole-Cole-Inversion of Time-Domain Induced-Polarization Data. Geophysical Prospecting, 55, 117-133.

[11]   Zhang, Z.Y., Tan, H.D., Wang, K.P., Lin, C.H. and Xie, M.B. (2016) Two-Dimensional Inversion of Spectral Induced Polarization Data Using MPI Parallel Algorithm in Data Space. Applied Geophysics, 13, 13-24.

[12]   Coggon, J.H. (1971) Electromagnetic and Electrical Modeling by the Finite Element Method. Geophysics, 36, 132-155.

[13]   Zonge, K.L. and Wynn, J.C. (1975) Recent Advances and Applications in Complex Resistivity Measurements. Geophysics, 40, 851-864.

[14]   Xu, S.Z. (1988) Selection of Wave Number K in Fourier Inverse Transformation for Point Source and 2-D Electric Field Problems. Computing Techniques for Geophysical and Geochemical Exploration, No. 3, 235-239.

[15]   Cai, J.T., Ruan, B.Y., Zhao, G.Z. and Zhu, G.P. (2007) Two-Dimensional Modeling of Complex Resistivity Using Finite Element Method. Chinese Journal of Geophysics, 50, 1615-1624.

[16]   Han, K.H. and Kim, J.H. (2002) Quantum-Inspired Evolutionary Algorithm for a Class of Combinatorial Optimization. IEEE Transactions on Evolutionary Computation, 6, 580-593.