In the recent years, the distributed generation (DG) has been increased in active distribution network and this is because of rapid development of intermittent renewable energy generation represented by wind and photovoltaics. Active component types and quantities have been increasing, so active distribution structure is still becoming more and more complex, and the distributed characteristics are becoming more prominent. The new requirements for the autonomy, operability and control of system have been put forward  . At the same time, there are a large number of controllable distributed resources in active distribution network such as energy storage, flexible load and so on. Energy storage has the ability to transfer power and energy; therefore, it has become an effective way to solve the problem of renewable energy access. The introduction of energy storage system (ESS) in active distribution network can effectively compensate for the problem of power system fluctuation caused by distributed renewable energy    . Flexible load is one of the most promising interactive resources in active distribution network due to its initiative and control capability. Making the full use of flexible load can effectively improve the impact of DG on distribution network and improve the adoptability of active distribution network.
It is difficult to fully collect real time data of DG, energy storage and flexible load by the existing data acquisition system in active distribution network. At the same time, the output of Distributed Renewable Energy DG has obvious randomness and volatility. The coordinated response of energy storage and flexible load get decentralized, and the traditional centralized control method has slow communication. Therefore, because of the large amount of calculation, it is difficult to realize the coordinated control of decentralized and time-varying active distribution network system. The Multi-Agent System (MAS) relies on its good autonomy, adaptability and coordination, it can meet the real-time interaction of different stakeholders and adapt to the development trend of the active distribution network. With the distributed characteristics and autonomous decision, models of MAS have obvious advantages in solving the coordination and optimization of complex active power distribution networks  -  ; the ref.  is based on increased activity and distribution of active distribution network, in order to increase the ductility of active distribution network, a multi agent control system for a new type of distribution network is proposed. Ref.  aims at the problem of low accuracy and scheduling risk of wind power forecasting, and puts forward the use of energy storage system (ESS) to improve the scale of wind power network, and evaluate its economic performance from two aspects of ESS operation benefit and income. In the ref.  , a multi-agent system (MAS) control model with multi-class load response is constructed, which is based on the characteristics of high density of commercial users. The coordinated control of the commercial load is carried out with the goal of user’s comfort; the distributed control of flexible load such as electric vehicle, air conditioner and water heater is discussed, which provides the basis for coordinated control of active distribution network. In Ref.  based on MAS, a distributed energy optimization model for active distribution networks, and control structure for regional autonomy and global coordination is proposed. The control strategy is studied from the global improved objective of the distributed energy and the active distribution network, the validity of the distributed control system to the active distribution network is proved, which improves the versatility and robustness of the system optimization model.
Therefore, based on the active distribution network security constraints, the market price guide, coordination of DG, energy storage and load and other benefits are important means to promote the utilization rate of Distributed Renewable Energy. Based on the hierarchical control structure of MAS, this paper proposes a distributed renewable energy coordination strategy based on price guidance and MAS regional agent target and active distribution network. It provides an effective method for the coordination of Distributed Renewable Energy consumption. Finally, the comprehensive performance of the proposed control strategy is evaluated by using the running index, and the validity of the MAS control model is verified by comparing the results of the traditional control method.
2. MAS Hierarchical Control Framework Design
2.1. MAS Structure
MAS is a kind of artificial intelligence computing method; its independent characteristics make it possible for electronic devices with common or conflicting goals to coexist in complex power systems. MAS based on JADE platform for Agent information interactive, distributed simulation based on JADE simulation platform has become an important research direction in recent years. JADE is to follow the FIPA specification, to achieve interoperability between Agents, while simplifying the process of MAS developing platform, Agent is the middleware to help Agent to achieve message encoding, message transmission, message resolution and message parsing work  .
In this paper, the characteristics of MAS communication and decision ordnance are adopted. A multi-agent structure for coordinated control of DG, ESS and flexible loads in an active distribution network is proposed. The control structure is shown in Figure 1. The MAS hierarchical structure of multi-agent model is used to control the DG, energy storage and load, and the hierarchical multi-agent model is shown in Figure 2.
1) Lead Agent (DNO): Starting from the global target, coordinating regional agents, setting up the regional catalytic signal to achieve the overall goal maximization;
2) Region Agent (DG, ESS, FL): In response to the driving signal of the Agent, the regional autonomy is realized according to the regional target;
3) Controlled Agent: To achieve the DG, energy storage devices, flexible load control, response to the regional Agent instructions.
2.2. MAS Coordination Process
Traditional time series simulation belongs to a simple set of power flow calculation
Figure 1. Multi-agent control structure in active distribution network.
Figure 2. MAS hierarchical multi-agent model.
at each time point; therefore, it is difficult to use the traditional sequential simulation method to highlight the initiative of DG and energy storage in active distribution network, at the same time, it is difficult to reflect the interaction between DG, ESS and flexible load. Compared with the traditional control methods, the decentralized decision making of MAS increases the uncertainty of the active distribution system operation, at the same time, the operation state of the system is optimized by the mutual influence and adjustment skills between DG, energy storage and flexible load.
This paper focused on DG in active distribution network, the coordinated control of energy storage and load is put forward, and the scheme of intensive optimization and decentralized control for MAS is proposed; DNO-Agent is mainly responsible for coordinating the power balance of the whole distribution network system, the controlled equipment in the regional Agent coordination area is adapted to the DNO optimization objective. The coordination process is shown in Figure 3. DNO send electricity price and distribution network information to regional Agent, regional Agent achieves coordinated response and feedback response scheme according to regional autonomy goal, DNO collect regional response plan, check system security, and make plans to feedback area Agent; When the zone agent initiates an active request to DNO, DNO coordinates the other regional agents to develop the scheme that implements the response to the regional agent request in case of system security.
3. Price Based Multi Agent Coordination Strategy
3.1. DNO-Agent Model
DNO-Agent is responsible for monitoring and maintaining the power balance and system power flow safety of the whole distribution network system. DNO send electricity price and distribution network information to regional Agent; Based on ensuring of overall supply, demand balance, safe and stable operation of the active distribution network, DNO receive a request from the area Agent or provide a response plan. DNO aims at minimizing coordination costs.
Figure 3. MAS coordinate control.
Type: is the price of t time; is the power generation of the grid; is the DG response; is the load response; is the energy storage response, the charge is positive, and the discharge is negative.
System security constraints are as follows:
1) Active power and reactive power flow constraint
Type: and respectively for the i node, active and reactive power; N is the total number of nodes; is the i node voltage; is the j node voltage; and are ij line conductance and electrical acceptance, respectively.
2) Node voltage constraints
Type: are node voltage lower and upper limit, respectively.
3) Branch power constraints
Type: is the upper limit of the transmission power of line L.
3.2. Regional Agent Model
DG-Agent achieves active response to DG energy management and active distribution network demand through coordinated control of distributed generation units in active distribution network. Distributed generation includes controllable power generation and uncontrollable power generation, in which uncontrolled power generation mainly refers to distributed renewable energy power generation. In the DG model, a controllable micro gas turbine and an uncontrollable fan generator are taken as examples. The wind turbine’s output model simulates its output by using Monte Carlo and two-parameter Weibull, output power is
where: is the output power of the first i wind turbine at t; the wind speed for the t moment; is the cut in wind speed; is the cut out wind speed; is the rated wind speed; is the rated capacity of the first i wind turbine.
The micro turbine meets the power constraint:
where: is the minimum output power of the gas turbine; are the actual output power of the gas turbine at t, and Maximum output power for gas turbine.
DG-Agent collects and manages the output status information of the gas turbines and wind turbine in the area, and ensures the safe operation of all the equipment in the Agent. Among them; the wind turbine output is not controllable, Agent should be controlled to maximize its absorptive capacity as the goal; the output of the gas turbine is controllable, which is mainly used to meet the demand of the wind turbine and the stored energy when the output power is not enough. The DG-Agent coordinated control function is shown in Figure 4.
At the initial moment, DNO sends the grid price and system load demand to DG-Agent, DG-Agent collects the power generation status and output power of controlled DG, Feedback to DNO for its own responsiveness; DNO takes the system power balance as the constraint, coordinates the Agent response of each region, determines the purchasing power and feedback DG-Agent; DG-Agent accept the remaining amount of distribution power of wind machine for calculating purchasing power, it maximizes the implementation of renewable energy generation in the region, stimulate the active distribution network storage and load response efforts. According to the remaining power of wind turbines, DG-Agent adjust the price of electricity, Initiate the consumptive request to DNO; DNO coordinates other regional Agent to meet the demand response of DG-Agent, and feedback the coordination purchase plan to DG-Agent. The DG-Agent accepts the response scheme, and if the renewable energy is left within the security constraint, the consumer request is initiated again.
It is worth emphasizing that, The DG-Agent coordination strategy is based on the remaining power and market price of the wind turbine, which stimulates the
Figure 4. Coordination control of DG-Agent.
energy storage and flexible load in the active distribution network to improve its consumption. When the wind turbine output surplus, the DG-Agent actively sends a power request to the DNO, the transmission of information including wind turbine power generation, the remaining adjusted price, the price adjustment is as follows:
where: is wind power price; is power grid tariff; and are price adjustment factors; is total power wind turbine for t of time; is residual or remaining power of wind turbine for time t.
ESS-Agent collects and manages the status information of the energy storage devices in the region, and coordinates the demand of the active distribution network on the basis of ensuring the safe operation of the energy storage, maximize the consumption of wind turbine power. Energy management is realized in the ESS-Agent to maximize the energy storage revenue in the area. Energy storage devices are generally limited by the capacity and storage charge status, and to extend life of the energy storage device in the system, overcharge and over discharge is not allowed. The state function is
where: for i storage device at t state of charge (SOC); and respectively in t device time charging and discharging power of the i storage; and the charge and discharge efficiency; and the charge and discharge power storage device; for the duration of the current state; and are the minimum and maximum allowable energy storage devices, Maximum charge state.
At the initial moment, DNO sends the power grid price to the ESS-Agent. Within the scope of security constraints, ESS-Agent determines the energy storage, discharge status and capacity of the stored energy according to the state of the energy storage device in the region and the price of the power grid, and feedback its response to the DNO; when DG-Agent initiate the launch request to DNO, DNO sends the wind power adjustment price and the remaining power generation to the ESS-Agent; ESS-Agent determines the storage state and power of stored energy according to the state of energy storage and the price of wind energy.
In the ESS-Agent regional control strategy, the charge and discharge behavior of the energy storage device is guided by the state of storage energy and the price of electricity, the aim of maximizing consumption of wind power and increasing its own income. The working state of the energy storage in the period is determined by considering the difference of the electricity price in different periods and the SOC state of the energy storage device in the current period, and the selection of the working strategy is shown in Table 1. ESS-Agent price based on DNO and information of active distribution network, combined with the state of energy storage to choose their own working state, at the peak load, the coordinated energy storage discharge can not only alleviate the system power supply pressure, but also maximize the energy storage benefits; When the load is low, the energy storage and charging is coordinated, which realizes the consumption of renewable energy, reduces the peak and valley load difference of the active distribution system, and reduces the charging cost. This strategy ensures safe operation of stored energy in the region, and based on income, improve the ability of the consumptive Distributed Renewable energy.
3.2.3. FL (Flexible Load) Agent
The behavior of flexible load is influenced by user’s preferences and environmental factors. It has strong controllability and is easily guided by electricity price and other environmental factors; through the coordination of flexible load control can realize the active power distribution system peak, and contribute to the consumptive renewable energy output.
FL-Agent collects and manages the status information of the flexible load in the area, in order to ensure the comfort of the users; the system controls the flexible load to respond to the DNO demand. At the initial time, the DNO sends
Table 1. Control of energy storage.
the power grid price to the FL-Agent, and the FL-Agent sends the response to the DNO according to the load demand in the area; When DG-Agent launched the consumptive requests to DNO, DNO send the wind power tariff adjustment and surplus generation to FL-Agent; FL-Agent responds the load response according to the state of the flexible loads and the safety constraints in the area. The response model of the flexible load in the model is
where: are the response quantities of flexible loads at t moments; is the total amount of flexible load in FL-Agent at time t; is the overall price elasticity coefficient of the flexible load; C for the comprehensive price; T is the whole work cycle; is the current grid price.
3.3. Price Based Interregional Coordination
When the active energy distribution network requests cannot be achieved within the DG Agent area distributed renewable energy consumption, the DG-Agent interacts with the DNO-Agent through the protocol mechanism to achieve the interactive protocol to realize the consumption of regional distributed renewable energy. There are two difficulties in the storage of renewable energy:
1) Hard mode: regional renewable energy consumptive is difficult, active distribution network energy coordination of renewable energy power surplus for . In order to achieve the distributed renewable energy consumption, reduce the abandoned wind, renewable energy should seek new response to the consumptive surplus. In the difficult mode, the amount of renewable energy power generation is large, Negative energy storage in the system, Flexible load again respond to the pressure of large consumption, DG-Agent significantly reduce the electricity price, The price adjustment Formula (7), hope to lower prices to stimulate and improve the system response efforts to promote renewable energy consumption.
2) Easy mode: regional renewable energy consumptive is easy, active distribution network energy coordination of renewable energy power surplus for . In an easy way, renewable energy generates less power, the pressure of load and energy storage is less, and DG-Agent reduces the price of electricity properly. The price adjustment is shown in type (7), in the promotion of renewable energy consumption while ensuring the economic benefits of DG agents. When renewables generate electricity, the DG-Agent adjusts the electricity price, DNO-Agent requests power consumption; DNO-Agent sends a request for renewable energy to other regional agents; ESS-Agent determines the working state of the energy storage according to the electricity price and the charged state of the stored energy in the region; FL-Agent determines the response of the regional load according to the change of electricity price; DNO receives the energy storage charge and the load response feedback, Check system flow, If the security returns DNO-Agent accommodation scheme, On the contrary, the DG-Agent refused to accept the request, requiring the wind.
4. Operational Level Evaluation
Operational level evaluation includes performance evaluation of active distribution network in terms of operating voltage level, system load and component economy. The comparison and analysis of different control methods not only need to compare with the index, but also analyze the whole performance. However, the dimension and nature of the evaluation indexes of active distribution network are different, and not all the indexes can be analyzed directly. Fuzzy Hierarchy Process, FAHP to achieve the complex multi-factor co-scale analysis, the subjective influence of the decision maker is even lower.
4.1. Fuzzy Comprehensive Analysis
FAHP is a combination of quantitative and qualitative analysis, and is suitable for multi-objective decision-making, It can analyze the non-sequential relations among multiple objectives, and avoid the bias caused by the subjective limitations of the analytic hierarchy process; it establishes the fuzzy consistency judgment matrix through the comparison of the influencing factors, the non-correlation qualitative relation between the indexes of distribution network is changed into quantitative weight relation, and reduce the influence of subjective definition weight value on the analysis result. In this paper, a fuzzy consistent judgment matrix is established by comparing the 22 of the influencing factors  , Quantitative conversion values for qualitative relationships between indicators are shown in Table 2.
The weight value of the index is calculated by using relation scale between indexes
Table 2. Relationships between elements.
where: is the index weight value; M is the total number of evaluation indexes; is the scaling relation between two indexes.
Convert all index results to non-dimensional and impactful values. The comprehensive evaluation score of the operation strategy is obtained by using the weight coefficient and the effective value of the index, the formula is
where: voltage variance; line impedance; line ij terminal reactive load; line ij first terminal voltage; Line ij Reactance; n Number of load nodes; System node load value; Stored energy output power; K Energy consumptive capacity; m Total energy storage device; Total load trough; Wind energy charge; B1 Energy arbitrage gains; Charge (discharge price); Charge (discharge power).
4.1.1. Voltage Operating Level
Voltage operating level includes system voltage deviation, Reactive stability. It is the main index to measure the quality of the power supply of the multi type energy in the active distribution network. The guarantee voltage excursion is the basic task of active power distribution system operation adjustment  .
The uncertainty of clean energy output and load fluctuation exacerbates the fluctuation of grid voltage largely  . In actual operation, adjustment of operating mode, DG and load timing fluctuations will lead to node voltage offset, the voltage deviation has a negative effect on the equipment in the system. In addition, the reactive load will also affect the stability of the system voltage, and its change will lead to sudden abrupt change in voltage.
4.1.2. Operating Peak Valley Difference
The introduction of renewable energy into the active distribution network is a problem that the power system has been trying to solve. The effective control of energy storage and load in active distribution network can reduce the negative
Table 3. Evaluation indicators.
impact of intermittent energy and promote the permeability of distributed renewable energy in power grid. On the other hand, the system can effectively adjust the peak and valley load difference, and alleviate the power supply pressure at the peak load of the distribution network.
Clamping peak filling is an important task of active distribution network optimization, which is an important index to measure the stability and reliability of distribution network. Peak daytime load, The energy storage discharge can effectively alleviate the load generation pressure on the generator and avoid the full load operation of the generator while reducing the system load shedding rate; When the night load is low, the randomness of wind power generation and the capacity of the system load are reduced. When the night load is low, the randomness of wind power generation and the reduced capacity of the system load are caused by the wind blows. The energy storage charge plays the role of “load”, which consumes excess wind energy and improves the utilization rate of wind energy, and for the daytime load peak energy storage discharge energy savings. For the power system, reducing the peak load difference can effectively delay the upgrading of power equipment capacity, improve equipment utilization, and reduce system cost. Furthermore, evaluation indexes and its significances are shown in Table 3.
4.1.3. Energy Storage Arbitrage
Because of the randomness and volatility of renewable energy sources, the presence of ESS is essential; the introduction of energy storage in active distribution network can increase the utilization rate of renewable energy and smooth load curve, and is an effective means to adjust the voltage and frequency of the system  . The high cost limits the large-scale application of energy storage in distribution network, and the maximization of profit with limited capacity is the goal of energy management optimization of active distribution network. It is also an important index to evaluate the energy storage economy systematically.
5. Case Study
5.1. Simulation Condition
In this paper, an active distribution network system with IEEE33 nodes is used. The validity and effectiveness of multi-agent operation control model and strategy for active power distribution network are analyzed and verified, the structure of the active distribution network is shown in Figure 5, and the installation information of DG and energy storage is shown in Table 4. In order to prolong the service life of the energy storage device, set , The initial state of stored energy is .
5.2. Simulation of Coordinated Control Based on MAS
In this paper, the peak price is adopted as the example, and the electricity price is shown in Table 5. In the model, DG, energy storage and load are based on the price to guide the formulation of Agent coordinated control strategy.
Figure 5. Active distribution network (AND) structure.
Table 4. The installation information of DG and ES.
Table 5. Electricity price of grid, kWh.
The simulation process of hierarchical control model for active distribution network is as follows: At the beginning of each period, the DNO-Agent initiates the request behavior in the MAS system and sends the price and the distribution network demand to the JADE service platform; DG-Agent collects the available electricity of the wind generator in the area, and makes the bidding strategy according to the electricity price and the electricity quantity, and feedback to service platform, and after the end of the single round bidding sale, if the remaining power, according to the remaining amount of electricity to modify the quotation, re apply to the DNO, to develop a new round of plans; ESS-Agent collects the status information of all the energy storage in the region, and develops the bidding scheme according to the current price and the energy storage state; FL Agent responds to the market price and the total controllable load at that time. The specific coordination process is shown in Figure 6.
It is worth emphasizing that, despite the adjusted schedule, DNO-Agent calculation is generated, and the system power flow security check is also generated by DNO, However, this is based on the operation data, data and coordination scheme provided by Agent in different regions. Compared with the centralized
Figure 6. Realization of coordinated control for active distribution network.
control, the centralized to decentralized model adopted in this paper can disperse the complex optimization process, at the same time, the processing speed of the system is faster and the operation difficulty is reduced.
5.3. Traditional Operation Model
In traditional operation model, the installation node, capacity and electrovalence of DG and energy storage, the wind turbine output model and the initial energy storage state are consistent with the model proposed in this paper. Each time period, the wind turbine and the micro gas turbine deliver the power generation to the distribution network, then the distribution network must force its output, DG output and consumption without price adjustment; the energy storage working state is related to the current storage energy, SOC and the power grid price, but stored energy can only be operated at one time. The output of distributed renewable energy sources does not have active regulation capability; in addition, the system does not have a flexible load under active management.
5.4. Results and Analysis
The load peak and valley difference of the active distribution network system leads to the increase of the investment cost and the decrease of the operation safety and stability. As can be seen from Figure 7, the peak load difference of the distribution system is about 9.57 MW in the traditional model, the system load peak and valley difference of the MAS control model mentioned in this paper is only 7.4 MW, compared to the traditional model of the peak load is reduced by 22%, therefore, this paper proposed a distributed control strategy is effective in regulating the system load than the traditional control strategy.
Figure 8 is the energy storage based on the ESS-Agent control model charging and discharging behavior and energy price, as can be seen from the diagram, the selling price of the wind power is different from the price of the power grid
Figure 7. Systematic load comparison of different control measures.
Figure 8. Energy storage coordination process in MAS.
at different times, When the power grid is at peak time, the wind turbine output is large, the energy storage discharge is flexible and the load response is flexible. In order to improve the amount of wind energy consumption, wind energy prices and grid price difference as high as 0.03 US$/kWh; When the power grid is in the valley, the electricity price, At the same time, consumption of energy storage and load, the price difference between wind energy and power grid is only 0.01 US$/kWh; Compared to the storage and discharge state of single energy storage centralized control, shown in Figure 9, MAS model of energy storage in power grid and electricity by wind power is composed of two parts, it directly reflects the storage of renewable energy consumption. In addition, the control strategy adopted in this paper increases the uncertainty of energy storage behavior, and fully explores the active decision-making ability of ESS-Agent to energy storage behavior, it makes the price guided ESS-Agent decision model more economical.
In this paper, the relationship between the element scale and the index weight is shown in Table 6. The operation performance of the distribution network under two control modes is evaluated by using the evaluation index, and the results are shown in Table 7. As can be seen from Table 6, the voltage operation level accounts for the largest value of the weight, and the economic value of the weight is the smallest, which conforms to the basic requirements of the safe operation of the power system.
Table 7, the load transfer index based on MAS coordination is only 15.2% of the traditional control model. It shows that the distributed control method has a significant effect on stabilizing the load fluctuation, and can effectively smooth the load curve; In addition, the voltage deviation index is 41.7% of the traditional control model, and the proposed method is more effective in controlling the
Figure 9. Energy storage coordination process of traditional model.
Table 6. Relationship between evaluation indexes and index weight.
Table 7. Index analysis of different control modes.
node voltage of active distribution network, and can effectively adjust the distributed DG, The adverse effects of load fluctuation on voltage improve the stability and power quality of active distribution network; From the stability index, the index values of all the nodes in the two models are stable at about 0.7, However, this strategy cannot improve the reactive power stability in the system.
The introduction of energy storage has promoted the rapid development of multi type power generation in active distribution network, and the core of energy storage coordination control is to explore the storage capacity and improve the storage economy. The comparison of energy storage arbitrage values from Figure 8 and two control methods is based on the ESS-Agent energy storage control strategy, the energy storage system’s annual revenue was 14% higher than the traditional model, we can see that the economy of the MAS model of energy storage in higher; The model presented in this paper can clearly monitor the actual working state and energy sources of energy storage devices, and reflect the promotion of energy storage to improve the permeability of Distributed Renewable Energy sources.
In addition, the use of Fuzzy Analytical Hierarchy Process (FAHP) to calculate the comprehensive score of two models, 10.34 points higher than the traditional MAS model, it is proved that the proposed control strategy of MAS based on active distribution network operation control is better than the traditional model control strategy.
In this paper, a price guidance coordination control strategy based on MAS is proposed. Considering the output characteristics of DG and the response characteristics of energy storage and load, a regional multi-agent model is established, and the energy management optimization of active distribution network is realized under the market mechanism; Furthermore, the performance of active distribution network is analyzed by using index. Compared to the traditional centralized control method, this model uses multi-agent information exchange characteristics, and increases the active distribution network operation uncertainty, making the simulation run process closer to the actual state; at the same time, the price factor is used to guide the coordination of the energy in the active distribution network, which highlights the active response capability of the energy storage and load, and increases the cooperation between the components. In addition, the evaluation indexes quantify the difference between the distributed control method and the traditional centralized control method, and it provides a train of thought for the subsequent research to choose the merits of different planning schemes.