Similar to the rest of the world, the wind power industry in Canada has experienced significant growth over the last decade. The total Canadian wind capacity surpassed the 1000 MW mark in 2006 and it reached more than 11,000 MW in 2015  . In order to assist in the growth of wind energy, the Government of Canada took several initiatives to accelerate the development of renewable energy in the country. One of the government’s initiatives has been in the form of wind power production incentive programs, notably the Wind Power Production Incentive program (WPPI) and the EcoEnergy program (EcoERP)  . These programs subsidize wind energy projects based on their estimated annual energy production.
A study from Natural Resources Canada on the annual energy production (AEP) of 59 projects funded by the WPPI and EcoERP programs  has shown that, in 2011, while a capacity factor of 34.2% was expected for the wind farms benefitting from the programs, the effective capacity factor was only 29.9%. This difference means an underperformance of about 12.5% and represents significant losses in economic terms. This behavior of underperformance of wind farms has been observed year after year.
Besides the daily and seasonal variations, the wind resource on a specific site is influenced by the physical characteristics of the terrain. Carvalho et al.  showed that these characteristics are significantly enhanced when dealing with a complex terrain, where the wind predictions are more difficult to achieve. Thus, the estimation of the wind resource, and more specifically the annual energy production (AEP) using the wind speed distribution of the IEC 61400-12-1 standard, might lead to significant uncertainties  .
Studies have been published in the literature to assess the feasibility of wind energy in various conditions. For example, Rehman et al.   presented wind resource assessments, along with the design and the economic assessment of a 20 MW wind power plant, using 2 MW turbines, located in the Eastern region of Saudi Arabia. Specific to wind farms, Touani et al.  developed of a Wind to Power Model for wind farm power production forecasting, where wind farm power curves are used to convert the predicted wind speeds to predicted power productions of wind farms. In their work, they have however not considered the site characteristics of the wind farms.
Kwon  proposed a methodology to better assess the AEP of wind farms. While making some simplifying assumptions, this methodology introduces a new approach for long-term corrections, the vertical extrapolation of the wind distribution and the power performance of the wind turbines by taking into account the uncertainties. However, the effects of the terrain on the AEP are not considered.
It is known that the land cover (roughness) and terrain height variations (orography) influence the wind. When these effects are not well interpreted, the horizontal and vertical extrapolation of the wind speed can have significant uncertainties, thus providing erroneous AEP estimates.
The present study aims to better understand the effect of orography and roughness on the production capacity of wind farms and to develop a methodology to reduce the gap between the energy production estimates and the actual measured energy generation, and to develop a method to reduce these discrepancies.
The models studied are WAsP  and MS-Micro  , which are linear models based on the analysis of the theory of flow over hills by Jackson and Hunt  . The simplifications of the Navier-Stoke equations in the models generate uncertainties, notably when flow separation occurs.
Bowen and Mortensen   developed a methodology to evaluate the accuracy of the WAsP model in complex terrains. It has been shown    that a relationship, called the ruggedness index (ΔRIX), exists between the mean wind speed errors and a flow separation indicator.
Mortensen et al.  investigated the optimum configuration of the parameters for the RIX calculation and showed that there is also a relationship between the AEP errors and ΔRIX. A coefficient of determination (R2) of 97.7% was obtained between the ΔRIX and the AEP errors on five sites located in rugged mountainous areas of northern Portugal.
Berge et al.  also obtained good correlations between the ΔRIX and the mean wind speed errors on five mountainous sites in Norway by using WAsP. Moreover, they investigated the relationship between the wind speed errors and the differences in heights and horizontal distances. No correlation was visible between the mean wind speed errors and the horizontal distances and a weak correlation was observed between wind speed errors and the difference in heights.
Feng et al.  validated the ruggedness index methodology based on energy production with data from an existing wind farm. The energy production corrected was more accurate; however, AEP errors up to 9.4% were still observed. For their part, Jimenez et al.  investigated WAsP on two offshore, one onshore and three island sites located in northern Germany. Four sites correlated well with each other, with mean wind speed errors up to 2%, while the two other sites gave significant mean wind speed errors.
These studies show that methodologies to increase the accuracy of the WAsP model in complex terrains can give relatively good results. However, these methodologies do not remove all the errors in complex terrains. Moreover, it has been observed that significant AEP errors occur even on simple terrains, where the methodologies cannot be used.
Based on these studies, several indices have been developed to better identify the effect of the terrain on the AEP errors. According to these indices, a new methodology has been investigated which uses a multi-variable correlations to give more accurate results. Finally, the efficiency of this methodology will also be applied to the MS-Micro model.
Following a presentation of the measured production data available and the quality control performed on these data, the quantification of the AEP errors are presented. Thereafter, the indices created to characterize the sites in terms of roughness, slopes and the position of the wind turbines relative to the meteorological mast are introduced; this is followed by the correlations, based on the indices proposed, used to relate the AEP error and the site characteristics. Finally, the results of the analysis without improvement are presented and compared to the improvements obtained due to the methodology proposed in this work. A short conclusion and recommendations for future work ends the paper.
2. Measured Production Data
The production data measured from five Canadian wind farms, with a global installed capacity of 350 MW, have been used to perform this study. For confidentiality reasons, the information that identifies these wind farms is not divulged.
Wind Farm I is characterized as a very simple site, with a relatively flat terrain and low roughness classes. Wind Farms II and III are complex sites with steep terrains and high roughness classes (notably forest). Finally, Wind Farms IV and V are simple sites with small slopes and high roughness classes.
The measured meteorological data, contour maps, roughness maps and wind farm layouts have been provided by the owners of the wind farms.
The meteorological data are ten minute averages measured at one 80 m meteorological (met) mast for every wind farm, while the corresponding production data cover one year of energy production for every wind farm, except for Wind Farm I where two years of meteorological and production data are available.
A quality control has been performed on the met mast measured data according to three main steps. First, the missing values and the values in the sectors that are disturbed by the tower shadow and by the wake of wind turbines in proximity to the met masts have been removed. The disturbed sector calculations have been done according to the relevant IEC standard  . Then, following the approach of the Wind Resource Assessment Handbook  , data which did not satisfy one or more criteria (see Table 1) have been flagged. Finally, a visual inspection of the flagged data has been done to identify and remove time series where abnormal operations of the instruments have occurred.
A quality control has also been performed on wind turbine data. The first step in the quality control of wind turbine data is to eliminate the missing values, the values in the perturbed sectors by the wake of the wind turbines in proximity to the met mast, and the time series which are not available at the met mast. Then, the time series resulting in active power values and/or reactive power values equal to or below zero have been removed.
Since it is not common to use a met mast as far as 8 km from any wind turbine position when performing wind assessments, this study is limited to wind turbines located within a radius of 8 km from the corresponding wind farm met mast. Moreover, it has been observed that wind turbines located at a distance greater than 8 km have significant AEP errors (see Section 6.3).
3. Quantification of the AEP Errors
In order to have the largest amount of unperturbed data in the various analyses, each wind turbine has been analyzed individually. Thus 197 analyses have been
Table 1. Met mast quality control criteria for the measured data.
done for every numerical model (WAsP and Ms-Micro), which is the number of wind turbines available for this study.
To evaluate the accuracy of the analyses, the AEP errors between the measured values and the estimated values from the models have been calculated for each wind turbine:
where is the AEP calculated with the models and is the AEP measured as the output energy of the wind turbine.
Since the AEP estimated by the models do not take into account the energy losses, most of these loss events (availability losses, wake losses and icing losses) have been removed from the database when calculating the. Also, for the same reasons, the data from wind turbines that were not operating in normal conditions (e.g. failure of a major component of the wind turbine) have been removed from the analysis. The method used to identify these wind turbines is presented in Section 5. The effects of the electric losses in the analysis have been minimized by taking the energy measurements directly at the wind turbine output. Finally, it is assumed that any other losses, which are not considered in this study, are negligible and constant for all the wind turbines analyzed.
4. Index Classification
In order to evaluate the effect of the different site characteristics on the AEP, an index classification has been developed. The indices have been divided in three categories: an index related to the position of the wind turbines relative to the met mast, an index related to the orography characteristics and an index related to the roughness of the terrain.
The site characteristics (orography, roughness) have been taken from the vector maps provided by the wind farm owners. Thus, it is assumed that the maps provided are representatives of the site characteristics of the wind farms studied.
The position of the wind turbines relative to the met mast has been characterized by the horizontal distance between the wind turbines and the met mast, along with the difference of height between the hub of the turbines and the top measurement height at the met mast of the wind farm.
The terrain characteristics have been evaluated on ten degree sectors over a radius corresponding to 20 times the rotor diameter (D) and it includes two ruggedness parameters (RIX). By definition, the RIX is the fractional extent of the surrounding terrain which is steeper than a certain critical slope  .
The first parameter is called the drop index, RIX10, where the critical slope is 10%. This index has been based on a classification of the IEC  . Table 2 shows the different classes of the drop index.
The second parameter is the flow separation index, which is already used by WAsP to correct the AEP  . This method is based on the fact that a linear relationship exists between the difference of flow separation between the met mast area and the wind turbine area, and the AEP error  .
The minimum critical slope before separation of the flow has been the subject of several studies. Wood  summarized the critical slopes given by Grant and Mason  from various numerical studies of two dimensional flows. Table 3 provides a summary.
Taking into account the different values for the minimum critical slope for the separation of the flow  , a critical slope of 40% has been used in this work.
Using the roughness classes in the European Wind Atlas  , the land surrounding wind turbines can contain different types of roughness. However, the roughness complexity, denoted as the variation of roughness over an area of interest, cannot be properly quantified by the current roughness classes. To this
Table 2. Classes for the drop index RIX10.
Table 3. Critical slope before separation of the flow.
end, a new method of classification of the roughness has been developed to take into account the different roughness lengths and roughness variations over an area surrounding the wind turbines. This new classification has been described by the reference roughness length and the roughness complexity.
The reference roughness length is the average roughness length of the site and is obtained using the reference friction coefficient. From the equation of velocity distribution in a neutral boundary layer:
where κ is the Von Karman constant, U is the wind speed, is the friction velocity, z0 is the roughness length and z is the reference height. Considering the surface shear stress:
the friction coefficient is:
Currently, one of the most common hub height of wind turbines is approximately 80 meters, which is much higher than the blending height  . Thus, the reference height (z) for the evaluation of the friction coefficient has been fixed at 80 meters.
The roughness in the vicinity, but outside of a sector, may influence the fluid inside the sector, particularly near the wind turbine of interest. Thus, the reference roughness cannot only be defined from the roughness values within the sector delimitation. The considered area is taken as a rectangle with a certain width, as shown in Figure 1, which shows the area used to calculate the roughness influence in a specific sector.
The equation of the reference friction coefficient thus becomes:
Figure 1. Area used to evaluate the roughness influence in a specific sector.
where is the surface length at the surface n, R is the radius of the sector, is the friction coefficient at the surface n and is the reference friction coefficient. Figure 2 shows the friction coefficients over the considered area.
From Equation (4), the reference roughness length is:
Then, the roughness length is converted to roughness classes according to the European Wind Atlas  :
The roughness variations have been quantified as the sum of the differences of the friction coefficients on the site:
where is the roughness complexity index and is defined as:
where and are respectively the drag coefficients before and after the roughness change n.
Subsequently, the roughness complexity index has been divided in classes. The development of these classes has been done as follows: First, the roughness complexity index has been calculated for each ten degree sector of the wind turbines studied. Then, the 8028 roughness complexity indices have been analyzed statistically. Table 4 shows the resulting statistical parameters. Assuming
Figure 2. Friction coefficients over the considered area.
that the indices analyzed represent the range of possible in a wind farm area, the classes have been selected by quartiles (see Table 5).
5. Correlation Parameters of the Proposed Indices
To be able to evaluate the effect of the different proposed indices on the AEP accuracy, a multiple linear correlation, using the least square method, between the AEP error and the indices has been done.
The indices have been transformed mathematically to obtain a relationship between terrain characteristics at the met mast position and at the wind turbine position. Table 6 presents these parameters. On this basis, the correlation equation proposed in this work is:
Table 4. Statistical values of the CR analyzed.
Table 5. Classes for the roughness complexity index CR.
Table 6. Correlation parameters.
where a, b, c, d, e and f are the variables to be solved.
In order to avoid using suspicious data, usually resulting from situations which cannot be identified only by looking at the power curve, the wind turbines which have a different trend than most of the other wind turbines of the wind farms have been removed from the correlation. The methodology used to remove these wind turbines is based on the Peirce criterion  .
The Peirce criterion is a simple method to eliminate the outlier data which are not representative of the sample of data set. The suspicious measurements are eliminated when the following condition is fulfilled:
where is a measured data value, is the mean of the data set, is the “sample” standard deviation of the complete data set and P is the Pierce criterion. Ross  denoted the Pierce criterion as the representation of the ratio of the maximum allowable deviation of a measured value from the data mean to the standard deviation, namely:
6.1. Average Indices
The average indices obtained for each wind farm are shown in Table 7. The average indices give a good overview of the site complexity. It also shows that the proposed methodology is applicable to different categories of sites.
As mentioned in Section 2, Wind Farm I is characterized by a very simple terrain with a reference roughness of Class 1, a roughness complexity of Class 2 and a drop index of Class 1. Wind Farms IV and V are characterized by simple terrains with a reference roughness of Class 1, the roughness complexity is relatively high (Class 3) and the drop index is low (Class 2).
Wind Farms II and III have a relatively low reference roughness (Class 2) and a low roughness complexity (Class 2); however the drop index is high (Class 4)
Table 7. Average indices for each wind farm.
and flow separation is observed in these area. Thus, these wind farms are considered as complex terrains.
6.2. Annual Energy Production Errors
Figure 3 shows the average AEP errors and the average absolute AEP errors for the wind turbines, along with the global AEP errors for the wind farms. From Figure 3, it can be seen that for Wind Farm I, WAsP underestimates the AEP while MS-Micro gives better results but nonetheless overestimates the AEP.
Regarding the wind farms located in complex sites, both models underestimate the AEP of Wind Farm II, with an AEP error being relatively high by exceeding 10%. However, WAsP gives the best results for this wind farm. For its part, Wind Farm III is characterized by the largest AEP errors, where the models overestimate the AEP of Wind Farm III, with WAsP having the smallest AEP errors.
For the wind farms located in simple sites, the AEP of Wind Farm IV is overestimated by WAsP and MS-Micro; however, the AEP errors are relatively low, which is expected for a simple terrain wind farm. For this wind farm, MS-Micro gives the best results, albeit by a relatively small margin.
Figure 3. Average AEP errors between the measured values and the estimated values for both numerical models.
Finally, Wind Farm V has high average absolute AEP errors for the wind turbines, and these AEP errors are in the same order as the AEP errors for the wind farms in complex terrains. This result suggests that errors, or a component of the errors, are induced by characteristics that are not related to the terrain. For this wind farm, MS-Micro gives the best results.
As expected, these results show that the largest AEP errors occur for wind farms in complex terrains. Furthermore, it appears from these results, and for the wind farms studied, that MS-Micro gives better results than WAsP for wind farms characterized by simple sites, while, in contrast, WAsP gives better results for wind farms characterized by complex sites. This is only an observation since the numerous calculations done were not clearly indicating any physical reason for this behavior.
6.3. Example of Correlation Results
This section shows an example of detailed correlation results. For this purpose, Wind Farm III has been analyzed with MS-Micro; Table 8 shows the initial AEP errors.
As expected and as shown in Figure 4, especially in complex terrains, the distance of the wind turbines from the met mast has a significant influence on the AEPerror.
It has been observed that above 8 km, the influence of the distance on the AEPerror is so high that the correlation with the other parameters, enumerated in
Table 8. Initial AEP errors―wind farm III―MS-Micro model.
Figure 4. Influence of the distance on the AEPerror―wind farm III―MS-Micro model.
Table 6, is not representative. According to this observation, and in order to evaluate the influence of all the parameters, the wind turbines located at a distance above 8 km were removed from the analyses.
Figure 5 presents the correlation curve obtained for Wind Farm III using the parameters of Equation (11). The values of the parameters are given in Equation (14).
This correlation has an R2 of 96.8% and a mean absolute error of 2.2%. The AEP errors corrected and the improvement of this methodology are presented in Table 9.
Equation (15) shows the formulation for the AEP errors corrected, namely:
where is the calculated with the correlation equation.
Then, Equation (16) shows the improvement calculation:
6.4. Overall Results
Figure 5. Correlation results―wind farm III―MS-Micro model.
Table 9. Correction results―wind farm III―MS-Micro model.
Figure 6. AEP errors corrected for each wind farm.
the improvement obtained in predicting the AEP using the proposed methodology, respectively.
The AEP errors for the wind farms, initially up to 17%, were reduced to values below 5% when using the methodology based on the proposed indices. Similar observations are applicable for the AEP errors and the absolute average AEP errors for the wind turbines, where the corrected errors are respectively below 2% and 5%, with the exception of Wind Farm V.
It has been seen that Wind Farm V has relatively high AEP errors for a simple terrain wind farm. This observation shows that the AEP errors could be influenced by other parameters that this study does not take into account.
Nevertheless, the methodology proposed shows a significant improvement of the AEP errors, up to 98% for Wind Farm III. The average improvement is 83% for the average AEP errors for the wind turbines and 74% for the average AEP error of the wind farms.
7. Conclusion and Future Work
A methodology has been developed to reduce the errors in the prediction of the
Figure 7. AEP error improvement for each wind farm.
annual energy production (AEP) of wind farm power production. Various indices have been proposed to better identify the characteristics of wind farm sites. Notably, a roughness classification has been developed, which includes a reference roughness index and a roughness complexity index.
Moreover, a drop index, a flow separation index, the horizontal and vertical distance between the met mast and the wind turbines have also been proposed and used. These indices have been transformed mathematically to obtain relationships between terrain characteristics at the met mast locations and the wind turbine locations. Then, multiple linear correlations have been performed in order to develop equations of the predicted AEP error as a function of these indices.
The efficiency of this methodology has been proven by reducing the AEP errors by an average of 83% for the wind turbines and by an average of 74% for the wind farms.
The methodology could also be applied to the wind speed instead of the energy production. If the methodology is validated with the wind speed as the reference variable, it would be possible to use this methodology in the wind condition assessment studies before the implantation of wind turbines. Thus, the errors on the wind condition at the wind turbine locations and on the energy production assessment could be considerably reduced.
Some additional analysis could also be done to improve the classifications; notably, the variation of the radius of analysis, defined initially by 20 D, could be optimized.
Moreover, the terrain and the roughness indices could be weighted according to their distance from the turbine, while other indices could be included in the correlation (e.g. flow stability, turbulence, etc.).
This work has been done within the Wind Energy Strategic Network (WESNet), a Canadian research network supported by the Natural Sciences and Engineering Research Council (NSERC) of Canada and by industry. The authors are also very grateful to the PEI Energy Corporation and an undisclosed Canadian wind energy independent power producer for providing production data of their wind farms.
a Correlation coefficient (see Equation (11))
b Correlation coefficient (see Equation (11))
c Correlation coefficient (see Equation (11))
d Correlation coefficient (see Equation (11))
e Correlation coefficient (see Equation (11))
f Correlation coefficient (see Equation (11))
κ von Karman constant
l Distance between the turbine and the mast [m]
σ Sample standard deviation
ρ Air density [kg/m3]
τw Surface shear stress [N]
u* Friction velocity [m/s]
x Data value
z Elevation with respect to the ground [m]
zo Roughness length [m]
AEP Annual energy production [kWh]
Cd Friction coefficient
Class Roughness class
CR Roughness complexity
Improvement Improvement calculation (see Equation (16))
P Pierce criterion
R Radius of the sector [m]
RIX Ruggedness parameter
U Wind speed [m/s]
ΔCd Variation in friction coefficient
Δh Difference in turbine and mast heights [m]
Δr Surface length [m]
corrected related to corrected values
correlated related to the correlated values
error related to the relative error
estimated related to the estimation values
i related to a given value
measured related to the measurement values
n related to the n surface
ref related to reference value
Mast related to the mast position
Turbine related to the turbine position
1 related to the upstream roughness change
2 related to the downstream roughness change
10 computed values using 10% slope
40 computed values using 40% slope
Submit or recommend next manuscript to SCIRP and we will provide best service for you:
Accepting pre-submission inquiries through Email, Facebook, LinkedIn, Twitter, etc.
A wide selection of journals (inclusive of 9 subjects, more than 200 journals)
Providing 24-hour high-quality service
User-friendly online submission system
Fair and swift peer-review system
Efficient typesetting and proofreading procedure
Display of the result of downloads and visits, as well as the number of cited articles
Maximum dissemination of your research work
Submit your manuscript at: http://papersubmission.scirp.org/
Or contact firstname.lastname@example.org
 CanWEA, Canadian Wind Energy Association (2016) Installed Capacity.
 ecoERP (2016) ecoEnergy for Renewable Power, Natural Resources Canada. www.nrcan.gc.ca/ecoaction/14145
 Carvalho, D., Rocha, A., Santos, C.S. and Pereira, R. (2013) Wind Resource Modeling in Complex Terrain using Different Mesoscale-Microscale Coupling Techniques. Applied Energy, 108, 493-504.
 Jung, S., Vanli, O.A. and Kwon, S.D. (2013) Wind Energy Potential Assessment Considering the Uncertainties Due to Limited Data. Applied Energy, 102, 1492-1503.
 Rehman, S., Mahbub, A.M., Meyer, J.P. and Al-Hadhrami, L.M. (2012) Wind Speed Characteristics and Resource Assessment Using Weibull Parameters. International Journal of Green Energy, 9, 800-814.
 Rehman, S., Aftab, A. and Al-Hadhrami, L.M. (2011) Development and Economic Assessment of a Grid Connected 20 MW Installed Capacity Wind Farm. Renewable and Sustainable Energy Reviews, 15, 833-838.
 Touani, I., Yu, W., Gagnon, Y. and Masson, C. (2013) Development of a Wind to Power Model for Wind Farm Power Production Forecasting. Wind Engineering, 37, 347-368.
 Bowen, A.J. and Mortensen, N.G. (1996) Exploring the Limits of WAsP the Wind Atlas Analysis and Application Program. Proceedings of 1996 European Union Wind Energy Conference, Göteborg, 20-24 May 1996, 584-587.
 Mortensen, N.G., Bowen, A.J. and Antoniou, I. (2006) Improving WAsP Predictions in (too) Complex Terrain. Proceedings of 2006 European Wind Energy Conference and Exhibition, Athens, 27 February-2 March 2006, 175-183.
 Feng, S.-L., Wang, W.-S., Liu, C. and Dai, H.-Z. (2009) Study on the Error Evaluation Method of Calculated Energy Production by WAsP When the Terrain Gets Complex. International Conference on Sustainable Power Generation and Supply, Nanjing, 6-7 April 2009, 1-4.
 Jimenez, B., Durante, F., Lange, B., Kreutzer, T. and Tambke, J. (2007) Offshore Wind Resource Assessment with WAsP and MM5: Comparative Study for the German Bight. Wind Energy, 10, 121-134.
 Grant, A.L.M. and Mason, P.J. (1990) Observations of Boundary-Layer Structure over Complex Terrain. Quarterly Journal of the Royal Meteorological Society, 116, 159-186.
 Taylor, P.A., Gent, P.R. and Keen, J.M. (1976) Some Numerical Solutions for Turbulent Boundary Layer Flow above Fixed Rough, Wavy Surfaces. Geophysical Journal International, 44, 177-201.
 Mason, P.J. and King, J.C. (1984) Atmospheric Flow over a Succession of Nearly Two-Dimensional Ridges and Valleys. Quarterly Journal of the Royal Meteorological Society, 110, 821-845.