Turkey has been facing the consequences of rapid population growth and unplanned urbanization like many other developing countries. Between 1950 and 1985, the population in the cities increased dramatically from 24.8% to 52.4%. Since 1985, the population living in the urban areas exceeded the rural population. While the average annual urban population growth rate for the country was 2.4% between 1990 and 2012, the estimated annual urban population growth rate between 2012 and 2030 is 1.6% . By 2012, the percentage of population living in cities has reached to 72.5%. Not only the increasing population growth but also both domestic and international migration fastened the transformation process from rural to urban areas in the last decades. Due to the geographical position Turkey has been experiencing an intense refugee flow, more than 4 million people, over the past decade. Besides, in 2012 the Law for metropolitan areas had changed in the country. With the Law No. 6360, 13 provinces redefined as metropolitan in addition to the existing metropolitan municipalities and the coverage of urban areas expanded. According to this definitional change statistics of urbanized population increased to 91.35% by the end of 2013 . Given all these factors, it is urgent to discuss and measure the sustainability of cities in Turkey.
The objective of this study is to measure and rank 81 counties in Turkey as alternatives, according to the urban sustainability framework. To solve this complex problem an Analytical Hierarchy Process (AHP) ratings method was proposed. The indicators combined and weighted according to experts’ evaluations in the model. The flexible characteristics of AHP ratings method were provided to compare a large number of alternatives by both qualitative and quantitative indicators. Thus, the model could also be useful in future comparisons.
2. Methodology and Data
2.1. Analytic Hierarchy Process
The Analytic Hierarchy Process (AHP) developed by Satty to provide a framework for dealing with decision-making problems and complex problems . It is a widely used method by decision makers and researchers for selection or ranking of alternatives in a wide range of problem types . The method is an effective and easy-to-understand tool used in complex problems both with qualitative and quantitative criteria. Combining with other linear programming techniques such as Data Envelopment Analysis, SWOT analysis is another advantage of the method .
The basic principles of AHP can be summarized as defining and determining the problem; decomposing the problem in a hierarchy from top through the intermediate levels; constructing a set of pair-wise comparison matrices; testing the consistency index; synthesizing the hierarchy to find out the ranks of the alternatives . AHP makes use of pair-wise comparisons to simplify the judgment process with 1 - 9 ratio scale in Table 1 .
In each level of the pairwise comparison matrix, created by assigning the relative weights of the elements using 1 - 9 scale, the elements are compared pairwise with respect to their importance to the element in the higher level. The pairwise comparison matrixes are formed as given in Equation (1). The score of aij in the pairwise comparison matrix symbolizes the relative importance of the element on the row (i) over the element on column (j).
Such that [ ] > 0.
After all pairwise comparisons are completed then the problem turns into general process to calculating the largest eigenvalue corresponding to eigenvector to assess the Consistency Index (CI). A is the matrix, w is the eigenvector and λmax is the largest eigenvalue of the matrix A.
When CI is divided by the Random Consistency Index (RI) the final value must be less than 0.10 . RI provided for different matrix orders in Table 2 .
There are two types of comparison in the AHP, relative measurement and absolute measurement. In relative measurement, each alternative is compared with other alternatives. However, in absolute measurement each alternative is compared with one ideal alternative . The absolute measurement method, also called ratings, is convenient in a large number of alternatives and the number of pair wised comparisons is much less than the relative measurement . Another advantage of the absolute measurement is adding or removing alternatives does not affect the old rankings . Also the number of alternatives and criteria does not cause a consistency problem in the ratings model .
Table 1. 1 - 9 comparison scale.
Table 2. Random consistency index (RI).
In absolute measurement, the hierarchy is developed as the same way in relative measurement. The goal of the problem exists at the top and it is followed by criteria and sub criteria hierarchically. The ratings are placed below the sub criterion. Ratings definitions may be qualitative and quantitative. For instance, a sub criterion can be decomposed into qualitative definitions such as hot, cold, low, high, far and near or can be defined quantitatively as certain numerical values or ranges as well. Each sub criterion could have different types and numbers of rating definitions. These definitions vary according to the problem studied. The definitions of the ratings must be carefully created in order to the experiences, the size of the alternatives and the knowledge of the experts to compare intensities. Alternatives do not need to be shown in the hierarchy since alternatives are not compared with each other.
2.2. Building the Hierarchy
In order to evaluate urban sustainability of cities a hierarchy three has been created with Super Decisions 2.8 software to apply the AHP ratings method. The hierarchy is presented in Figure 1.
The goal exists at the first level of the hierarchy that is comparing the sustainability of cities in Turkey. Since sustainability is considered with three components economic, environmental and social sustainability are presented at the second level of the hierarchy as criteria. At the third level of the hierarchy, five sub criteria under each criterion are placed.
The indicators under each criterion were determined by a three-stage elimination process. In the first part of the elimination, the literature was searched. The most frequently used indicators were listed among the urban sustainability studies and sustainable development indicator sets of international institutions. Thus, the indicators to represent the sustainability were identified. In the second
Figure 1. Hierarchy three of the urban sustainability model.
step, indicators were eliminated by statistical availability, easy to understanding, measurability and reliability principles by the experts. In the third step, the indicators took their final form by taking into consideration the basic principles of the AHP method.
In the AHP method the indicators in the hierarchy should not interact with each other . Another principle is the “magic number 7: plus minus 2” rule. A rational pairwise comparison requires an effective number of criteria . Therefore, five indicators under each component of sustainability were selected and pairwise compared by the experts. Selected sub-criteria were listed in Table 3. In the analysis the period before the lawful definition change of metropolitan cities were taken into consideration.
Labor force participation rate, GDP per capita, investments made with incentive certificates, population per bank branch and non-performing loans of banks were chosen as sub criteria of economic sustainability component. Labor force participation rate statistics, refers to people available for work as a percentage of total population aged 15 to 64, and were obtained from Turkish Statistical Institution (Turkstat). The latest announced income statistics for the provinces were published by Turkstat in 2001. In the following years, income statistics were published only at regional and national level. Therefore, GDP per capita statistics were calculated according to the latest available data. To do so, first the share of national level of GDP for each province was calculated according to the last statistics on the provincial basis. Then the data at the regional level were demoted to the provincial level. In the last stage, per capita values were calculated. The
Table 3. Indicator list.
investment incentive certificates data were obtained from the Ministry of Economy to represent the investment capacity of the urban areas. Population per bank branch and non-performing loans of banks statistics, which represent the financial potential of the cities, were taken from Banking Regulation and Supervision Agency.
Air pollution, wastes, forests and water represent main themes of the environmental sustainability. Five indicators selected by the experts which are particulate equivalent, wastes, abstracted water, wastewater and forest area. Wastes, abstracted water, wastewater date are published by TURKSTAT every two years. Forest reserves data were obtained from General Directorate of Forestry. Particle equivalent indicator to represent the air pollution was computed by employing PM10 and SO2 data according to the particle equivalent formula (PE).
Urban safety, citizen participation, medical doctors per person, number of students per classroom and percentage of illiterate women were chosen as five sub-criteria of social sustainability component. Indicators represent the safety and security, social inclusion, health and education topics. The urban safety sub-criteria calculated as the sum of traffic accidents occurred within a year in a province, those affected by these accidents (the number of dead and wounded) and the number of convicts entering the prison according to the crime per 100,000 people.
2.3. Selection of Experts
Since there is no general rule about the selection of experts, there are various studies implemented with different numbers of experts in the literature. Gómez-Navarro et al.  worked with 5 experts from the public and private sector in their study. Saaty  determined the weights of the indicators with 6 experts. Köne and Büke  studied with twenty-five experts. Ramanathan and Ganesh  made interviews with different interdisciplinary groups. Oddershede, Arias and Cancino  applied the pairwise comparison questionnaires to 50 experts. In AHP studies, the knowledge level of the consulted experts’ is more important than the number of experts. Besides, there should be a diversity of their study field .
In this study, the interviews of environmental sustainability dimension were made with environmental engineers. Selected experts are specialized on environmental sustainability and working in municipalities and private sector. For social and economic sustainability dimensions of the study, academicians were chosen who study specifically on social and economic sustainability topics. It was studied with five experts for each component, fifteen experts in total. Face-to-face interviews made with experts and paired comparison matrices generated for each criteria and sub criteria.
In order to make the definition of the ratings, the statistical series of each indicator were sorted from the lowest to the highest. Then they were divided into three groups such as low, medium and high. After making the rating definitions for each indicator, the standard deviations of the series of the indicators were calculated. The alternatives, which are at the boundaries, have been moved to an upper or lower group according to the direction of the indicators whether the contribution of the indicator to sustainability is negative or positive. Since the weights of the rating definitions for each indicator are different, the experts have also compared the rating definitions. These weights were calculated by the geometric mean method and the inconsistency rates were also checked. All calculations are below the critical value 0.10.
2.5. Calculation of Weights
Aczel and Saaty  recommended the geometric mean method to evaluate the expert’s pairwise comparisons together. When number of judges is not large enough then the geometric mean can be obtained . Additionally, the most widely used method in the literature is the geometric meaning method . Thus, the weights are calculated by geometric mean method in this study. The weights calculated from pairwise comparisons of experts for criteria or in other words, components of sustainability are given in Table 4. According to the results, experts weighted the environmental sustainability by 44.3% as the most important component to ensure urban sustainability. Social and economic sustainability components are weighted 38.8% and 16.9% respectively. These results reveal the environmental concerns for urban sustainability on the ecological perspective.
The calculated weights of the urban sustainability sub criteria are given in Table 5. The weights reflect the substance that the experts give to each criterion for urban sustainability. GDP per capita is the highest weighted factor of the economic sustainability component. It is followed by investments with incentive certificate, labor force participation rate, non-performing loans of banks and, population per bank branch. The weights given to water abstraction per capita and wastewater per capita are the most important factors weighted 40.83% and 28.36% respectively, to consider urban environmental sustainability. Particulate equivalent, wastes and forest area are weighted comparatively least important. According to the weights calculated for the social sustainability urban safety indicator acquired the highest weight. It is followed by medical doctors per person, citizen participation, the number of students per classroom and percentage of illiterate women, respectively.
Table 4. The weights derived for sustainability components.
Table 5. The weights of the sub-criteria.
According to the results obtained from the analysis, provinces ranked from the highest score to the lowest score. The sustainability scores of the provinces presented in Table 6 and Table 7. The “normal” column presents the sustainability results of alternatives. The “idealized values” column was derived from the normals column. These values were obtained by dividing the value of each alternative in the normals column by the highest value in the normals column. Therefore, in the idealized column of values, the best alternative with the highest score has a value of “1”. The “raws” result column was obtained directly from the supermatrix. In the hierarchical models, the column of raws and the column of normals are the same.
The results reflect the sustainability of cities relatively to others. According to the results, Eskisehir is the best performer. The city is located in the Eastern Marmara region, close to the two largest metropolitans, Ankara and Istanbul. Approximately 1% of the country’s population resides in Eskişehir. The city’s population density is 62 people per km2, below the average density of Turkey, 105 people per km2. Eskişehir provides significant advantages in education, health, transportation and social life opportunities. Eskişehir is followed by Çanakkale, Bursa, İzmir, Bilecik, Giresun, Edirne, Ankara, Rize and Manisa.
Locations of the most sustainable cities and least sustainable cities were visually
Table 6. Urban sustainability scores of the cities.
Table 7. Urban sustainability scores of the cities-2.
represented in Figure 2. The top ten provinces that received the highest sustainability scores were shown in the black circle and the provinces with the lowest scores were shown in the red circle. The map illustrates the geographical distribution of sustainability scores. Diyarbakir, Mardin, Muş, Kars, Bitlis, Yozgat, Sanliurfa, Van, and Batman are less sustainable cities that are located in the eastern part of the country. The provinces with high sustainability scores are mostly located in the western provinces.
Increasing urbanization has led to urban sustainability discussions since the country has been experiencing rapid population growth and migration. As a result of the process creating sustainable cities became a challenge. In this context, it is essential to measure the sustainability of urban areas.
Achieving urban sustainability requires monitoring the past and current performances of the cities. Thus, policymakers can evaluate the effects of their policies and monitor the progress towards sustainability. Moreover the strategies can be developed or changed according to the needs of society.
This study provides a new measurement approach to compare the urban sustainability by means of AHP ratings method based on the judgements of the experts. The urban sustainability of Turkish provinces was ranked through AHP ratings method since the method allows comparing a large number of the alternatives. Fifteen criteria were employed which have been grouped in three clusters related to economic, environmental and social sustainability. The results of the analysis have shown that provinces namely Eskişehir, Çanakkale, Bursa, İzmir, Bilecik, Giresun, Edirne, Ankara, Rize and Manisa have been considered more sustainable. On the other hand, Diyarbakir, Mardin, Muş, Kars, Bitlis, Yozgat, Sanliurfa, Van, and Batman have considered least sustainable provinces.
Figure 2. Urban sustainability comparison of the provinces.
From the point of regional development disparity, the Western provinces have higher sustainability rates compared to the Eastern provinces.
In terms of sustainability components, the study reveals another conclusion. The weights given by the experts to the indicators can help the decision makers to reconsider urban sustainability. The results have shown that environment is the main concern compared to social and economic pillars of sustainability. Water and wastewater management are considered as the most important factor to ensure environmental sustainability. In terms of economic sustainability, the weights given to the indicators reveal that the income level and investment potential of the cities are the most important indicators. Urban security and health are essential indicators to achieve social sustainability in urban areas.
As a result of this paper various policies are simply proposed below:
・ The model can be applied to different countries by modification of indicators and/or expert evaluations can be repeated. Consequently, the model can provide a measurement tool to support decision makers. Periodically calculated measurements can help to determine progress or performance losses.
・ Divergent models can be developed for each component of sustainability. Thus, economic, environmental and social sustainability performances can be evaluated specifically.
・ The steps to be taken by both central and local governments could contribute to the urban sustainability as a whole.
・ Sustainability awareness should be created for urban residents. Thus residents could capitalize to governmental sustainability projects and municipalities’ decisions.
 TURKSTAT (2018) The Results of Address Based Population Registration System.
 Saaty, T.L. (2006) Rank from Comparisons and from Ratings in the Analytic Hierarchy Network Processes. European Journal of Operational Research, 168, 557-570.
 Saaty, T.L. (1986) Absolute and Relative Measurement with the AHP. The Most Livable Cities in the United States. Socio-Economic Planning Sciences, 20, 327-331.
 Silva, A.C.S., Belderrain, M.C.N. and Pantoja, F.C.M. (2010) Prioritization of R&D Projects in the Aerospace Sector: AHP Method with Ratings. Journal of Aerospace Technology and Management, 2, 339-348.
 Ohnishi, S.I., Saito, T., Yamanoi, T. and Imai, H. (2011) A Weights Representation for Absolute Measurement AHP Using Fuzzy Sets Theory. 5th International Symposium on Computational Intelligence and Intelligent Informatics, Floriana, 15-17 September 2011, 67-70.
 Gómez-Navarro, T., García-Melón, M., Acuna-Dutra, S. and Díaz-Martín, D. (2009) An Environmental Pressure Index Proposal for Urban Development Planning Based on the Analytic Network Process. Environmental Impact Assessment Review, 29, 319-329.
 Kone, A.C. and Büke, T. (2017) Eco-Efficiency Analysis Using Analytic Hierarchy Process Approach. International Journal of the Analytic Hierarchy Process, 9, 167-182.
 Ramanathan, R. and Ganesh, L.S. (1995) Energy Resource Allocation Incorporating Qualitative and Quantitative Criteria: An Integrated Model Using Goal Programming AHP. Socio-Economic Planning Sciences, 29, 197-218.
 Oddershede, A., Arias, A. and Cancino, H. (2007) Rural Development Decision Support Using the Analytic Hierarchy Process. Mathematical and Computer Modelling, 46, 1107-1114.
 Ramanathan, R. (2001) A Note on the Use of the Analytic Hierarchy Process for Environmental Impact Assessment. Journal of Environmental Management, 63, 27-35.
 Melón, M.G., Beltran, P.A. and Cruz, M.C.G. (2008) An AHP-Based Evaluation Procedure for Innovative Educational Projects: A Face-to-Face Vs. Computer-Mediated Case Study. Omega, 36, 754-765.