Back
 JWARP  Vol.11 No.5 , May 2019
Comparing the Effects of Inputs for NTT and ArcAPEX Interfaces on Model Outputs and Simulation Performance
Abstract: The Agricultural Policy/Environmental eXtender (APEX) model has five different interfaces used to process and build simulation projects. These interfaces utilize different input databases that lead to different model default values. These values can result in different hydrologic, crop growth, and nutrient flow model outputs. This study compared structural and input value differences of the ArcAPEX and Nutrient Tracking Tool (NTT) interfaces. Long-term, water quality data from the Rock Creek watershed, located in Ohio were used to determine the impact of the differences on computation time, parameter sensitivity, and streamflow, total nitrogen (TN), and total phosphorus (TP) simulation performance. The input structures were the same for both interfaces for all files except soils, where NTT assigns three soil files per field, rather than a single one in ArcAPEX. As a result, computation times were three times as long for NTT as for ArcAPEX. There were twelve sensitive parameters in both cases, but the order of sensitivity was different. Both interfaces simulated streamflow well, but ARCAPEX simulated evapotranspiration, TN, and TP better than NTT, while NTT simulated crop yields better than ArcAPEX. However, none of the models met all of the performance criteria for either interface. Therefore, more work is needed to ensure models are properly calibrated before being used for scenario analysis. While it is acceptable for the values to be different from the SSURGO database, there is no documentation explaining the rationale for the modifications from the original source. This is one of the examples that highlights lack of detailed documentation that would be useful to model users. Overall, the results indicate that different interfaces lead to different model simulation results and, therefore, the authors recommend users specify the interface used and any modifications made to the associated databases when reporting model results.
Cite this paper: Nelson, A. , Moriasi, D. , Talebizadeh, M. , Tadesse, H. , Steiner, J. , Gowda, P. and Starks, P. (2019) Comparing the Effects of Inputs for NTT and ArcAPEX Interfaces on Model Outputs and Simulation Performance. Journal of Water Resource and Protection, 11, 554-580. doi: 10.4236/jwarp.2019.115032.
References

[1]   Mitsch, W.J., Day, J.W., Gilliam, J.W., Groffman, P.M., Hey, D.L., Randall, G.W. and Wang, N. (2001) Reducing Nitrogen Loading to the Gulf of Mexico from the Mississippi River Basin: Strategies to Counter a Persistent Ecological Problem Ecotechnology—The Use of Natural Ecosystems to Solve Environmental Problems—Should Be a Part of Efforts to Shrink the Zone of Hypoxia in the Gulf of Mexico. BioScience, 51, 373-388.
https://doi.org/10.1641/0006-3568(2001)051[0373:RNLTTG]2.0.CO;2

[2]   Moffat, A.S. (1998) Global Nitrogen Overload Problem Grows Critical. Science, 279, 988-989.
https://doi.org/10.1126/science.279.5353.988

[3]   Robertson, G.P. and Vitousek, P.M. (2009) Nitrogen in Agriculture: Balancing the Cost of an Essential Resource. Annual Review of Environment and Resources, 34, 97-125.
https://doi.org/10.1146/annurev.environ.032108.105046

[4]   Drewry, J.J., Newham, L.T.H., Greene, R.S.B., Jakeman, A.J. and Croke, B.F.W. (2006) A Review of Nitrogen and Phosphorus Export to Waterways: Context for Catchment Modelling. Marine and Freshwater Research, 57, 757-774.
https://doi.org/10.1071/MF05166

[5]   Korsaeth, A. (2008) Relations between Nitrogen Leaching and Food Productivity in Organic and Conventional Cropping Systems in a Long-Term Field Study. Agriculture, Ecosystems & Environment, 127, 177-188.
https://doi.org/10.1016/j.agee.2008.03.014

[6]   Arnold, J.G. and Allen, P.M. (1993) A Comprehensive Surface-Ground Water Flow Model. Journal of Hydrology, 142, 47-69.
https://doi.org/10.1016/0022-1694(93)90004-S

[7]   Williams, J.R. and Izaurralde, R.C. (2005) The APEX Model. BRC Rep. 2005-02. Blackland Res. Center, Texas A&M Univ., Temple.
https://doi.org/10.1201/9781420037432.ch18

[8]   Cornelissen, T., Diekkrüger, B. and Giertz, S. (2013) A Comparison of Hydrological Models for Assessing the Impact of Land Use and Climate Change on Discharge in a Tropical Catchment. Journal of Hydrology, 498, 221-236.
https://doi.org/10.1016/j.jhydrol.2013.06.016

[9]   Tegegne, G., Park, D.K. and Kim, Y.-O. (2017) Comparison of Hydrological Models for the Assessment of Water Resources in a Data-Scarce Region, the Upper Blue Nile River Basin. Journal of Hydrology: Regional Studies, 14, 49-66.
https://doi.org/10.1016/j.ejrh.2017.10.002

[10]   Douglas-Mankin K.R., Srinivasan, R. and Arnold, J.G. (2010) Soil and Water Assessment Tool (SWAT) Model: Current Developments and Applications. Transactions of the ASABE, 53, 1423-1431.
https://doi.org/10.13031/2013.34915

[11]   Gassman, P.W., Reyes, M., Green, C.H. and Arnold, J.G. (2007) The Soil and Water Assessment Tool: Historical Development, Applications, and Future Directions. Transactions of the ASABE, 50, 1211-1250.
https://doi.org/10.13031/2013.23637

[12]   Gassman, P.W., Williams, J.R., Wang, X., Saleh, A., Osei, E., Hauck, L.M., Izaurralde, R.C. and Flowers, J.D. (2010) The Agricultural Policy/Environmental eXtender (APEX) Model: An Emerging Tool for Landscape and Watershed Environmental Analyses. Transactions of the ASABE, 53, 711-740.
https://doi.org/10.13031/2013.30078

[13]   Geza, M. and McCray, J.E. (2018) Effects of Soil Data Resolution on SWAT Model Stream Flow and Water Quality Predictions. Journal of Environmental Management, 88, 393-406.
https://doi.org/10.1016/j.jenvman.2007.03.016

[14]   Gatzke, S.E., Beaudette, D.E., Ficklin, D.L., Luo, Y., O’Green, A.T. and Zhang, M. (2011) Aggregation Strategies for SSURGO Data: Effects on SWAT Soil Inputs and Hydrologic Outputs. Soil Science Society of America Journal, 75, 1908-1921.
https://doi.org/10.2136/sssaj2010.0418

[15]   Monks, A.M. (2016) Comparing Soil Datasets with the APEX Model: Calibration and Validation for Hydrology and Crop Yield in Whatcom County, Washington. Master’s Thesis, Western Washington University, Bellingham.

[16]   Peschel, J.M., Haan, P.K. and Lacey, R.E. (2006) Influences of Soil Dataset Resolution on Hydrologic Modeling. Journal of the American Water Resources Association, 42, 1371-1389.
https://doi.org/10.1111/j.1752-1688.2006.tb05307.x

[17]   Starks, P. and Moriasi, D. (2009) Spatial Resolution Effect of Precipitation Data on SWAT Calibration and Performance: Implications for CEAP. Transactions of the ASABE, 52, 1171-1180.
https://doi.org/10.13031/2013.27792

[18]   Glotter, M.J., Moyer, E.J., Ruane, A.C. and Elliot, J.W. (2015) Evaluating the Sensitivity of Agricultural Model Performance to Different Climate Inputs. Journal of Applied Meteorology and Climatology, 55, 579-594.
https://doi.org/10.1175/JAMC-D-15-0120.1

[19]   Tadesse, H.K., Moriasi, D.N., Gowda, P., Marek, G.W., Steiner, J.L., Brauer, D.K., Talebizadeh, M., Nelson, A.M. and Starks, P.J. (2018) Evaluating Evapotranspiration Estimation Methods in APEX Model for Dryland Cropping Systems in a Semi-Arid Region. Agricultural Water Management, 206, 217-228.
https://doi.org/10.1016/j.agwat.2018.04.007

[20]   Li, J. and Wong, D.W.S. (2010) Effects of DEM Sources on Hydrologic Applications. Computers, Environment and Urban Systems, 34, 251-261.
https://doi.org/10.1016/j.compenvurbsys.2009.11.002

[21]   Cho, S.-M. and Lee, M.W. (2001) Sensitivity Considerations When Modeling Hydrologic Processes with Digital Elevation Model. Journal of the American Water Resources Association, 37, 931-934.
https://doi.org/10.1111/j.1752-1688.2001.tb05523.x

[22]   Bailey, R., Rathjens, H., Bieger, K., Chaubey, I. and Arnold, J. (2017) SWATMOD-PREP: Graphical User Interface for Preparing Coupled SWAT-MODFLOW Simulations. Journal of the American Water Resources Association, 53, 400-410.
https://doi.org/10.1111/1752-1688.12502

[23]   Garrote, L. and Bras, R.L. (1995) An Integrated Software Environment for Real-Time Use of a Distributed Hydrologic Model. Journal of Hydrology, 167, 307-326. https://doi.org/10.1016/0022-1694(94)02593-Z

[24]   Juracek, K.E. and Wolock, D.M. (2002) Spatial and Statistical Differences between 1:250,000- and 1:24,000-Scale Digital Soil Databases. Journal of Soil and Water Conservation, 57, 89-94.
https://doi.org/10.2489/jswc.65.2.92

[25]   Mednick, A.C. (2010) Does Soil Data Resolution Matter? State Soil Geographic Database versus Soil Survey Geographic Database in Rainfall-Runoff Modeling across Wisconsin. Journal of Soil and Water Conservation, 65, 190-199.
https://doi.org/10.2489/jswc.65.3.190

[26]   Van Liew, M.W., Wortmann, C.S., Moriasi, D.N., King, K.W., Flanagan, D.C., Veith, T.L., McCarty, G.W., Bosch, D.D. and Tomer, M.D. (2017) Evaluating the APEX Model for Simulating Streamflow and Water Quality on Ten Agricultural Watersheds of the United States. Transactions of the ASABE, 60, 123-146.
https://doi.org/10.13031/trans.11903

[27]   Talebizadeh, M., Moriasi, D., Steiner, J.S., Gowda, P., Tadesse, H., Nelson, A.M. and Starks, P.J. (2018) APEXSENSUN: An Open-Source Package in R for Sensitivity Analysis and Model Performance Evaluation for the APEX Model. Journal of the American Water Resources Association, 54, 1270-1284.
https://doi.org/10.1111/1752-1688.12686

[28]   Nelson, A.M., Moriasi, D.N., Talebizadeh, M., Steiner, J.L., Confesor, R.B., Gowda, P.H., Starks, P.J. and Tadesse, H. (2017) Impact of Length of Dataset on Streamflow Calibration Parameters and Performance of APEX Model. Journal of the American Water Resources Association, 53, 1164-1177.
https://doi.org/10.1111/1752-1688.12564

[29]   Nelson, A.M., Moriasi, D.N., Talebizadeh, M., Steiner, J.L., Gowda, P.H., Starks, P.J. and Tadesse, H. (2018) Use of Soft Data for Multi-Criteria Calibration and Validation of APEX: Impact on Model Simulations. Journal of Soil and Water Conservation, 73, 623-636.
https://doi.org/10.2489/jswc.73.6.623

[30]   Williams, J.R., Izaurralde, R.C. and Steglich, E.M. (2008) Agricultural Policy/Environmental eXtender Model Theoretical Documentation Version 0604. BREC Report # 2008-17, AgriLife Research, Texas A&M, Blackland Research and Extension Center, Temple.
http://epicapex.tamu.edu/files/2013/02/the-apex-theoretical-documentation.pdf

[31]   Williams, J.R. (1990) The Erosion Productivity Impact Calculator (EPIC) Model: A Case History. Philosophical Transactions of the Royal Society of London, 329, 421-428.
https://doi.org/10.1098/rstb.1990.0184

[32]   Tuppad, P., Winchell, M.F., Wang, X., Srinivasan, R. and Williams, J.R. (2009) ArcAPEX:ArcGIS Interface for Agricultural Policy Environmental eXtender (APEX) Hydrology/Water Quality Model. International Agricultural Engineering Journal, 18, 59-71.

[33]   Siemers, M., Plotkin, S. and Gassman, P. (2014) Interactive APEX (i_APEX) User’s Guide to Using APEX2110 and APEX0806. Technical Report 14-TR 50, Iowa State University, Ames, 78.

[34]   Steglich, E.M. (2014) WinAPEX: An APEX Window’s Interface Users Guide. Blackland Research and Extension Center, Temple.

[35]   Saleh, A., Gallego, O., Osei, E., Lal, H., Gross, C., McKinney, S. and Cover, H. (2011) Nutrient Tracking Tool—A User-Friendly Tool for Calculating Nutrient Reductions for Water Quality Trading. Journal of Soil and Water Conservation, 66, 400-410.
https://doi.org/10.2489/jswc.66.6.400

[36]   Saleh, A., Osei, E. and Gallego, O. (2012) Evaluating Nutrient Tracking Tool (NTT) and Simulated Conservation Practices. 21st Century Watershed Technology Conference and Workshop, Bari, 27 May-1 June 2012, Paper No. 12-12940, 9 p.

[37]   Steglich, E.M. and Williams, J.R. (2013) Agricultural Policy/Environmental eXtender Model Users’s Manual: Version 0806. Blackland Research and Extension Center, Temple.

[38]   Saleh, A., Selman, M. and Gallego, O. (2018) Nutrient Tracking Tool (NTT): User Manual. Modeling Team at TIAER Tarleton State University, Stephenville.
http://ntt.tiaer.tarleton.edu/basic_help.pdf

[39]   Ohio Department of Natural Resources (1960) Water Inventory of the Maumee River Basin, Ohio. Division of Water, Ohio Water Plan Inventory, Rpt. No. 11, 112 p.

[40]   Ohio Department of Natural Resources (1966) Water Inventory of the Portage River and Sandusky River Basins and Adjacent Lake Erie Tributary Areas. Division of Water, Ohio Water Plan Inventory, Rpt. No. 20, 131 p.

[41]   Ohio Department of Natural Resources (1967) The Northwest Ohio Water Development Plan, a Comprehensive Program for All Phases of Water Management. Ohio Water Commission, Burgess & Niple Ltd., 299 p.

[42]   Meals, D.W., Richards, P., Confesor, R., Czajkowski, K., Bonnell, J., Osmond, D.L., Hoag, D.L.K., Spooner, J. and McFarland, M.L. (2012) Rock Creek Watershed, Ohio: National Institute of Food and Agriculture-Conservation Effects Assessment Project. In: Osmond, D.L., Meals, D.W., Hoag, D. and Arabi, M., Eds., How to Build Better Agricultural Conservation Programs to Protect Water Quality: The National Institute of Food and Agriculture-Conservation Effects Assessment Project Experience, Soil and Water Conservation Society, Ankeny, 316-326.

[43]   King, K.W., Fausey, N.R. and Williams, M.R. (2014) Effect of Subsurface Drainage on Streamflow in an Agricultural Headwater Watershed. Journal of Hydrology, 519, 438-445.
https://doi.org/10.1016/j.jhydrol.2014.07.035

[44]   PRISM Climate Group, Oregon State University (2015).
http://www.prism.oregonstate.edu

[45]   Baker, D.B., Confesor, R., Ewing, D.E., Johnson, L.T., Kramer, J.W. and Merryfield, B.J. (2014) Phosphorus Loading to Lake Erie from the Maumee, Sandusky and Cuyahoga Rivers: The Importance of Bioavailability. Journal of Great Lakes Research, 40, 502-517.
https://doi.org/10.1016/j.jglr.2014.05.001

[46]   Bjorneberg, D.L. and King, K. (2012) Water Balance for a West and Midwest Watershed. ASABE Annual International Meeting Proceedings, Dallas, 29 July 2012, Paper No. 12-1337056, 1-11.

[47]   Arnold, J.G., Youssef, M.A., Yen, H., White, M.J., Sheshukov, A.Y., Sadeghi, A.M., Moriasi, D.M., Steiner, J.L., Amatya, D.M., Skaggs, R.W., Haney, E.B., Jeong, J., Arabi, M. and Gowda, P.H. (2015) Hydrological Processes and Model Representation: Impact of Soft Data on Calibration. Transactions of the ASABE, 58, 1637-1660.
https://doi.org/10.13031/trans.58.10726

[48]   USDA: National Agricultural Statistics Service (2015) Ohio Agricultural Statistics 2015 Annual Bulletin. 17-18.

[49]   Ohio Department of Agriculture (2009) 2009 Ohio Agricultural Statistics. 41-42.

[50]   Williams, J.R., Izaurralde, R.C. and Steglich, E.M. (2012) Agricultural Policy/Environmental eXtender Model Theoretical Documentation Version 0806. Texas A&M AgriLife Blackland Research and Extension Center, Temple.
http://epicapex.tamu.edu/files/2014/10/APEX0806-theoretical-documentation.pdf

[51]   Confessor, R. (2015) Personal Communication, 8 October 2015. Heidelberg University, Tiffin.

[52]   Confessor, R. (2016) Personal Communication, 13 January 2016. Heidelberg University, Tiffin.

[53]   Hargreaves, G.H. and Samani, Z.A. (1985) Reference Crop Evapotranspiration from Temperature. Applied Engineering in Agriculture, 1, 96-99.
https://doi.org/10.13031/2013.26773

[54]   Yuan, Y., Khare, Y., Wang, X., Parajuli, P.B., Kisekka, I. and Finsterle, S. (2015) Hydrological and Water Quality Models: Sensitivity. Transactions of the ASABE, 58, 1721-1744.
https://doi.org/10.13031/trans.58.10611

[55]   Saltelli, A., Tarantola, S., Campolongo, F. and Ratto, M. (2004) Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models. John Wiley and Sons, Chichester, 218.

[56]   Gupta, H.V., Sorooshian, S. and Yapo, P.O. (1999) Status of Automatic Calibration for Hydrologic Models: Comparison with Multilevel Expert Calibration. Journal of Hydrology, 4, 135-143.
https://doi.org/10.1061/(ASCE)1084-0699(1999)4:2(135)

[57]   Nash, J.E. and Sutcliffe, J.V. (1970) River Flow Forecasting through Conceptual Models, Part 1—A Discussion of Principles. Journal of Hydrology, 10, 282-290.
https://doi.org/10.1016/0022-1694(70)90255-6

[58]   Moriasi, D.N., Arnold, J.G., Van Liew, M.W., Bingner, R.L., Harmel, R.D. and Veith, T.L. (2007) Model Evaluation Guidelines for Systematic Quantification of Accuracy in Watershed Simulations. Transactions of the ASABE, 50, 885-900.
https://doi.org/10.13031/2013.23153

[59]   Moriasi, D.N., King, K.W., Bosch, D.D., Bjorneberg, D.L., Teet, S., Guzman, J.A. and Williams, M.R. (2016) Framework to Parameterize and Validate APEX to Support Deployment of the Nutrient Tracking Tool. Agricultural Water Management, 177, 146-164.
https://doi.org/10.1016/j.agwat.2016.07.009

[60]   Wang, X., Williams, J.R., Gassman, P.W., Baffaut, C., Izaurralde, R.C., Jeong, J. and Kiniry, J.R. (2012) EPIC and APEX: Model Use, Calibration, and Validation. Transactions of the ASABE, 55, 1447-1462. https://doi.org/10.13031/2013.42253

[61]   Kirchner, J.W. (2006) Getting the Right Answers for the Right Reasons: Linking Measurements, Analyses, and Models to Advance the Science of Hydrology. Water Resources Research, 42, W03S04.
https://doi.org/10.1029/2005WR004362

[62]   Moriasi, D.N., Gitau, M.W., Pai, N. and Daggupati, P. (2015) Hydrologic and Water Quality Models: Performance Measures and Criteria. Transactions of the ASABE, 58, 1763-1785.
https://doi.org/10.13031/trans.58.10715

[63]   Saraswat, D., Frankenberg, J.R., Pai, N., Ale, S., Daggupati, P., Douglas-Mankin, K.R. and Youssef, M.A. (2015) Hydrologic and Water Quality Models: Documentation and Reporting Procedures for Calibration, Validation, and Use. Transactions of the ASABE, 58, 1787-1797.
https://doi.org/10.13031/trans.58.10707

[64]   Saxton, K.E. and Rawls, W.J. (2006) Soil Water Characteristic Estimates by Texture and Organic Matter for Hydrologic Solutions. Soil Science Society of America Journal, 70, 1569-1578.
https://doi.org/10.2136/sssaj2005.0117

[65]   Wang, T., Istanbulluoglu, E., Lenters, J. and Scott, D. (2009) On the Role of Groundwater and Soil Texture in the Regional Water Balance: An Investigation of the Nebraska Sand Hills, USA. Water Resources Research, 45, W10413.
https://doi.org/10.1029/2009WR007733

[66]   Easton, Z.M. and Bock, E. (2016) Soil and Soil Water Relationships. Virginia Cooperative Extension, Virginia State University, Petersburg, Publication BSE-194P, 9.

 
 
Top