The present study aims to investigate the factors affecting the choice of aspectual verbs “begin” or “start”, the factors affecting the choice of their complements, and the possible relation between the two choices in English Academic Writing. With the VARBRUL approach, a model has been found to account for these questions. The choice of “begin” or “start” is affected by the preceding syntactic tags, the choice of the complement is thus controlled by the choice of the aspectual verb, and both the two choices are affected by a social factor. In addition, the model of the VARBRUL analysis can be further applied to Natural Language Processing and English Academic Writing Teaching or Assistance, so a VARBRUL analysis is thus very economic. Other findings show the comparison of the model prediction among Logistic Regression, Decision-Tree-based Logistic Regression and Neural Network with linguistic data.
 Biber, D., Conrad, S., & Reppen, R. (1998). Corpus Linguistics: Investigating Language Structure and Use. New York: Cambridge University Press.
 Freed, A. F. (1979). The Semantics of English Aspectual Complementation. Dordrecht: Springer.
 Gries, S. T., & Hilpert, M. (2010). Modeling Diachronic Change in the Third Person Singular: A Multifactorial, Verband Author-Specific Exploratory Approach. English Language and Linguistics, 14, 293-320.
 Inkpen, D. (2007). A Statistical Model for Near-Synonym Choice. ACM Transactions on Speech and Language Processing, 4, 2.1-2.17.
 Johnson, D. E. (2009). Getting off the Goldvarb Standard: Introducing Rbrul for Mixed-Effects Variable Rule Analysis. Language and Linguistics Compass, 3, 359-383.
 Kilgarriff, A., & Tugwell, D. (2001). WORD SKETCH: Extraction and Display of Significant Collocations for Lexicography. In Proceedings of the ACL Workshop on COLLOCATION: Computational Extraction, Analysis and Exploitation (pp. 32-38). Toulouse: Association for Computational Linguistics.
 Labov, W. (1969). Contraction, Deletion, and the Inherent Variability of the English Copula. Language, 45, 715-762.
 Leitner, G. (1993). Where to Begin or Start? Aspectual Verbs in Dictionaries. In M. Hoey (Eds.), Data, Description, Discourse: Papers on the English Language in Honour of John McH Sinclair on His Sixtieth Birthday (pp. 50-63). London: HarperCollins.
 Lin, Y., Michel, J., Aiden, E. L., Orwant, J., Brockman, W., & Petrov, S. (2012). Syntactic Annotations for the Google Books Ngram Corpus. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, (pp. 169-174). Jeju Island, Korea: Association for Computational Linguistics.
 Mair, C. (2003). Gerundial Complements after Begin and Start: Grammatical and Sociolinguistic Factors, and How They Work against Each Other. In G. Rohdenburg &, B. Mondorf (Eds.), Determinants of Grammatical Variation in English (pp. 329-346). Berlin, New York: Mouton de Gruyter.
 Mair, C. (2009). Infinitival and Gerundial Complements. In P. Peters, P. Collins, & A. Smith (Eds.), Comparative Studies in Australian and New Zealand English: Grammar and Beyond (pp. 263-276). Amsterdam: John Benjamins.
 Professional English Research Consortium (n.d.). PERC Corpus.
 R Core Team (2013). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing.
 Reiter, E., & Sripada, S. (2004). Contextual Influences on Near-Synonym Choice. Proceedings of the International Natural Language Generation Conference, Brockenhurst, 14-16 July 2004, 161-170.
 Sigley, R. (2003). The Importance of Interaction Effects. Language Variation and Change, 15, 227-253.
 Szmrecsanyi, B. (2006). Morphosyntactic Persistence in Spoken English: A Corpus Study at the Intersection of Variationist Sociolinguistics, Psycholinguistics, and Discourse Analysis. Berlin, New York: Mouton de Gruyter.
 Therneau, T., Atkinson, B., & Ripley, B. (2013). Rpart: Recursive Partitioning. R Package Version 4.1-3.
 Young, R., & Yandell, B. (1999). Top-Down versus Bottom up Analysis. Studies in Second Language Acquisition, 21, 477488.