PSYCH  Vol.6 No.7 , June 2015
Technical Adequacy of the Student Protective Factors Screening Scale (SPF-7) as a Universal Screening Tool
Author(s) Julie Q. Morrison*
Universal screening is a critical foundation for school-based prevention and early intervention. This study examined the technical adequacy of the SPF-7, an instrument designed to assist school personnel in the early identification of students at-risk for emotional and behavioral concerns. The SPF-7 differs from other measures used in identifying emotionally and behaviorally at-risk students, as the SPF-7 focuses on protective factors rather than risk factors. The results of this study suggest that the SPF-7 has adequate test-retest reliability and criterion validity, but limited inter-rater agreement. The SPF-7 is a potentially promising tool for identifying students in need of support within a multi-tiered system of increasingly intensive interventions.

Cite this paper
Morrison, J. (2015). Technical Adequacy of the Student Protective Factors Screening Scale (SPF-7) as a Universal Screening Tool. Psychology, 6, 817-832. doi: 10.4236/psych.2015.67081.
[1]   Achenbach, T. (1985). Assessment and Taxonomy Child and Adolescent Psychopathology. Beverly Hills, CA: Sage.

[2]   Alvord, M. K., & Grados, J. (2005). Enhancing Resilience in Children: A Proactive Approach. Professional Psychology: Research and Practice, 36, 238-245.

[3]   Anderson, C. M., & Kincaid, D. (2005). Applying Behavior Analysis to School Violence and Discipline Problems: School-Wide Positive Behavior Support. Behavior Analyst, 28, 49-63.

[4]   Anastasi, A. (1988). Psychological Testing (6th ed.). New York: Macmillan.

[5]   Anderman, E. M., & Maehr, M.L. (1994). Motivation and Schooling in the Middle Grades. Review of Educational Research, 64, 287-309.

[6]   Appleton, J. J., Christenson, S. L., & Furlong, M. J. (2008). Student Engagement with School: Critical Conceptual and Methodological Issues of the Construct. Psychology in the Schools, 45, 369-386.

[7]   Barnett, D. W., Daly III, E. J., Jones, K. M., & Lentz Jr., F. (2004). Response to Intervention: Empirically Based Special Service Decisions from Single-Case Designs of Increasing and Decreasing Intensity. Journal of Special Education, 38, 66-79.

[8]   Bassarath, L. (2001). Conduct Disorder: A Biopsychosocial Review. Canadian Journal of Psychiatry, 46, 609-616.

[9]   Baumeister, R. F., & Leary, M. R. (1995). The Need to Belong: Desire for Interpersonal Attachments as a Fundamental Motivation. Psychological Bulletin, 117, 497-529.

[10]   Birch, S., & Ladd, G. W. (1997). The Teacher-Child Relationship and Children’s Early School Adjustment. Journal of School Psychology, 35, 61-79.

[11]   Bonny, A. E., Britto, M. T., Klostermann, B. K., Hornung, R. W., & Slap, G. B. (2000). School Disconnectedness Identifying Adolescents at Risk. Pediatrics, 106, 1017-1021.

[12]   Booth, A., & Dunn, J. F. (1996). Family-School Links: How Do They Affect Education Outcomes. Mahwah, NJ: Erlbaum.

[13]   Brown, B. B., & Huang, G. H. (1995). Examining Parenting Practices in Different Peer Contexts: Implications for Adolescent Trajectories. In L. J. Crockett, & A. C. Crouter (Eds.), Pathways through Adolescence: Relation to Social Contexts (pp. 151-174). Mahwah, NJ: Erlbaum.

[14]   Brown-Chidsey, R., & Steeg, M. (2005). Response to Intervention: Principles and Strategies for Effective Practice. New York: Guilford.

[15]   Cairns, R. B., Cairns, B. D., Neckerman, H. J., Gest, S. D., & Gariepy, J. L. (1988). Peer Networks and Aggressive Behavior: Peer Support or Peer Rejection? Developmental Psychology, 24, 815-823.

[16]   Canter, A. S., Lau, M. Y., & House, A. (2002). Best Practices in Developing Local Norms in Behavioral Assessment. In A. Thomas, & J. Grimes (Eds.), Best Practices in School Psychology, Fourth Edition (pp. 1099-1114). Bethesda, MD: National Association of School Psychologists.

[17]   Caprara, G. V., Barbaranelli, C., Pastorelli, C., Bandura, A., & Zimbardo, P. G. (2000). Prosocial Foundations of Children’s Academic Achievement. Psychological Science, 11, 302-306.

[18]   Catalano, R. F., & Hawkins, J. D. (1996). The Social Development Model: A Theory of Antisocial Behavior. In J. D. Hawkins (Ed.), Delinquency and Crime: Current Theories (pp. 149-197). New York: Cambridge University Press.

[19]   Christenson, S. L., Sinclair, M. F., Lehr, C. A., & Godber, Y. (2001). Promoting Successful School Completion: Critical Conceptual and Methodological Guidelines. School Psychology Quarterly, 16, 468-484.

[20]   Clark, R. M. (1993). Homework-Focused Parenting Practices That Positively Affect Student Achievement. In N. F. Chavkin (Ed.), Families and Schools in a Pluralistic Society. Albany, NY: State University of New York Press.

[21]   Coie, J. D., & Jacobs, M. R. (1993). The Role of Social Context in the Prevention of Conduct Disorder. Development and Psychopathology, 5, 263-275.

[22]   Connell, J. P., Halpern-Felsher, B. L., Clifford, E., Crichlow, W., & Usinger, P. (1995). Hanging in There: Behavioral, Psychological, and Contextual Factors Affecting Whether African American Adolescents Stay in High School. Journal of Adolescent Research, 10, 41-63.

[23]   Criss, M. M., Pettit, G. S., Bates, J. E., Dodge, K. A., & Lapp, A. L. (2002). Family Adversity, Positive Peer Relationships, and Children’s Externalizing Behavior: A Longitudinal Perspective on Risk and Resilience. Child Development, 73, 1220-1237.

[24]   de Wied, M., Goudena, P. P., & Matthys, W. (2005). Empathy in Boys with Disruptive Behavior Disorders. Journal of Child Psychology and Psychiatry, 46, 867-880.

[25]   DiPerna, J., & Elliott, S. N. (2000). Academic Competence Evaluation Scales. San Antonio, TX: Harcourt Assessment.

[26]   DiPerna, J. C., Volpe, R. J., & Elliott, S. N. (2002). A Model of Academic Enablers and Elementary Reading/Language Arts Achievement. School Psychology Review, 31, 298-312.

[27]   Dishion, T. J., Andrews, D. W., & Crosby, L. (1995). Antisocial Boys and Their Friends in Early Adolescence: Relationship Characteristics, Quality, and Interactional Process. Child Development, 66, 139-151.

[28]   Dishion, T. J., Patterson, G. R., Stoolmiller, M., & Skinner, M. L. (1991). Family, School, and Behavioral Antecedents to Early Adolescents Involvement with Antisocial Peers. Developmental Psychology, 27, 172-180.

[29]   Doll, B., & Hess, R. S. (2001). Through a New Lens: Contemporary Psychological Perspectives on School Completion and Dropping Out of High School. School Psychology Quarterly, 16, 351-356.

[30]   Doll, B., & Lyon, M. A. (1998). Risk and Resilience: Implications for the Delivery of Educational and Mental Health Services in Schools. School Psychology Review, 27, 348-363.

[31]   Drummond, T. (1993). The Student Risk Screening Scale (SRSS). Grants Pass, OR: Josephine County Mental Health Program.

[32]   Dunn, C. W., & Tucker, M. (1993). Black Children’s Adaptive Functioning and Maladaptive Behavior Associated with Quality of Family Support. Journal of Multicultural Counseling and Development, 21, 79-87.

[33]   Eccles, J. S., Wigfield, A., Midgley, C., Reuman, D., MacIver, D., & Feldlaufer, H. (1993). Negative Effects of Traditional Middle Schools on Students’ Motivation. The Elementary School Journal, 93, 553-574.

[34]   Eisenberg, N., Fabes, R. A., Shepard, S. A., Murphy, B. C., Guthrie, I. K., Jones, S., Friedman, J., Poulin, R., & Maszk, P. (1997). Contemporaneous and Longitudinal Prediction of Children’s Social Functioning from Regulation and Emotionality. Child Development, 68, 642-664.

[35]   Elliott, S. N., Huai, N., & Roach, A. T. (2007). Universal and Early Screening for Educational Difficulties: Current and Future Approaches. Journal of School Psychology, 45, 137-161.

[36]   Epstein, J. L. (1983). Longitudinal Effects of Family-School-Person Interactions on Student Outcomes. In A. Kerckhoff (Ed.), Research in Sociology of Education and Socialization (Vol. 4, pp. 101-128). Greenwich, CT: JAI.

[37]   Feil, E. G., Severson, H. H., & Walker, H. M. (2002). Early Screening and Intervention to Prevent the Development of Aggressive, Destructive Behavior Patterns among At-Risk Children. In M. R. Shinn, H. M. Walker, & G. Stoner (Eds.), Interventions for Achievement and Behavior Problems II: Preventive and Remedial Approaches. Bethesda, MD: The National Association of School Psychologists.

[38]   Finn, J. D. (1989). Withdrawing from School. Review of Educational Research, 59, 117-142.

[39]   Finn, J. D. (1993). School Engagement and Students at Risk. Washington DC: National Center for Education Statistics.

[40]   Finn, J. D., & Rock, D. A. (1997). Academic Success among Students at Risk for School Failure. Journal of Applied Psychology, 82, 221-234.

[41]   Fredericks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School Engagement: Potential of the Concept, State of the Evidence. Review of Educational Research, 74, 59-109.

[42]   Furlong, M. J., Whipple, A. D., St. Jean, G., Simental, J., Soliz, A., & Punthuna, S. (2003). Multiple Contexts of School Engagement: Moving toward a Unifying Framework for Educational Research and Practice. California School Psychologist, 8, 99-114.

[43]   Garnefski, N., & Diekstra, W. (1996). Perceived Social Support from Family, School, and Peers: Relationship with Emotional and Behavioral Problems among Adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 35, 1657-1664.

[44]   Gresham, F. M. (2002). Best Practices in Social Skills Training. In A. Thomas, & J. Grimes (Eds.), Best Practices in School Psychology IV (pp. 1029-1040). Bethesda, MD: National Association of School Psychologists.

[45]   Gresham, F. M. (2004). Current Status and Future Directions of School-Based Behavioral Interventions. School Psychology Review, 33, 326-343.

[46]   Gresham, F. M. (2005). Response to Intervention: An Alternative Means of Identifying Students as Emotionally Disturbed. Education and Treatment of Children, 28, 328-344.

[47]   Habedank, L. (1995). Best Practices in Developing Local Norms for Problem Solving in the Schools. In A. Thomas, & J. Grimes (Eds.), Best Practices in School Psychology (3rd ed., pp. 701-715). Washington DC: National Association of School Psychologists.

[48]   Henricsson, L., & Rydell, A. (2004). Elementary School Children with Behavior Problems: Teacher-Child Relations and Self-Perception. A Prospective Study. Merrill-Palmer Quarterly, 50, 111-138.

[49]   Hinshaw, S. (1987). On the Distinction between Attention Deficit/Hyperactivity and Conduct Problems/Aggression in Child Psychopathology. Psychological Bulletin, 101, 443-463.

[50]   Hinshaw, S. (1992). Externalizing Behavior Problems and Academic Underachievement in Childhood and Adolescence: Causal Relationships and Underlying Mechanisms. Psychological Bulletin, 111, 127-155.

[51]   Horner, R. H., Sugai, G., Todd, A. W., & Lewis-Palmer, T. (2005). School-Wide Positive Behavior Support. In L. Bambara, & L. Kern (Eds.), Individualized Supports for Students with Problem Behaviors: Designing Positive Behavior Plans (pp. 359-390). New York: Guilford Press.

[52]   Ikeda, M. J., Neessen, E., & Witt, J. C. (2008). Best Practices in Universal Screening. In A. Thomas, & J. Grimes (Eds.), Best Practices in School Psychology (5th ed., pp. 103-114). Bethesda, MD: National Association of School Psychologists.

[53]   Irvin, L. K., Horner, R. H., Ingram, K., Todd, A. W., Sugai, G., Sampson, N. K., et al. (2006). Using Office Discipline Referral Data for Decision Making about Student Behavior in Elementary and Middle Schools: An Empirical Evaluation of Validity. Journal of Positive Behavior Interventions, 8, 10-23.

[54]   Irvin, L. K., Tobin, T. J., Sprague, J. R., Sugai, G., & Vincent, C. G. (2004). Validity of Office Discipline Referral Measures as Indices of School-Wide Behavioral Status and Effects of School-Wide Behavioral Interventions. Journal of Positive Behavioral Interventions, 6, 131-147.

[55]   Jimerson, S. R., Campos, E., & Greif, J. L. (2003). Toward an Understanding of Definitions and Measures of School Engagement and Related Terms. California School Psychologist, 8, 7-27.

[56]   Kamphaus, R. W., & Reynolds, C. R. (2007). BASC-2 Behavioral and Emotional Screening System. Minneapolis, MN: Pearson.

[57]   Karcher, M. J. (2002). The Cycle of Violence and Disconnection among Rural Middle School Students: Teacher Disconnection as a Consequence of Violence. Journal of School Violence, 1, 35-51.

[58]   Karcher, M. J., Davis, C., & Powell, B. (2002). The Effects of Developmental Mentoring on Connectedness and Academic Achievement. School Community Journal, 12, 35-50.

[59]   Kavale, K. A., & Forness, S. R. (1998). Covariance in Learning Disability and Behavior Disorder: An Examination of Classification and Placement Issues. In T. E. Scruggs, & M. A. Mastropieri (Eds.), Advances in Learning and Behavioral Disabilities (pp. 1-42). Greenwich, CT: JAI Press.

[60]   Kazdin, A. (1987). Treatment of Antisocial Behavior in Children: Current Status and Future Directions. Psychological Bulletin, 102, 187-203.

[61]   Kazdin, A. E., Kraemer, H. C., Kessler, R. C., & Kupfer, D. J. (1997). Contributions of Risk-Factor Research to Developmental Psychopathology. Clinical Psychology Review, 17, 375-406.

[62]   Kern, L., & Manz, P. (2004). A Look at Current Validity Issues of School-Wide Behavior Support. Behavioral Disorders, 30, 47-59.

[63]   Kilgus, S. P., Chafouleas, S. M., &Riley-Tillman, T. C. (2013). Development and Initial Validation of the Social and Academic Behavior Risk Screener for Elementary Grades. School Psychology Quarterly, 28, 210-226.

[64]   Kochenderfer, B. J., & Ladd, G. W. (1996). Peer Vicitimization: Cause or Consequence of School Maladjustment? Child Development, 67, 1305-1317.

[65]   Kuperminc, G. P., Blatt, S. J., & Leadbeater, B. J. (1997). Relatedness, Self-Definition, and Early Adolescent Adjustment. Cognitive Therapy and Research, 21, 301-320.

[66]   Kupersmidt, J. B., & Coie, J. D. (1990). Preadolescent Peer Status, Aggression, and School Adjustment as Predictors of Externalizing Problems in Adolescence. Child Development, 61, 1350-1362.

[67]   Kupersmidt, J., Coie, J., & Dodge, K., (1990). The Role of Peer Relationships in the Development of Disorder. In S. Asher, & J. Coie (Eds.), Peer Rejection in Childhood (pp. 274-308). New York: Cambridge University Press.

[68]   Ladd, G. W., Kochenderfer, B. J., & Coleman, C. C. (1997). Classroom Peer Acceptance, Friendship, and Victimization: Distinct Relational Systems That Contribute Uniquely to Children’s School Adjustment? Child Development, 68, 1181-1197.

[69]   Lane, K. L., Kalberg, J. R., Parks, R. J., & Carter, E. W. (2008). Student Risk Screening Scale: Initial Evidence for Score Reliability and Validity at the High School Level. Journal of Emotional and Behavioral Disorders, 16, 178-190.

[70]   Lane, K. L., Menzies, H. M., Oakes, W. P., Kalberg, J. R. (2012). Systematic Screenings of Behavior to Support Instruction: From Preschool to High School. New York: Guilford Press.

[71]   Majoribanks, K. (1987). Ability and Attitude Correlates of ACADEMIC achievement: Family Group Differences. Journal of Educational Psychology, 79, 171-178.

[72]   Masten, A. S., & Coatsworth, J. D. (1998). The Development of Competence in Favorable and Unfavorable Environments: Lessons from Research on Successful Children. American Psychologist, 53, 205-220.

[73]   Malecki, C. K., & Elliott, S. N. (2002). Children’s Social Behaviors as Predictors of Academic Achievement: A Longitudinal Analysis. School Psychology Quarterly, 17, 1-23.

[74]   Marston, D. (2005). Tiers of Intervention in Responsiveness to Intervention: Prevention Outcomes and Learning Disabilities Identification Patterns. Journal of Learning Disabilities, 38, 539-544.

[75]   Morano, C. D., Cisler, R. A., & Lemerond, J. (1993). Risk Factors for Adolescent Suicidal Behavior: Loss, Insufficient Familial Support, and Hopelessness. Adolescence, 28, 851-865.

[76]   Morrison, G. M., Robertson, L., Laurie, B., & Kelly, J. (2002). Protective Factors Related to Antisocial Behavior Trajectories. Journal of Clinical Psychology, 58, 277-290.

[77]   Morrison, J. Q., Kobayashi, M., & Bolognone, J. (2007). Use of Protective Factors to Develop Behavioral Norms for English Language Learners. Unpublished manuscript, Dayton, OH: University of Dayton.

[78]   Mounts, N. S., & Steinberg, L. (1995). An Ecological Analysis of Peer Influence on Adolescent Grade Point Average and Drug Use. Developmental Psychology, 31, 915-922.

[79]   Murray, C., & Greenberg, T. (2000). Children’s Relationship with Teachers and Bonds with School. An Investigation of Patterns and Correlates in Middle Childhood. Journal of School Psychology, 38, 423-445.

[80]   National Research Council & Institute of Medicine (2004). Engaging Schools: Fostering High School Students’ Motivation to Learn. Washington DC: The National Academies Press.

[81]   Osher, D., Dwyer, K., & Jimerson, S. R. (2006). Safe, Supportive, and Effective Schools: Promoting School Success to Reduce School Violence. In S. R. Jimerson, & M. J. Furlong (Eds.), The Handbook of School Violence and School Safety: From Research to Practice (pp. 51-71). Mahwah, NJ: Lawrence Erlbaum.

[82]   Parker, J., & Asher, S. (1987). Peer Relations and Later Personal Adjustment: Are Low-Accepted Children At-Risk? Psychological Bulletin, 102, 357-389.

[83]   Patterson, G. R., DeBaryshe, B. D., & Ramsey, E. (1989). A Developmental Perspective on Antisocial Behavior. American Psychologist, 44, 329-335.

[84]   Piko, B. F., Fitzpatrick, K. M., & Wright, D. R. (2005). A Risk and Protective Factors Framework for Understanding Youth’s Externalizing Problem Behavior in Two Different Cultural Settings. European Child & Adolescent Psychiatry, 14, 95-103.

[85]   Pianta, R. C., Steinberg, M., & Rollins, K. (1995). The First Two Years of School: Teacher-Child Relationships and Deflections in Children’s Classroom Adjustment. Development and Psychopathology, 7, 295-312.

[86]   Putnam, R. F., Luiselli, J. K., Handler, M. W., & Jefferson, G. L. (2003). Evaluating Student Discipline Practices in a Public School through Behavioral Assessment of Office Referrals. Behavior Modification, 27, 505-523.

[87]   Reschly, A., & Christenson, S. L. (2006a). Promoting Successful School Completion. In G. Bear, & K. Minke (Eds.), Children’s Needs, III: Development, Prevention, and Intervention (pp. 103-113). Bethesda, MD: National Association of School Psychologists.

[88]   Reschly, A., & Christenson, S. L. (2006b). Research Leading to a Predictive Model of Dropout and Completion among Students with Mild Disabilities and the Role of Student Engagement. Remedial and Special Education, 27, 276-292.

[89]   Reynolds, A. J., & Wahlberg, H. J. (1991). A Structural Model of Science Achievement. Journal of Educational Psychology, 83, 97-107.

[90]   Roberts, W., & Strayer, J. (1996). Empathy, Emotional Expressiveness, and Prosocial Behavior. Child Development, 67, 449-470.

[91]   Ryan, B. A., Adams, G. R., Gullotta, T. P., Weissberg, R. P., & Hampton, R. L. (1995). The Family-School Connection: Theory, Research and Practice. Thousand Oaks, CA: Sage.

[92]   Scott-Jones, D. (1995). Parent-Child Interactions and School Achievement. In B. A. Ryan, G. R. Adams, T. P. Gullotta, R. P. Weissberg, & R. L. Hampton (Eds.), The Family-School Connection: Theory, Research and Practice (Vol. 2, pp. 75-107). Thousand Oaks, CA: Sage.

[93]   Severson, H. H., Walker, H. M., Hope-Doolittle, J., Kratochwill, T. R., & Gresham, F. M. (2007). Proactive, Early Screening to Detect Behaviorally At-Risk Students: Issues, Approaches, Emerging Innovations, and Professional Practices. Journal of School Psychology, 45, 193-223.

[94]   Smokowski, P. R., Mann, E. A., Reynolds, A. J., & Fraser, M. W. (2004). Childhood Risk and Protective Factors and Late Adolescent Adjustment in Inner City Minority Youth. Children and Youth Services Review, 26, 63-91.

[95]   Spoth, R., Yoo, S., Kahn, J. H., & Redmond, C. (1996). A Model of the Effects of Protective Parent and Peer Factors on Young Adolescent Alcohol Refusal Skills. Journal of Primary Prevention, 16, 373-394.

[96]   Sprague, J. R., & Horner, R. H. (2006). School Wide Positive Behavioral Supports. In S. R. Jimerson, & M. J. Furlong (Eds.), The Handbook of School Violence and School Safety: From Research to Practice. Mahwah, NJ: Lawrence Erlbaum.

[97]   Steinberg, L. (1996). Beyond the Classroom: Why School Reform Has Failed and What Parents Need to Do. New York: Simon & Schuster.

[98]   Steinberg, L., Lamborn, S. D., Dornbusch, S. M., & Darling, N. (1992). Impact of Parenting Practices on Adolescent Achievement: Authoritative Parenting, School Involvement, and Encouragement to Succeed. Child Development, 63, 1266-1281.

[99]   Steinhausen, H., & Metzke, W. (2001). Risk, Compensatory, Vulnerability, and Protective Factors Influencing Mental Health in Adolescence. Journal of Youth and Adolescence, 30, 259-280.

[100]   Stevenson, H. W., Chen, C., & Lee, S. Y. (1993). Mathematics Achievement of Chinese, Japanese, and American Children: Ten Years Later. Science, 259, 53-58.

[101]   Stoner, G. (2006). School Psychology and Screening for Problems. The School Psychologist, 60, 104-105, 132.

[102]   Strayer, J., & Roberts, W. (2004). Empathy and Observed Anger and Aggression in Five-Year-Olds. Social Development, 13, 1-13.

[103]   Sugai, G., & Horner, R. H. (2002). Introduction to the Special Series on Positive Behavior Support in Schools. Journal of Emotional and Behavioral Disorders, 10, 130-135.

[104]   Sugai, G., Sprague, J. R., Horner, R. H., & Walker, H. M. (Eds.). (2001). Preventing School Violence: The Use of Office Discipline Referrals to Assess and Monitor School-Wide Discipline Intervention (reprinted chapter). Austin, TX: Pro-Ed, Inc.

[105]   Todis, B., Severson, H. H., & Walker, H. M. (1990). The Critical Events Scale: Behavioral Profiles of Students with Externalizing and Internalizing Behavior Disorders. Behavioral Disorders, 15, 75-86.

[106]   Walker, H. M., Block-Pedego, A., Todis, B., & Severson, H. (1991). School Archival Records Search. Longmont, CO: Sopris West.

[107]   Walker, H. M., Colvin, G., & Ramsey, E. (1995). Antisocial Behavior in School: Strategies and Best Practices. Pacific Grove, CA: Brooks/Cole.

[108]   Walker, H. M., & Shinn, M. A. (2002). Structuring School-Based Interventions to Achieve Integrated Primary, Secondary, and Tertiary Prevention Goals for Safe and Effective Schools. In M. Shinn, H. Walker, & G. Stoner (Eds.), Interventions for Academic and Behavior Problems II (pp. 1-26). Bethesda, MD: National Association of School Psychologists.