Health  Vol.9 No.10 , September 2017
A Scale of Parental Anxiety about Pediatric Emergency Medical Care Services of Japan: Development, Reliability, Validity, Generalizability and Usefulness
Abstract: Aim: The purpose of this study was to develop a scale, “parental anxiety about pediatric emergency medical care services” (PAPEMCS), and to evaluate its psychometric properties. Methods: Participants were 14,510 parents with children 6 years old or younger in Kagawa Prefecture. Using each half of the participants, exploratory factor analysis was performed to generate items and factors for the PAPEMCS, and confirmatory factor analysis (CFA) was used to establish the construct validity. The generalizability of the PAPEMCS was evaluated by congruence tests and multigroup CFA. The usefulness of the PAPEMCS was established by the relationship between the PAPEMCS and non-urgent usage of pediatric emergency medical care services (PEMCS). Results: The PAPEMCS compromised 4 factors: “anxiety about quality of PEMCS”, “anxiety about PEMCS system”, “anxiety about public support”, and “anxiety about private support”. All reliability estimates (polychoric ordinal alpha coefficients, item-rest correlations), the item discrimination, 5 fit indices for CFA, the convergent validity (indicator reliabilities, composite reliabilities, average variance extracteds), and the discriminant validity fulfilled the acceptability thresholds. All generalizability estimates fulfilled the predetermined levels of acceptability (Tucker’s congruence coefficients, congruence tests, strict factorial invariance). The usefulness of the PAPEMCS was established by the higher scores of the PAPEMCS being related to non-urgent usage of PEMCS. Conclusions: The PAPEMCS demonstrated satisfactory reliability, validity, generalizability and usefulness. The PAPEMCS is useful to quantify the contents and extent of parental anxiety about PEMCS, and to clarify the mechanisms of non-urgent PEMCS usage.
Cite this paper: Sobue, I. , Tanimoto, K. and Itoh, S. (2017) A Scale of Parental Anxiety about Pediatric Emergency Medical Care Services of Japan: Development, Reliability, Validity, Generalizability and Usefulness. Health, 9, 1427-1458. doi: 10.4236/health.2017.910105.

[1]   American Academy of Pediatrics Committee on Pediatric Emergency Medicine (2004) Over Crowding Crisis in Our Nation’s Emergency Departments: Is Our Safety Net Unraveling? Pediatrics, 114, 878-888.

[2]   Moskop, J.C., Sklar, D.P., Geiderman, J.M., Schears, R.M. and Bookman, K.J. (2009) Emergency Department Crowding, Part 1—Concept, Causes, and Moral Consequences. Annals of Emergency Medicine, 53, 605-611.

[3]   Richardson, L.D. and Hwang, U. (2001) Access to Care: A Review of the Emergency Medicine Literature. Academic Emergency Medicine, 8, 1030-1036.

[4]   Massin, M. and Lepage, P. (2002) Observations and Reflections on the Management of Pediatric Emergencies in Belgium. Revue Medicale De Liege, 57, 591-598.

[5]   Berry, A., Brousseau, D., Brotanek, J.M., Tomany-Korman, S. and Flores, G. (2008) Why Do Parents Bring Children to the Emergency Department for Nonurgent Conditions? A Qualitative Study. Ambulatory Pediatrics, 8, 360-367.

[6]   Ganapathy, S., Lim, S.Y., Kua, J.P. and Ng, K.C. (2015) Non-Urgent Paediatric Emergency Department Visits: Why Are They So Common? A Singapore Perspective. ANNALS Academy of Medicine Singapore, 44, 269-271.

[7]   Brousseau, D.C., Hoffmann, R.G., Nattinger, A.B., Flores, G., Zhang, Y. and Gorelick, M. (2007) Quality of Primary Care and Subsequent Pediatric Emergency Department Utilization. Pediatrics, 119, 1131-1138.

[8]   Ohns, M.J., Oliver-McNeil, S., Nantais-Smith, L.M. and George, N.M. (2016) Nonurgent Use of the Emergency Department by Pediatric Patients: A Theory-Guided Approach for Primary and Acute Care Pediatric Nurse Practitioners. Journal of Pediatric Health Care, 30, 339-346.

[9]   Goh, G.L., Huang, P., Kong, M.C., Chew, S.P. and Ganapathy, S. (2016) Unplanned Reattendances at the Paediatric Emergency Department within 72 Hours: A One-Year Experience in KKH. Singapore Medical Journal, 57, 307-313.

[10]   Brousseau, D.C., Bergholte, J. and Gorelick, M.H. (2004) The Effect of Prior Interactions with a Primary Care Provider on Nonurgent Pediatric Emergency Department Use. Archives of Pediatrics and Adolescent Medicine, 158, 78-82.

[11]   Kennedy, T.J., Purcell, L.K., LeBlanc, J.C. and Jangaard, K.A. (2004) Emergency Department Use by Infants Less than 14 Days of Age. Pediatric Emergency Care, 20, 437-442.

[12]   Phelps, K., Taylor, C., Kimmel, S., Nagel, R., Klein, W. and Puczynski, S. (2000) Factors Associated with Emergency Department Utilization for Nonurgent Pediatric Problems. Archives of Family Medicine, 9, 1086-1092.

[13]   Wier, L.M., Yu, H., Owens, P.L. and Washington, R. (2013) Overview of Childrenthe Emergency Department, 2010: Statistical Brief #157. Agency for Healthcare Research and Quality, 1-12.

[14]   Chin, N.P., Goepp, J.G., Malia, T., Harris, L. and Poordabbagh, A. (2006) Nonurgent Use of a Pediatric Emergency Department: A Preliminary Qualitative Study. Pediatric Emergency Care, 22, 22-27.

[15]   Drummond, J., Schnirer, L., So, S., Mayan, M., Williamson, D.L., Bisanz, J., et al. (2014) The Protocol for the Families First Edmonton Trial (FFE): A Randomized Community-Based Trial to Compare Four Service Integration Approaches for Families with Low-Income. BMC Health Services Research, 14, 1-12.

[16]   Matziou, V., Brokalaki, H., Kyritsi, H., Perdikaris, P., Gymnopoulou, E. and Merkouris, A. (2008) What Greek Mothers Know about Evaluation and Treatment of Fever in Children: An Interview Study. International Journal of Nursing Studies, 45, 829-836.

[17]   Morrison, A.K., Chanmugathas, R., Schapira, M.M., Gorelick, M.H., Hoffmann, R.G. and Brousseau, D.C. (2014) Caregiver Low Health Literacy and Nonurgent Use of the Pediatric Emergency Department for Febrile Illness. Academic Pediatrics, 14, 505-509.

[18]   Morrison, A.K., Schapira, M.M., Gorelick, M.H., Hoffmann, R.G. and Brousseau, D.C. (2014) Low Caregiver Health Literacy Is Associated with Higher Pediatric Emergency Department Use and Nonurgent Visits. Academic Pediatrics, 14, 309-314.

[19]   Salami, O., Salvador, J. and Vega, R. (2012) Reasons for Nonurgent Pediatric Emergency Department Visits: Perceptions of Health Care Providers and Caregivers. Pediatric Emergency Care, 28, 43-46.

[20]   Neill, S.J., Jones, C.H., Lakhanpaul, M., Roland, D.T. and Thompson, M.J. (2016) Parents’ Help-Seeking Behaviours during Acute Childhood Illness at Home: A Contribution to Explanatory Theory. Journal of Child Health Care, 20, 77-86.

[21]   Neill, S.J. (2008) Family Management of Acute Childhood Illness at Home: A Grounded Theory Study. PhD Thesis, Nightingale School of Nursing and Midwifery, King’s College London, London, UK.

[22]   Parkinson, G.W., Gordon, K.E., Camfield, C.S. and Fitzpatrick, E.A. (1999) Anxiety in Parents of Young Febrile Children in a Pediatric Emergency Department: Why Is It Elevated? Clinical Pediatrics, 38, 219-226.

[23]   Kubicek, K., Liu, D., Beaudin, C., Supan, J., Weiss, G., Lu, Y., et al. (2012) A Profile of Nonurgent Emergency Department Use in an Urban Pediatric Hospital. Pediatric Emergency Care, 28, 977-984.

[24]   Richier, P., Gocko, X., Mory, O., Trombert-Paviot, B. and Patural, H. (2015) étude épidémiologique des consultations précoces de nouveaunés aux services d’accueil des urgences pédiatriques. [An Epidemiological Study of Early Consultations of Newborns in Pediatric Emergency Units.] Archives de Pédiatrie, 22, 135-140.

[25]   Rousseau, D.C., Nimmer, M.R., Yunk, N.L., Nattinger, A.B. and Greer, A. (2011) Noncurrent Emergency-Department Care: Analysis of Parent and Primary Physician Perspectives. Pediatrics, 127, e375-e381.

[26]   Graham, J.M., Fitzpatrick, E.A. and Black, K.J. (2010) “My Child Can’t Keep Anything Down!” Interviewing Parents Who Bring Their Preschoolers to the Emergency Department for Diarrhea, Vomiting, and Dehydration. Pediatric Emergency Care, 26, 251-256.

[27]   Hugenholtz, M., Bröer, C. and van Daalen, R. (2009) Apprehensive Parents: A Qualitative Study of Parents Seeking Immediate Primary Care for Their Children. British Journal of General Practice, 59, 173-179.

[28]   Watanabe, S., Nakazawa, M., Eto, Y., Ichikawa, K., Mori T., Tanaka, A., et al. (2006) Family Needs in Pediatric Emergency Department Use in Japan. The Journal of the Japan Pediatric Society, 110, 696-702.

[29]   Fieldston, E.S., Alpern, E.R., Nadel, F.M., Shea, J.A. and Alessandrini, E.A. (2012) A Qualitative Assessment of Reasons for Nonurgent Visits to the Emergency Department: Parent and Health Professional Opinions. Pediatric Emergency Care, 28, 220-225.

[30]   O’Malley, P.J., Brown, K. and Krug, S.E. and Committee on Pediatric Emergency Medicine (2008) Patient-and Family-Centered Care of Children in the Emergency Department. Pediatrics, 122, e511-e521.

[31]   Health Policy Unit, Graduate School of Public Policy, The University of Tokyo (2014) RH-PAC Community Medical Vision/The Guideline of Regional Medical Treatment Plan: Pediatric Medicine. [Cited 25 July 2017.] Available from URL:

[32]   Japan Pediatric Society (2010) Reformation of Pediatric Emergency Medical Service Advanced by Japan Pediatric Society. [Cited 25 July 2017.] Available from URL:

[33]   Ehara, A. (2009) Are City Population and the Number of Emergency Medical Facilities Correlated? Pediatrics International, 51, 258-259.

[34]   Guidance of Medical Service Division, Health Policy Bureau, Ministry of Health, Labour and Welfare (2008) Maintenance of the Pediatric Emergency Medical Care Service System.

[35]   Ministry of Health, Labour and Welfare (2009) Reference Materials, Pediatric Emergency Medical Care.

[36]   Mashiko, K. (2009) Function and Role of Pre-Hospital Transportation in Tertiary Emergency Medical Care. IATSS Review, 34, 286-292.

[37]   Yamamoto, Y and Sakamoto, T. (2012) The Health and Labour Science Research, Study on Promotion of the Emergency Care System, the Present Situation of Emergency and Critical Care Centre.

[38]   Kai, J. (1996) What Worries Parents When Their Preschool Children Are Acutely Ill, Andwhy: A Qualitative Study. BMJ, 313, 983-986.

[39]   Kajiyama, M. (2002) Anxiety in Parents for Children’s Emergency Medicine in Japan. Japanese Society of Emergency Pediatrics, 1, 121-129.

[40]   Kallestrup, P. and Bro, F. (2003) Parents’ Beliefs and Expectations When Presenting with a Febrile Child at an Out-Of-Hours General Practice Clinic. British Journal of General Practice, 53, 43-44.

[41]   Shimobiraki, C. (2005) Determinants of Anxiety in Parents for Children’s Emergency Medicine in Japan. Japanese Journal of Public Health, 52, 349-355.

[42]   Kushnir, T. (1984) Parental Anxiety and Children’s Attendance at Emergency Departments in Relation to the Child’s Birth Order. The Journal of Social Psychology, 123, 123-129.

[43]   E-Stat (2014) The 2010 National Census. [Cited 25 July 2017.] Available from URL:

[44]   Kagawa Prefecture (2017) Statistics Information of Kagawa Pref. [Cited 25 July 2017.] Available from URL:

[45]   Kagawa Prefecture (2013) The Sixth Kagawa Health Care Plans. [Cited 25 July 2017.] Available from URL:

[46]   Acworth, J., Babl, F., Borland, M., Ngo, P., Krieser, D., Schutz, J., et al. (2009) Patterns of Presentation to the Australian and New Zealand Paediatric Emergency Research Network. Emergency Medicine Australasia, 21, 59-66.

[47]   Ban, S., Kuboyama, I., Ito, S. and Tanaka H. (2006) Time Structure of Emergency Medical Services under the Age of Twenty in Tokyo. The Journal of Japan Academy of Health Sciences, 9, 90-95.

[48]   Chishiro, T., Toshiro, J., Tsujimoto, T. and Uchino, M. (2001) The Analytical Observation of Emergency Medical Care for Children at Wakayama Medical Center. Medical Journal of Japanese Red Cross Society Wakayama Medical Center, 19, 27-33.

[49]   Zimmer, K.P., Walker, A.R. and Minkovitz, C.S. (2006) Maternal and Child Factors Affecting High-Volume Pediatric Emergency Department Use. Pediatric Emergency Care, 22, 301-308.

[50]   Child Care Support Section, Health and Welfare Department, Kagawa Prefecture (2017) A Medical Expense Supply System for Infants Of Kagawa Prefecture. [Cited 25 July 2017.] Available from URL:

[51]   Gross, G.J. and Howard, M. (2001) Mothers’ Decision-Making Processes regarding Health Care for Their Children. Public Health Nursing, 18, 157-168.

[52]   Japan Pediatric Society (2006) Pediatric Emergency. [Cited 25 July 2017.] Available from URL:

[53]   Maeda, K., Okamoto, S., Mishina, H. and Nakayama, T. (2009) A Decision Analysis of the Effectiveness of the Pediatric Telephone Triage Program in Japan. BioScience Trends, 3, 184-190.

[54]   Oberlander, T.F., Pless, I.B. and Dougherty, G.E. (1993) Advice Seeking and Appropriate Use of a Pediatric Emergency Department. The American Journal of Diseases of Children, 147, 863-867.

[55]   Equal Employment, Children and Families Bureau, Ministry of Health, Labour and Welfare (2010) Section Meeting of Director-General, Labour Relations, Ministry of Health, Labour and Welfare.

[56]   Japan Association for the Advancement of Working Women (2009) For the Cooperation with the Emergency Support Network Service. [Cited 25 July 2017.] Available from URL:

[57]   Sobue, I., Tanimoto, K. and Itoh, S. (2013) A Comparison of Pediatric Emergency Care on the Basis of the Number of Children and Birth Order. Japan Association for School Emergency Nursing, 15, 13-22.

[58]   Gasquet, I., Villeminot, S., Estaquio, C., Durieux, P., Ravaud, P. and Falissard, B. (2004) Construction of a Questionnaire Measuring Outpatients’ Opinion of Quality of Hospital Consultation Departments. Health and Quality of Life Outcomes, 2, 1-13.

[59]   Labarere, J., Francois, P., Auquier, P., Robert, C. and Fourny, M. (2001) Development of a French Inpatient Satisfaction Questionnaire. International Journal for Quality in Health Care, 13, 99-108.

[60]   Holgado-Tello, F.P., Chacón-Moscoso, S., Barbero-García, I. and Vila-Abad, E. (2010) Polychoric versus Pearson Correlations in Exploratory and Confirmatory Factor Analysis of Ordinal Variables. Quality & Quantity, 44, 153-166.

[61]   Craney, T.A. and Surles, J.G. (2002) Model-Dependent Variance Inflation Factor Cutoff Values. Quality Engineering, 14, 391-403.

[62]   Stine, R.A. (1995) Graphical Interpretation of Variance Inflation Factors. The American Statistician, 49, 53-56.

[63]   Forero, C.G., Maydeu-Olivares, A. and Gallardo-Pujol, D. (2009) Factor Analysis with Ordinal Indicators: A Monte Carlo Study Comparing DWLS and Unweighted Least Squares Estimation. Structural Equation Modeling: A Multidisciplinary Journal, 16, 625-641.

[64]   Lee, C.T., Zhanga, G. and Edwards, M.C. (2012) Ordinary Least Squares Estimation of Parameters in Exploratory Factor Analysis with Ordinal Data. Multivariate Behavioral Research, 47, 314-339.

[65]   Beavers, A.S., Lounsbury, J.W., Richards, J.K., Huck, S.W., Skolits, G.J. and Esquivel, S.L. (2013) Practical Considerations for Using Exploratory Factor Analysis in Educational Research. Practical Assessment, Research & Evaluation, 18, 1-13.

[66]   Hair, J.F., Black, B., Babin, B., Anderson, R.E. and Tatham, R.L. (2006) Factor Analysis. In: Hair, J.F., Black, B., Babin, B., Anderson, R.E. and Tatham, R.L. Eds., Multivariate Data Analysis, 6th Ed., Pearson Prentice Hall., New Jersey, 1-166.

[67]   Kaiser, H.F. and Rice, J. (1974) Little Jiffy, Mark Iv. Educational and Psychological Measurement, 34, 111-117.

[68]   Cattell, R.B. (1978) Fixing the Number of Factors: The Most Practicable Psychometric Procedures. In: Cattell, R.B., Ed., The Scientific Use of Factor Analysis in Behavioral and Life Sciences, Plenum Press, New York, 72-91.

[69]   Kaiser, H.F. (1960) The Application of Electronic Computers to Factor Analysis. Educational and Psychological Measurement, 20, 141-151.

[70]   Pett, M.A., Lackey, N.R. and Sullivan, J.J. (2003) Extracting the Initial Factors. In: Pett, M.A., Lackey, N.R. and Sullivan, J.J., Eds., Making Sense of Factor Analysis: The Use of Factor Analysis for Instrument Development in Health Care Research, Sage Publications, Inc., California, 114-130.

[71]   Tabachnick, B.G. and Fidell, L.S. (2001) Principal Components and Factor Analysis. In: Tabachnick. B.G. and Fidell, L.S. Eds., Using Multivariate Statistics, 4th Ed., Allyn & Bacon., Boston, 607-675.

[72]   Minato, S. (1983) Some Mathematical Attitudinal Data on Eighth Grade Students in Japan Measured by a Semantic Differential. Educational Studies in Mathematics, 14, 19-38.

[73]   Gadermann, A.M., Guhn, M. and Zumbo, B.D. (2012) Estimating Ordinal Reliability for Likert-Type and Ordinal Item Response Data: A Conceptual, Empirical, and Practical Guide. Practical Assessment, Research & Evaluation, 17, 1-13.

[74]   Iacobucci, D. and Duhachek, A. (2003) Advancing Alpha: Measuring Reliability with Confidence. Journal of Consumer Psychology, 13, 478-487.

[75]   Zumbo, B.D., Gadermann, A.M. and Zeisser, C. (2007) Ordinal Versions of Coefficients Alpha and Theta for Likert Rating Scales. Journal of Modern Applied Statistical Methods, 6, 21-29.

[76]   Helfrich, C.D., Li, Y.F., Mohr, D.C., Meterko, M. and Sales, A.E. (2007) Assessing an Organizational Culture Instrument Based on the Competing Values Framework: Exploratory and Confirmatory Factor Analyses. Implementation Science, 2, 1-14.

[77]   Morata-Ramírez, M.A. and Holgado-Tello, F.P. (2013) Construct Validity of Likert Scales through Confirmatory Factor Analysis: A Simulation Study Comparing Different Methods of Estimation Based on Pearson and Polychoric Correlations. International Journal of Social Science Studies, 1, 54-61.

[78]   Yang-Wallentin, F., Jöreskoga, K.G. and Luo, H. (2010) Confirmatory Factor Analysis of Ordinal Variables with Misspecified Models. Structural Equation Modeling: A Multidisciplinary Journal, 17, 392-423.

[79]   Hooper, D., Coughlan, J. and Mullen, M. (2008) Structural Equation Modelling: Guidelines for Determining Model Fit. The Electronic Journal of Business Research Methods, 6, 53-60.

[80]   Schermelleh-Engel, K., Moosbrugger, H. and Müller, H. (2003) Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodness-Of-Fit Measures. Methods of Psychological Research Online, 8, 23-74.

[81]   Sin, S.J. (2012) Modeling the Impact of Individuals’ Characteristics and Library Service Levels on High School Students’ Public Library Usage: A National Analysis. Library & Information Science Research, 34, 228-237.

[82]   Chin, W.W. (1998) Issues and Opinion on Structural Equation Modeling. MIS Quarterly, 22, 7-16.

[83]   Hair, J.F., Black, B., Babin, B., Anderson, R.E. and Tatham, R.L. (2006) SEM: Confirmatory Factor Analysis. In: Hair, J.F., Black, B., Babin, B., Anderson, R.E. and Tatham, R.L. Eds., Multivariate Data Analysis, 6th Ed., Pearson Prentice Hall, New Jersey, 770-836.

[84]   Starkweather, J. (2012) Step Out of the Past: Stop Using Coefficient Alpha; There Are Better Ways to Calculate Reliability. Research and Statistical Support, 1-6.

[85]   Thurber, S. and Bonynge, M.R. (2011) SEM-Based Composite Reliability Estimates of the Crisis Acuity Rating Scale with Children and Adolescents. Archives of Assessment Psychology, 1, 1-9.

[86]   Fornell, C. and Larker, D.F. (1981) Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. Journal of Marketing Research, 18, 39-50.

[87]   Kalpakjian, C.Z., Toussaint, L.L., Albright, K.J., Bombardier, C.H., Krause, J.K. and Tate, D.G. (2009) Patient Health Questionnaire-9 in Spinal Cord Injury: An Examination of Factor Structure as Related to Gender. The Journal of Spinal Cord Medicine, 32, 147-156.

[88]   Lorenzo-Seva, U. and ten Berge, J.M.F. (2006) Tucker’s Congruence Coefficient as a Meaningful Index of Factor Similarity. Methodology, 2, 57-64.

[89]   Milfont, T.L. and Fischer, R. (2010) Testing Measurement Invariance across Groups: Applications in Cross-Cultural Research. International Journal of Psychological Research, 3, 111-121.

[90]   Wu, A.D., Li, Z. and Zumbo, B.D. (2007) Decoding the Meaning of Factorial Invariance and Updating the Practice of Multi-Group Confirmatory Factor Analysis: A Demonstration with TIMSS Data. Practical Assessment, Research & Evaluation, 12, 1-26.

[91]   Breslow, N.E. (1996) Statistics in Epidemiology: The Case-Control Study. Journal of the American Statistical Association, 91, 14-28.

[92]   Lachin, J.M. (2011) Biostatistical Methods: The Assessment of Relative Risks, 2nd Edition, Wiley, New Jersey.

[93]   LaMorte, W.W. (2016) The Cochran-Mantel-Haenszel Method. [Cited 25 July 2017.] Available from URL:

[94]   McCulloch, C.E. (2000) Generalized Linear Models. Journal of the American Statistical Association, 95, 1320-1324.

[95]   Olsson, U. (2002) Generalized Linear Models: An Applied Approach. Student Litteratur Lund., Sweden, 1-232.

[96]   Abdi, H. and Valentin, D. (2007) Multiple Correspondence Analysis. In: Salkind, N.J., Ed., Encyclopedia of Measurement and Statistics, SAGE Publications, Thousand Oaks, CA, 1-13.

[97]   Hoffman, D.L. and Leeuw, J.D. (1992) Interpreting Multiple Correspondence Analysis as a Multidimensional Scaling Method. Marketing Letters, 3, 259-272.

[98]   Cabinet Office, Government of Japan (2015) Local Support Programs for Children and Child-Rearing.

[99]   E-Stat (2011) The 2010 National Census. [Cited 25 July 2017.] Available from URL:

[100]   Mori, R., Etani, Y., Ehara, A., Oyama, S., Nagamura, T., Kajii, N., et al. (2015) Report of System to Provide Pediatric Medicine. The Journal of the Japan Pediatric Society, 119, 1551-1566.