PSYCH  Vol.9 No.11 , October 2018
Development and Validation of the Japanese-Translated Version of the Multiple-Choice Questionnaire of Depression Literacy (MCQ-DL)
Author(s) Jun Kashihara1,2,3, Shinji Sakamoto1
ABSTRACT
Although depression literacy plays a key role in encouraging people with depression to seek professional treatment, there exist no measures of depression literacy in Japan that are comparable to those validated in English-speaking countries. The present study therefore developed and validated a Japanese-translated version of the Multiple-Choice Questionnaire of Depression Literacy (MCQ-DL), which is rated as being of high quality by recent systematic reviews. We conducted an online two-wave survey (NT1 = 325, NT2 = 180) and examined the psychometric properties of the full-item (27 items) and short (10 items) versions of the Japanese-translated MCQ-DL. Results provide several points of validity evidence for both versions as measures that capture individuals’ depression literacy profiles: 1) one-factor structures of these versions were supported by the data; and 2) the items used in both versions had a variety of difficulty and discrimination indices. Results also indicate several limitations of the Japanese-translated MCQ-DL for use in correlation-based and multivariate analyses: 1) internal consistencies seem insufficient (α = .68) and poor (α = .28) for the full-item and short versions, respectively; 2) the test-retest reliability was insufficient for the short version (r = .51, p < .001, 95% CI [.40, .60]), 3) both the full-item and short versions of the MCQ-DL exhibited only weak correlations (|r| ≤ .22) with the other variables, including stigmatizing attitudes toward, and familiarity with, people with depression and components of empathy. The discussion highlights the usage of and further room for the validation of the Japanese-translated MCQ-DL we developed.
Cite this paper
Kashihara, J. , Sakamoto, S. (2018) Development and Validation of the Japanese-Translated Version of the Multiple-Choice Questionnaire of Depression Literacy (MCQ-DL). Psychology, 9, 2482-2502. doi: 10.4236/psych.2018.911143.
References
[1]   American Psychiatric Association (2013). Diagnostic and Statistical Manual of Mental Disorders (5th ed.). Washington, DC: Author.
https://doi.org/10.1176/appi.books.9780890425596

[2]   Bandalos, D. L. (2002). The Effects of Item Parceling on Goodness-of-Fit and Parameter Estimate Bias in Structural Equation Modeling. Structural Equation Modeling, 9, 78-102.
https://doi.org/10.1207/S15328007SEM0901_5

[3]   Birnbaum, A. (1968). Some Latent Trait Models and Their Use in Inferring an Examinee’s Ability. In F. M. Lord & M. R. Novick (Eds.), Statistical Theories of Mental Test Scores (pp. 397-424). Reading, MA: Addison-Wesley.

[4]   Brislin, R. W. (1970). Back-Translation for Cross-Cultural Research. Journal of Cross-Cultural Psychology, 1, 185-216.
https://doi.org/10.1177/135910457000100301

[5]   Brislin, R. W. (1980). Translation and Content Analysis of Oral and Written Material. In H. C. Triandis & J. W. Berry (Eds.), Handbook of Crosscultural Psychology (Vol. 2, pp. 389-444). Boston: Allyn & Bacon.

[6]   Brislin, R. W., Lonner, W. J., & Thorndike, R. M. (1973). Cross-Cultural Research Methods. New York: Wiley.

[7]   Coffman, D. L., & MacCallum, R. C. (2005). Using Parcels to Convert Path Analysis Models into Latent Variable Models. Multivariate Behavioral Research, 40, 235-259.
https://doi.org/10.1207/s15327906mbr4002_4

[8]   Corrigan, P. W., & Shapiro, J. R. (2010). Measuring the Impact of Programs that Challenge the Public Stigma of Mental Illness. Clinical Psychology Review, 30, 907-922.
https://doi.org/10.1016/j.cpr.2010.06.004

[9]   Corrigan, P. W., Morris, S. B., Michaels, P. J., Rafacz, J. D., & Ruesch, N. (2012). Challenging the Public Stigma of Mental Illness: A Meta-Analysis of Outcome Studies. Psychiatric Services, 63, 963-973. https://doi.org/10.1176/appi.ps.201100529

[10]   Davis, M. H. (1980). A Multidimensional Approach to Individual Differences in Empathy. JSAS Catalog of Selected Documents in Psychology, 10, 85.

[11]   Davis, M. H. (1983). Measuring Individual-Differences in Empathy: Evidence for a Multidimensional Approach. Journal of Personality and Social Psychology, 44, 113-126.
https://doi.org/10.1037/0022-3514.44.1.113

[12]   Evans-Lacko, S., Malcolm, E., West, K., Rose, D., London, J., Ruesch, N. et al. (2013). Influence of Time to Change’s Social Marketing Interventions on Stigma in England 2009-2011. British Journal of Psychiatry, 202, S77-S88.
https://doi.org/10.1192/bjp.bp.113.126672

[13]   Finkelstein, J., & Lapshin, O. (2007). Reducing Depression Stigma Using a Web-Based Program. International Journal of Medical Informatics, 76, 726-734.
https://doi.org/10.1016/j.ijmedinf.2006.07.004

[14]   Foster, S. D., Elischberger, H. B., & Hill, E. D. (2018). Examining the Link Between Socioeconomic Status and Mental Illness Prejudice: The Roles of Knowledge About Mental Illness and Empathy. Stigma and Health, 3, 139-151.
https://doi.org/10.1037/sah0000084

[15]   Fricker, S., Galesic, M., Tourangeau, R., & Yan, T. (2005). An Experimental Comparison of Web and Telephone Surveys. Public Opinion Quarterly, 69, 370-392.
https://doi.org/10.1093/poq/nfi027

[16]   Gabriel, A., & Violato, C. (2009). The Development of a Knowledge Test of Depression and Its Treatment for Patients Suffering from Non-Psychotic Depression: A Psychometric Assessment. BMC Psychiatry, 9, 56.
https://doi.org/10.1186/1471-244X-9-56

[17]   Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P. (2004). Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions about Internet Questionnaires. American Psychologist, 59, 93-104.
https://doi.org/10.1037/0003-066X.59.2.93

[18]   Gribbons, B. C., & Hocevar, D. (1998). Levels of Aggregation in Higher Level Confirmatory Factor Analysis: Application for Academic Self-Concept. Structural Equation Modeling, 5, 377-390. https://doi.org/10.1080/10705519809540113

[19]   Griffiths, K. M., Christensen, H., Jorm, A. F., Evans, K., & Groves, C. (2004). Effect of Web-Based Depression Literacy and Cognitive-Behavioural Therapy Interventions on Stigmatising Attitudes to Depression: Randomised Controlled Trial. British Journal of Psychiatry, 185, 342-349. https://doi.org/10.1192/bjp.185.4.342

[20]   Griffiths, K. M., Nakane, Y., Christensen, H., Yoshioka, K., Jorm, A. F., & Nakane, H. (2006). Stigma in Response to Mental Disorders: A Comparison of Australia and Japan. BMC Psychiatry, 6, 21. https://doi.org/10.1186/1471-244X-6-21

[21]   Hart, S. R., Kastelic, E. A., Wilcox, H. C., Beaudry, M. B., Musci, R. J., Heley, K. M., Swartz, K. L. et al. (2014). Achieving Depression Literacy: The Adolescent Depression Knowledge Questionnaire (ADKQ). School Mental Health, 6, 213-223.
https://doi.org/10.1007/s12310-014-9120-1

[22]   Hashimoto, N., Suzuki, Y., Kato, T. A., Fujisawa, D., Sato, R., Aoyama-Uehara, K., Otsuka, K. et al. (2016). Effectiveness of Suicide Prevention Gatekeeper-Training for University Administrative Staff in Japan. Psychiatry and Clinical Neurosciences, 70, 62-70.
https://doi.org/10.1111/pcn.12358

[23]   Henderson, C., & Thornicroft, G. (2009). Stigma and Discrimination in Mental Illness: Time to Change. The Lancet, 373, 1928-1930.
https://doi.org/10.1016/S0140-6736(09)61046-1

[24]   Holmes, E. P., Corrigan, P. W., Williams, P., Canar, J., & Kubiak, M. A. (1999). Changing Attitudes about Schizophrenia. Schizophrenia Bulletin, 25, 447-456.
https://doi.org/10.1093/oxfordjournals.schbul.a033392

[25]   Hu, L. T., & Bentler, P. M. (1999). Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Structural Equation Modeling, 6, 1-55.
https://doi.org/10.1080/10705519909540118

[26]   Jorm, A. F. (2012). Mental Health Literacy: Empowering the Community to Take Action for Better Mental Health. American Psychologist, 67, 231-243.
https://doi.org/10.1037/a0025957

[27]   Jorm, A. F., Blewitt, K. A., Griffiths, K. M., Kitchener, B. A., & Parslow, R. A. (2005). Mental Health First Aid Responses of the Public: Results from an Australian National Survey. BMC Psychiatry, 5, 9.
https://doi.org/10.1186/1471-244X-5-9

[28]   Kane, M. T. (2006). Validation. In R. B. Brennan (Ed.), Educational Measurement (4th ed., pp. 17-64). Westport, CT: American Council on Education/Praeger.

[29]   Kashihara, J. (2015). Examination of Stigmatizing Beliefs about Depression and Stigma-Reduction Effects of Education by Using Implicit Measures. Psychological Reports, 116, 337-362.
https://doi.org/10.2466/15.PR0.116k20w9

[30]   Kashihara, J., & Sakamoto, S. (2018). Reducing Implicit Stigmatizing Beliefs and Attitudes toward Depression by Promoting Counterstereotypic Exemplars. Basic and Applied Social Psychology, 40, 87-103.
https://doi.org/10.1080/01973533.2018.1441714

[31]   Kato, T. A., Suzuki, Y., Sato, R., Fujisawa, D., Uehara, K., Hashimoto, N., Otsuka, K. et al. (2010). Development of 2-Hour Suicide Intervention Program among Medical Residents: First Pilot Trial. Psychiatry and Clinical Neurosciences, 64, 531-540.
https://doi.org/10.1111/j.1440-1819.2010.02114.x

[32]   Kiropoulos, L. A., Griffiths, K. M., & Blashki, G. (2011). Effects of a Multilingual Information Website Intervention on the Levels of Depression Literacy and Depression-Related Stigma in Greek-Born and Italian-Born Immigrants Living in Australia: A Randomized Controlled Trial. Journal of Medical Internet Research, 13, e34.
https://doi.org/10.2196/jmir.1527

[33]   Kitchener, B. A., & Jorm, A. F. (2002a). Mental Health First Aid Manual. Canberra: Centre for Mental Health Research.

[34]   Kitchener, B. A., & Jorm, A. F. (2002b). Mental Health First Aid Training for the Public: Evaluation of Effects on Knowledge, Attitudes and Helping Behavior. BMC Psychiatry, 2, 10.
https://doi.org/10.1186/1471-244X-2-10

[35]   Kitchener, B. A., & Jorm, A. F. (2008). Mental Health First Aid: An International Programme for Early Intervention. Early Intervention in Psychiatry, 2, 55-61.
https://doi.org/10.1111/j.1751-7893.2007.00056.x

[36]   Krosnick, J. A. (1991). Response Strategies for Coping with the Cognitive Demands of Attitude Measures in Surveys. Applied Cognitive Psychology, 5, 213-236.
https://doi.org/10.1002/acp.2350050305

[37]   Krosnick, J. A., Narayan, S. S., & Smith, W. R. (1996). Satisficing in Surveys: Initial Evidence. In M. T. Braverman, & J. K. Slater (Eds.), Advances in Survey Research (pp. 29-44). San Francisco, CA: Jossey-Bass.

[38]   Little, T. D., Cunningham, W. A., Shahar, G., & Widaman, K. F. (2002). To Parcel or Not to Parcel: Exploring the Question, Weighing the Merits. Structural Equation Modeling, 9, 151-173.
https://doi.org/10.1207/S15328007SEM0902_1

[39]   Little, T. D., Rhemtulla, M., Gibson, K., & Schoemann, A. M. (2013). Why the Items versus Parcels Controversy Needn’t Be One. Psychological Methods, 18, 285-300.
https://doi.org/10.1037/a0033266

[40]   Maniaci, M. R., & Rogge, R. D. (2014). Caring about Carelessness: Participant Inattention and Its Effects on Research. Journal of Research in Personality, 48, 61-83.
https://doi.org/10.1016/j.jrp.2013.09.008

[41]   Marsh, H. W., Hau, K. T., Balla, J. R., & Grayson, D. (1998). Is More Ever Too Much? The Number of Indicators per Factor in Confirmatory Factor Analysis. Multivariate Behavioral Research, 33, 181-220.
https://doi.org/10.1207/s15327906mbr3302_1

[42]   Muthén, L. K., & Muthén, B. O. (1998-2012). Mplus User’s Guide (7th ed.). Los Angeles, CA: Muthén & Muthén.

[43]   Nakane, Y., Yoshioka, K., & Nakane, H. (2006). Perceptions of Mental Illness among Japanese: Results from Cross-Cultural Surveys of Mental Health Literacy in Japan and Australia. Japanese Bulletin of Social Psychiatry, 15, 25-38. (In Japanese)

[44]   Nunnally, J. C., & Bernstein, I. R. (1994). Psychometric Theory (3rd ed.). New York, NY: McGraw-Hill.

[45]   Paykel, E. S., Hart, D., & Priest, R. G. (1998). Changes in Public Attitudes to Depression during the Defeat Depression Campaign. British Journal of Psychiatry, 173, 519-522.
https://doi.org/10.1192/bjp.173.6.519

[46]   Paykel, E. S., Tylee, A., Wright, A., Priest, R. G., Rix, S., & Hart, D. (1997). The Defeat Depression Campaign: Psychiatry in the Public Arena. American Journal of Psychiatry, 154, 59-66. https://doi.org/10.1176/ajp.154.6.59

[47]   R Development Core Team (2017). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing.
http://www.R-project.org

[48]   Rix, S., Paykel, E. S., Lelliott, P., Tylee, A., Freeling, P., Gask, L., & Hart, D. (1999). Impact of a National Campaign on GP Education: An Evaluation of the Defeat Depression Campaign. British Journal of General Practice, 49, 99-102.

[49]   Rusch, L. C., Kanter, J. W., & Brondino, M. J. (2009). A Comparison of Contextual and Biomedical Models of Stigma Reduction for Depression with a Nonclinical Undergraduate Sample. Journal of Nervous and Mental Disease, 197, 104-110.
https://doi.org/10.1097/NMD.0b013e318192416f

[50]   Sakurai, S. (1988). The Relationship between Empathy and Helping Behavior in College Students. Bulletin of Nara University of Education, 37, 149-154. (In Japanese)

[51]   Sijtsma, K. (2009). On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha. Psychometrika, 74, 107-120.
https://doi.org/10.1007/s11336-008-9101-0

[52]   StataCorp (2015). Stata Version 14 [Computer Software]. College Station, TX: StataCorp LP.

[53]   Suzuki, Y., Kato, T. A., Sato, R., Fujisawa, D., Aoyama-Uehara, K., Hashimoto, N., Otsuka, K. et al. (2014). Effectiveness of Brief Suicide Management Training Programme for Medical Residents in Japan: A Cluster Randomized Controlled Trial. Epidemiology and Psychiatric Sciences, 23, 167-176. https://doi.org/10.1017/S2045796013000334

[54]   Wei, Y. F., McGrath, P. J., Hayden, J., & Kutcher, S. (2015). Mental Health Literacy Measures Evaluating Knowledge, Attitudes and Help-Seeking: A Scoping Review. BMC Psychiatry, 15, 291.
https://doi.org/10.1186/s12888-015-0681-9

[55]   Wei, Y. F., McGrath, P. J., Hayden, J., & Kutcher, S. (2016). Measurement Properties of Tools Measuring Mental Health Knowledge: A Systematic Review. BMC Psychiatry, 16, 297.
https://doi.org/10.1186/s12888-016-1012-5

[56]   World Health Organization (2008). The Global Burden of Disease: 2004 Update.
http://www.who.int/healthinfo/global_burden_disease/2004_report_update/en/

[57]   World Health Organization (2012a). Depression: A Global Crisis.
http://www.who.int/mental_health/management/depression/wf
mh_paper_depression_wmhd_2012.pdf


[58]   World Health Organization (2012b). Depression: A Global Public Health Concern.
http://www.who.int/mental_health/management/depression/wh
o_paper_depression_wfmh_2012.pdf


[59]   Yamakawa, I., Hirobiki, T., Honda, A., Machino, T., Okamura, N., Akiyama, M., Sakamoto, S. et al. (2012). The Effect of Depression Literacy and Emotional Valence Information on Anxiety about Suffering Depressive Disorder. Nihon University Psychological Research, 33, 49-57. (In Japanese)

 
 
Top