This study focuses on nurse specialist students (NSS) in the final phase of their postgraduate education in surgical, oncology, anaesthesia and intensive care nursing. The education comprises both a theoretical and a clinical part. Clinical supervision (CS) and systematic reflection on clinical experiences constitute an important component of the education. Supervisors are in a unique position to facilitate learning processes and promote the students’ professional growth and identity building as specialist nurses   . However, many clinical nurse supervisors in Norway have no formal qualifications or training for supervision. The supervisor’s role is significant for the quality of supervision and a systematic structure enhances the students’ professional development, leading to positive outcomes in terms of quality and patient safety (PS)  . Empirical research has focused on different models of supervision, effectiveness and quality of care as well as on ethical issues  . There are several definitions of CS and Lyth  underlined the difficulty of clarifying the concept, as nursing practice varies. An article by Proctor  identified three components of supervision: normative (standard setting), formative (development) and restorative (support), which have been adopted by the nursing profession as key elements in the CS literature  . These three components have stood the test of time, thus the purpose and content of CS encompasses one or a combination of the following: a learning, supportive and monitoring process  . In this paper, CS is defined as a pedagogical human development process, in which the participants raise questions, explore, explain and systematize care experiences from a perspective that is considered holistic in the professional context  .
PS is the cornerstone of high quality healthcare  . Systematic development of PS is necessary as poor quality care causes human suffering  . Much of the work defining PS and practices that prevent harm has focused on negative care outcomes, such as mortality and morbidity  . Patient safety culture is a subset of the organizational culture relating specifically to the values and beliefs concerning PS  . Mustard  (p. 112) defined the patient safety culture as “a product of social learning, ways of thinking and behaving that are shared and that work to meet the primary objective of patient safety”. Implementation of PS requires evidence-based knowledge, professional staff and financial resources  . Thus, the quality of care is dependent on nurses’ professional competence and the use of the best evidence in practice  .
Work remains to be done in evaluating how PS competencies can be learnt and how knowledge, skills and attitudes that enhance PS can be developed   . According to Sullivan et al.  , a major national initiative in the US, Quality and Safety Education for Nurses (QSEN), attempted to define competencies for nursing students. The primary goal was to address the challenge of providing future nurses with the necessary knowledge, skills and attitudes to continuously improve the quality and safety of the healthcare systems in which they work  . The competencies are supported by The WHO  safety curriculum guidelines and include patient-centred care, teamwork and collaboration, evidence-based practice, quality improvement and safety, as well as the use of informatics. Altmiller  demonstrated how the competencies can be transferred to a nurse specialist role. Patients undergoing surgery are at the highest risk of harm and adverse healthcare events  . A reason for this is the surgery team, which often consists of two surgical nurses, an anaesthesia nurse, an anaesthesia physician and at least one operating physician. Each professional must have the competence to manage her/his own professional work and know how to coordinate it with that of the other team members  . As lack of coordination and cooperation in the operating theatre poses a threat to PS, teamwork competence must be developed during the NSS education.
Flin et al.  (p. 1) define non-technical skills as “the cognitive, social and personal resource skills that complement technical skills, and contribute to safe and efficient task performance”. Rasmussen et al.  identified the following set of non-technical skills for surgical nurses: 1) Cognitive skills, which involve making use of knowledge and experiences, understanding the situation, perceiving changes and considering measures; 2) Cooperative skills, which include understanding the division of work in the team, adjusting one’s own duties to those of the other team members and ability to communicate; 3) Self-manage- ment skills, which encompass exhibiting self-control, a professional manner and working under time pressure; 4) Ethical skills, examples of which are showing respect, contributing to a positive work climate and having a caring attitude towards patients and colleagues.
We focused on the influence of CS on professional development related to PS. In addition, we would like to compare the results of this study with the evidence of PS competencies as recommended by the QSEN (2003),  , Flin et al.  Rasmussen et al.  and Patient Safety Topics as identified by Jha et al.  . A PS curriculum strengthens the necessary attitudes, behaviours and skills, making it a prerequisite for healthcare education and training to enhance PS  . This underlines the importance of evaluating clinical training and the way in which CS influences nursing practice.
The aim of the study was to evaluate nurse specialist students’ views of CS and its influence on their professional competence development. An additional aim was to interpret the results and link them to non-technical skills and Patient Safety (PS) topics. The research question was: What are the benefits of CS focusing on non-technical skills in the area of PS?
This study had a descriptive-correlational design  . Data were collected from NSS in Norway, using a package of instruments to measure the influence of CS, the students’ views on the benefit of supervision, as well as their perceptions of the involvement of patients and family members in safe care.
All registered NSS (n = 56) taking part in the Postgraduate education at the University College in June 2015 were eligible to participate in the study, which included four healthcare contexts. The questionnaire was distributed to the participants at the end of their clinical placements during the final semester of their education. In total, 46 NSS (8 anaesthesia, 11 intensive care, 14 operation/sur- gical and 13 oncological care) completed and returned the questionnaire to the first author. The response rate was 82%. The characteristics of the participants are presented in Table 1.
The questionnaire included three instruments: the Manchester Clinical Supervision Scale (MCSS)   , the Effects of Supervision Scale (ESS),  designed to measure nurses’ views of the effectiveness of CS and the Focus on Empowerment Supervision Scale (FESS)  , that illuminates user involvement, nursing documentation and the influence of supervision, in addition to providing demographic data.
2.3.1. The Manchester Clinical Supervision Scale
The participants were asked to rate 36 items divided into seven factors; Trust/ Rapport, Supervisor advice/support, Improved care/skills, Importance value of CS, Finding time, Personal issues and Reflection (MCSS)   . The response alternatives for items such as “Clinical supervision improves the quality of care I give to my patients” and “Supervision gives me time to reflect” ranged from 1 (strongly disagree) to 5 (strongly agree). In a previous study the reliability score
Table 1. Demographic characteristics of the students.
*Due to internal missing data, N varies between 44 and 46.
for the full-item scale was 0.86  .
2.3.2. The Effects of Supervision Scale
The 25 items from the Effects of Supervision Scale (ESS) were used to measure what the students had learnt in CS. Examples of items are: “I can deal with difficult caring situations”, “I realize when I need help from others” and “I can plan more easily together with the patient”  . The ESS comprises three sub-scales: Interprofessional skills, Professional skills and Communication skills with responses indicated on a 4-point scale ranging from strongly disagree to strongly agree. The known reliability is 0.96  .
2.3.3. The Focus on Empowerment Supervision Scale
The Focus on Empowerment Supervision Scale (FESS) is a 24 item instrument that measures nurses’ perceptions of empowerment, documentation, the influence of CS, involving users by preserving their integrity and enabling the participation of the patient and her/his family in decision-making   . The participants were asked to rate items on a Likert scale with scores ranging from 1 (strongly disagree) to 4 (strongly agree). Examples of items of pertaining to perceptions of the influence of supervision, documentation and user involvement in the nursing process are: “I am satisfied with the learning situation at my clinical practicum” and “I cooperate with the patient in all parts of the problem-solving process”. The two factor solution yielded a Cronbach’s alpha score of 0.84  .
2.4. Data Analysis
Descriptive and correlational analyses were employed in the analytic procedures. The statistical analyses were conducted using the Statistical Package for the Social Sciences (SPSS) PC-version 20.0 for Windows  . A P = 0.05 was considered statistically significant. A factor analysis with varimax rotation  was performed to condense the number of the items in the instruments and to identify factors with common characteristics. Cronbach’s alpha was applied to established internal consistency. Differences in the responses between the groups were tested by the Mann-Whitney U-test  and the Spearman rank correlation coefficient was used to calculate the correlation between the factors.
2.5. Ethical Considerations
The study followed the guidelines for research set out in the Helsinki declaration  . The study was approved by the Head of the Institute of Nursing and the Dean of the Faculty of a University College on the east coast of Norway. In addition, the principles of confidentiality, voluntariness and informed consent were adhered to. The participants received information about the purpose of the study and indicated their consent by giving the completed consent form to their principal tutor. The data were stored in accordance with the university regulations. Permission to use the MCSS was obtained from the copyright holder, Dr. J. Winstanley (personal contact, Australia).
3.1. Demographic Characteristics of Participants, Frequency of Sessions and Context of Supervision
Of the 46 participants 42 were female, their mean age was 36.5 years (standard deviation (SD); range, 31.0 - 39.3) and they had 10 years of work experience (Table 1). They all had previous experience of supervision but it differed in terms of frequency, as 27 (58.6%) had supervision daily, 14 (30.4%) once a week, three (6.5%) every second week and two (4.3%) once per month during their postgraduate education. The supervision took place during work (n = 27), in a separate room (n = 2) and both settings (n = 17). Furthermore, 31 (70.5%) participants had individual supervision, one had group supervision and 12 (27.3%) reported supervision in both contexts. Regarding whether the agreed supervision time was adhered to, 14 (30.4%) participants answered yes, 28 (60.9%) no and four (8.7%) both. The time devoted to supervision per week was less than 15 minutes (n = 7), 15 - 30 minutes (n = 11), 31 - 45 minutes (n = 8), 46 - 60 minutes (n = 3) and over 60 minutes (n = 16). The perception of sufficient time for supervision was reported by 23 (50%) of the participants, while 23 (50%) stated that it was not insufficient. Factor analysis and Cronbach’s alpha coefficients of the students’ (N = 46) views on CS are presented in Table 2.
The most important factors from the MCSS regarding the need for more supervision were: Trust/Rapport, Supervisor advice and Finding time. The participants who wanted more supervision had significantly lower scores on the FESS factors: Supporting yet challenging relationship (p-value 0.004) and Preparatory and confirming professional relationship (p-value 0.002), Table 3.
3.2. Students’ Perceptions of the Quality and Effectiveness of Clinical Supervision
To evaluate the quality and effectiveness of CS the instrument labelling and the sub-scales are described in Table 4. This structure explained 67.3% of the variance.
3.3. Spearman’s Correlations between the Manchester Supervision Scale and Other Factors
A highly significant association was found between Trust and Interpersonal skills (P = 0.001), (r = 0.50) as well as between Reflection, Professional and Communication skills (P = 0.001), (r = 0.50).
Furthermore, associations were found between Supervisor advice and the factors Supportive yet challenging, Preparatory and confirming professional relationship, and Interpersonal, Professional and Communications skills (P = 0.001), (r = 0.70). There were no associations between Finding time and the factors: User involvement, Influence of supervision and the Effects of Supervision Scale, Table 5.
The aim of this study was to evaluate nurse specialist students’ views of CS and
Table 2. Factor loading, Cronbach’s alpha coefficients (α) and explained variance of the students’ (N = 46) views on clinical supervision (MCSS).
MCSS = Manchester Clinical Supervision Scale. Cronbach alpha total = 0.80.
its influence on their professional competence development. An additional aim was to interpret the results and link them to non-technical skills and Patient Safety (PS) topics. The research question was: What are the benefits of clinical supervision focusing on non-technical skills in the area of PS? Data were collected from 46 NSS using a package of instruments to measure the influence of CS.
CS factors that influenced the competencies of the NSS were: interpersonal, professional and communication skills, in addition to ethical skills, the importance of teamwork and awareness of the need to involve patients and their family members in safe care. Table 6 illustrates the linkages between the results of CS, non-technical skills, patient safety competencies and patient safety topics.
Despite an average of 10 years’ of experience as nurses the NSS expressed the need for more CS. The NSS context is entirely different and they have new roles and functions. Their increased responsibilities give rise to a sense of insecurity. The CS of these students has traditionally focused on technical skills using a hands-on approach. There is a need to pay more attention to non-technical skills development in order to safeguard patients. CS can serve as a forum for reflection where together with their supervisor. NSS are enabled to review situations, identify what succeeded or failed and what to do on the next occasion. It is through reflection that individuals grow as professionals and develop non-tech- nical skills  . The supervisors should help by challenging the behaviour of NSS in order to promote communication and teamwork skills. According to McCabe  , nurses communicate well with patients when they use a person-centred approach. However, the ability to do so is heavily influenced by the work and culture in the organization. Interest in non-technical skills has increased in healthcare in line with the focus on increased PS to reduce the number of ad-
Table 3. Factors, mean rank and p-value for nurses who wanted more supervision.
Table 4. Included factors, Medians, Quartiles and Cronbach’s alpha.
Table 5. Spearman’s correlations between the MCSS and other factors.
*P => 0.05; **P =< 0.01; ***P =< 0.001.
Table 6. The benefits of CS, non-technical skills, patient safety competencies and patient safety topics.
1) Flin et al.  ; 2) Rasmussen et al.  ; 3) Jha et al.  .
verse events  . De Vries et al.  found that 41% of all adverse events in hospitals occurred in the operating theatre. Furthermore, the authors linked these events to the failure of team cooperation  . According to Mc Culluch  , reasons for the high rate of adverse events in the operating theatre are that the environment is perceived as stressful by staff and communication between team/staff members is difficult. Non-technical skills training resulted in improved attitudes to safety  . Professional skills on the part of NSS can be interpreted as linkages to their capacity for self-management, situational awareness and decision-making. According to Flin et al.  , situational awareness can be explained simply as “knowing what is going around you”. The terms situational awareness and situation assessment are often used synonymously. Flin et al.  defined situational awareness as the cognitive process for building and maintaining awareness of a workplace situation or event. The authors also described situational awareness as the first stage of decision-making, defined as the process of reaching a judgement or choosing an option, sometimes called a course of action, to meet the needs of a given situation. Elements of situational awareness can be situation assessment i.e., defining the problem, generating and considering one or more response options, selecting and implementing an option and reviewing the outcome  . All aspects can be seen as referring to care models such as patient-centred care and safety culture.
Despite the fact that the result of the present study revealed the importance and positive outcomes of CS for the development of PS competencies, there is still a room for improvement. The participants reported differences in the frequency of CS. Over half of the NSS stated that they were not offered enough time for CS. The participants who wanted more supervision had significantly lower scores on the factors; Supporting yet challenging and Preparatory (P = 0.004), confirming professional relationship (P = 0.002).These findings are confirmed by the study of Amsrud et al.  and their evaluation of undergraduate nursing students. Nursing universities are responsible for NSS programmes. In order to provide clinical supervisors with improved understanding and CS skills, the universities should devote more effort to “designing and providing” educational programmes for clinical supervisors. The supervisors must be made more aware of the actual importance of their supervision, particularly in terms of the development of non-technical skills. CS must be given priority in the organisation as it increases the focus on PS and safety culture. This is supported by Gordon et al.  who concluded that education in the use of non-technical skills can improve PS. There can be various reasons for the lack of time for CS. Clinical supervisors are usually not relieved from ordinary patient work. Finding time for CS and reflection should therefore be given high priority by management and clinical leadership. Johns  claims that clinical leadership is a cornerstone for the development of nursing and healthcare practice. The clinical leader is responsible for facilitating development, supporting/promoting staff competence, clinical practice and ensuring the quality of care.
Limitations of the Study
This study has some limitations. Data collection only took place on one occasion by means of the questionnaire and the sample of students was relatively small. The latter was unavoidable as the sample comprised almost all students in the class. For future research we recommend the inclusion of a larger group. The results are only valid for the study group. It would be of interest to compare different groups of students at postgraduate educational level such as master level. A mixed method design combining interviews and a questionnaire with open ended questions would be ideal for focusing on PS issues  .
CS is crucial for development of non-technical skills and patient safety competencies among NSS. However, finding the time to reflect and learn from the supervisors was reported to be problematic. Thus, there is potential for quality improvement. We recommend that nursing universities should provide formal educational programmes for supervisors focusing on the students’ professional development, especially non-technical skills. Management and clinical leaders should give higher priority to CS in order to enhance PS.
The study was designed by E.S. and A.L. coordinated the research. E.R. and A.L.J. performed the data collection. E.R. and A.L.J. contributed to the study conception and literature search, supported by the specialized librarian at the university college. All authors in the research team participated in the data analysis. A.L. and E.S. were responsible for drafting the manuscript. All authors contributed to the intellectual content of the paper. The study was supervised by E.S. and A.L.
The authors wish to thank the nurse specialist students for participating in the study and Vibeke Horstmann for statistical expertise. We also thank Monique Federsel for revising the English language. This research was funded by The Centre for Women’s, Family & Child Health at the University College of Southeast Norway.
 Altmiller, G. (2011) Quality and Safety Education for Nurses Competencies and the Clinical Nurse Specialist Role. Implications for Preceptors. Clinical Nurse Specialist, 25, 28-32.
 Jokelainen, M., Turunen, H., Tossavainen, K., Jamookeeah, D. and Coco, K. (2011) A Systematic Review of Mentoring Nursing Students in Clinical Placements. Journal of Clinical Nursing, 20, 2854-2867.
 Berggren, I. and Severinsson, E. (2011) The State of the Science of Clinical Supervision in Europe. In: Cutcliffe, J., Hyrkäs, K. and Fowler, J., Eds., Fundamental International Themes, Routledge, Milton Park, 327-337.
 Proctor, B. (1991) Supervision: A Co-Operative Exercise in Accountability. In: Marken, M. and Payn, M., Eds., Enabling and Ensuring: Supervision in Practice, National Bureau and Council for Education and Training in Youth and Community Work, Leicester, 21-23.
 Fowler, J. and Cutcliffe, J.R. (2011) Clinical Supervision. Origins, Overviews and Rudiments. In: Cutcliffe, J., Hyrkäs, K. and Fowler, J., Eds., Fundamental International Themes, Routledge, Milton Park, 8-19.
 Kohn, L.T., Corrigan, J.M. and Donaldson, M.S. (2000) To Err Is Human: Building a Safer Health System. Committee on Quality Health Care in America, Institute of Medicine, National Academy Press, Washington DC, 6.
 Feng, X., Bobay, K. and Weiss, M. (2008) Patient Safety Culture in Nursing: A Dimensional Concept Analysis. Journal of Advanced Nursing, 63, 310-319.
 Severinsson, E. and Holm, A.L. (2015) Patients’ Role in their own Safety—A Systematic Review of Patient Involvement in Safety. Open Journal of Nursing, 5, 642-653.
 Jha, A.K., Prasopa-Plaizier, N., Larizgoitia, I. and Bates, D.W. (2010) On Behalf of the Research Priority Setting Working Group of the WHO World Alliance for Patient Safety. Patient Safety Research: An Overview of the Global Evidence. Quality Safe Health Care, 19, 42-47.
 Sullivan, T.D., Hirst, D. and Cronenwett, L. (2009) Assessing Quality and Safety Competences of Graduating Prelicensure Nursing Students. Nursing Outlook Today, 57, 323-331.
 Cronenwett, L., Sherwood, G., Barnsteiner, J., Disch, J., Johnson, J. and Mitchell, P. (2007) Quality and Safety Education for Nurses. Nurse Outlook, 55, 122-31.
 De Vries E.N., Ramratten, M.A., Smorenburg, S.M., Gouma, D.J. and Boermeester M.A. (2008) The Incidence and Nature of In-Hospital Adverse Events. A Systematic Review. Quality Safety Health Care, 17, 216-223.
 Leach, L.S., Myrtle, R.C., Weaver, F.A. and Dasu, S. (2009) Assessing the Performance of Surgical Teams. Health Care Management Review, 34, 29-41.
 Steven, A., Magnusson, C., Smith, P. and Pearson, P.H. (2014) Patient Safety in Nursing Education: Contexts, Tensions and Feeling Safe to Learn. Nurse Education Today, 34, 277-284.
 Severinsson, E. and Sand, Å. (2010) Evaluation of the Clinical Supervision and Professional Development of Student Nurses. Journal of Nursing Management, 18, 669-677.
 Amsrud, K.E., Lyberg, A. and Severinsson, E. (2015) The Influence of Clinical Supervision and Its Potential for Enhancing Patient Safety-Undergraduate Nursing Students’ Views. Journal of Nursing Education and Practice, 5, 87-95.
 Lyberg, A., Amsrud, K.E. and Severinsson, E. (2015) Evaluation Nursing Students’ Views of Improved Competence Development after Clinical Supervision: An Educative Approach to the WHO Patient Safety Model. Open Journal of Nursing, 5, 725-734. https://doi.org/10.4236/ojn.2015.58075
 World Medical Association Declaration of Helsinki (2008) Ethical Principles for Medical Research Involving Human Subjects. Adopted by the 59th WMA General Assembly, Seoul.
 McCulloch, P., Mishra, A., Handa, A., Dale, T., Hirst, G. and Catchpole, K. (2009) The Effects of Aviation-Style Non-Technical Skills Training on Technical Performance and Outcome in the Operating Theatre. Quality and Safety in Health Care, 18, 109-115.
 Gordon, M., Darbyshire, D. and Baker, P. (2012) Non-Technical Skills Training to Enhance Patient Safety: A Systematic Review. Medical Education, 46, 1042-1054.