Clinical judgement has been identified as an essential component of safe and effective nursing care and has been incorporated into the competency standards for registration by various nursing registration boards      . As nurses engage in multiple clinical judgement episodes in their care of a patient, it is paramount that nurses have the ability to recognize important changes in the patient’s condition, especially in the deteriorating patient, and respond appropriately   . However, nurse leaders have identified that new graduate nurses may not always adequately demonstrate clinical judgement in practice     .
Often the definitions and characteristics of clinical judgement are not clearly stated in the literature  . Clearly identified characteristics could provide a framework for clinical judgement to assist both clinical nurses and nurse researchers in observing and describing clinical judgement in action.
This paper reports a study that aimed to clarify the main characteristics of clinical judgement from the perspectives of nurse scholars, nurse academics and clinical nurses.
Although clinical judgement has been identified as an important component in the provision of safe and effective patient care, it remains a challenging concept to articulate and assess. Clinical judgement in nursing is broadly described as involving the collection of important patient data, the interpretation of the collected data, forming a hypothesis, responding by nursing action and reflecting on and evaluating the actions taken     .
The most commonly used definition of clinical judgement in the nursing literature is that of Tanner  who describes the cognitive processes nurses use to determine and anticipate patient’s needs. This definition was developed from her observation of expert nurses and their decision-making processes. Furthermore Tanner  identified what the nurse brings to the situation (their knowledge and experience), how a relationship with a patient, (knowing the patient and how they respond) as well as the context in which the situation occurs, all of which will influence that nurse’s clinical judgement. While this definition describes the concept of clinical judgement, the specific characteristics or elements that are incorporated within this process were not stated.
A search of the literature revealed two separate concept analyses that described the characteristics or specific elements of clinical judgement   . A concept analysis is usually undertaken to identify the basic element or characteristic of a concept  . Delineating the concept of clinical judgement into its characteristics will allow the objective observation of clinical judgement in action to measure students’ achievements in this skill and to identify areas for further development.
The concept analysis by South African researchers van Graan, Williams  aimed to develop a theoretical definition of clinical judgement using a framework by Walker and Avant. Following a search of the literature (including both medical and nursing dictionaries) the researchers defined clinical judgement as both a singular event “Clinical judgement is the conclusion at which a nurse arrives through the ability to gather salient pieces of information …” (p. 38), and a process, with 18 characteristics (or attributes) of the concept of clinical judgement (p. 39). A second concept analysis conducted by Australian researchers  in an integrative review identified 13 characteristics.
The characteristics from both studies have at their core the collection and interpretation of data, planning of care, and evaluation of the data. This is consistent with Tanner’s definition of clinical judgement described earlier. Both sets of characteristics also emphasised the theoretical, practical and experiential knowledge of the nurse and the context within which the clinical judgement occurs, which are important aspects of clinical judgement according to Tanner  . However, in the van Graan paper the characteristics are not mutually exclusive, for example, “manage uncertainty” is a synonym for the characteristic “nuanced/ distinct ability” and also as the separate characteristic “managing uncertainty”. van Graan, Williams  described antecedents and consequences around the action of clinical judgement, so clinical judgement appears to be separate to the characteristics and therefore the nature of clinical judgement appears unclear.
Clearly there remains uncertainty around the characteristics of clinical judgement and more research is needed to enable educators and researchers to explore and apply the concept of clinical judgement. To further develop this field of research, the authors undertook a study to clarify the characteristics formulated from the concept analysis in our previous paper  . The current paper reports a two-phase survey to obtain consensus from nurses in both academic and clinical roles about the characteristics of clinical judgement.
The aim of the study was to:
・ Confirm the characteristics of clinical judgement identified from the literature;
・ Identify if the characteristics accurately represented the nurses’ perceptions of clinical judgement.
The study used an online survey developed by the researchers to investigate whether the characteristics of clinical judgement accurately represented the perceptions of clinical judgement used by nurses in their clinical practice. There has been an increase in use of online surveys as the use of the internet has become widespread   . The use of online surveys has the advantages of potentially being able to access populations in distant locations and can reduce the time and effort exerted by researchers  .
The study used a survey design in two phases using convenience sampling with participants invited to complete the survey online. The survey instrument sought demographic information and identification as to whether the previously identified 13 characteristics  accurately represented the cognitive process of clinical judgement.
Prior to data collection approval from the institutional Human Research Ethics Committee was obtained. As data were collected using an anonymous online survey therefore confidentiality was assured. Implied consent was indicated by completion of the survey.
4.3. Phase 1
In phase 1 the survey incorporated a tick box format using Yes and No answers eliciting responses from nurse scholars and nurse academics. The survey during this phase was conducted between November 2015 to March 2016.
4.4. Sample and Recruitment
Participants in this phase of the study were nurses who work within the tertiary education sector. The participants were identified as nurse scholars: these were academics who had published around cognitive processes used by nurses and had a track record of research in the area with their information sourced from Google and published articles. This sample also included nurse educators identified from staff lists on university schools of nursing websites throughout Australia. Recruitment occurred through the inclusion of a hyperlink in an email.
4.5. Survey Tool
A survey was created asking participants whether they agree by answering either Yes/No to the 13 characteristics identified were components of clinical judgement. The 13 characteristics were: “essential for safe practice”, “Interpretation of patient/clients’ needs”, “Culminates in a clinical decision”, “Involves pattern recognition”, “Knowledge based on practical skills”, “Context Dependent”, “Evaluation of choices made”, “Knowledge based on experience”, “Systematic process”, “Reflective process”, “Culminates in a clinical management plan”, “Knowledge based on theory” and “cyclical process”  .
4.6. Data Collection
Data were collected using an online survey software tool, Qualtrics® (http://www.qualtrics.com/research-suite/#academic). The online survey is flexible and allows the collection of both quantitative and qualitative data and has the capacity for downloading the completed responses into suitable software for data analysis. The online survey was disseminated via individual emails to the nurse academics and accessible via an attached hyperlink. A total of 269 surveys were emailed with 39 completed surveys.
4.7. Data Analysis
Data analysis was performed on the survey responses of the 13 characteristics and a percentage agreement was calculated. There are no clear guidelines or objective methods available in the literature to identify the acceptable level of agreement between participants when completing surveys   . When the survey is limited to only two scores (as this phase of the survey has Yes or No answers), percent agreement is a valid measurement to use  .
Fifteen (38%) of the respondents elected not to reveal their age; of the rest 41 - 50 years’ group had the highest representation with 13 (33%). Doctorate qualification was highly represented in the sample (n = 8) and the respondents held various positions with the university sector from associate lecturer to professor in nursing (Table 1).
As a Yes/No response was used it is difficult to determine what percentage of Yes determines a level of agreement as the literature varies from 50 upwards 
Table 1. Phase 1 Demographics of academics for combined nurse scholars and nurse academics.
 , the authors elected to accept a consensus level of 60% (indicating a moderate level of agreement) as acceptable for each of the 13 characteristics in phase 1 of the survey (see Table 2). At this level of agreement all participants identified that 12 of the 13 characteristics were components of clinical judgement. Two of the 13 characteristics “interpretation of the patient’s needs and “knowledge based on experience” had the highest level of agreement with 95%. This was followed by “essential for safe patient/client care” at 92%. There was a moderate level of agreement with five of the characteristics “knowledge based on theory, “evaluation of choices made, and actions taken”, “reflective process”, pattern recognition” having 67% agreement and “systematic process” having 61% agreement. The characteristic “a cyclical process” was only identified by 54% of respondents and fell below the level of agreement for acceptance as a perceived characteristic of clinical judgement.
4.10. Phase 2
In phase 2 the survey was adapted to use a 5-point Likert scale to indicate the extent of their agreement or disagreement with each of the characteristics identified. Participants in phase 2 were nurses from both clinical and academic areas. The survey for this phase was conducted between May 2017 and February 2018.
4.11. Sample and Recruitment
To identify the strength of agreement between respondents to the characteristics in the survey it was modified to indicate the extent of the agreement or disagreement with each of the 13 characteristics. The participants for this phase were all nurses with recruitment occurring via online networks with a hyperlink contained within the invitations posted to these networks.
Table 2. 60% agreement for characteristics of clinical judgement in descending order.
4.12. Data Collection
The software program Qualtrics® was used to collect the data in this phase. A5-point Likert scale was introduced with 1 being strongly disagree, 2 somewhat disagree, 3 neither agree or disagree, 4 somewhat agree, and 5 strongly agree with each of the 13 identified characteristics of clinical judgement. Likert scales have been widely used in research when assessing attitudes, as it permits a range of answers allowing the respondents to specify their level of agreement or disagreement with statements made  .
The link to the survey was posted onto professional networks (Australian Nurse Teachers’ Society & Sigma Theta Tau International) and to social media (Facebook and Twitter), inviting all registered nurses to respond, and the survey remained open for two months. This captured nurses in a variety of sectors to confirm and validate the results of the first survey.
4.13. Data Analysis
The data were exported from Qualtrics® to Statistical Package for Social Sciences (SPSS) version 24 for management and analysis  . The demographics were presented as frequency distributions. Descriptive analysis of each characteristic was undertaken with frequencies tallied, means and standard deviation calculated. Cronbach’s alpha was calculated for the items in the survey.
While seventy-six participants started the phase 2 survey and only completed the demographics section; 29 completed the full survey. From those that completed the full survey, the majority (72%) were aged between 41 - 60 years. Fourteen (48%) respondents were in the 51 - 60 years’ group with 7(24%) in the 41 - 50 years’ group. The length of time the respondents worked in nursing ranged between 5 to 42 years with 15 (52%) having between 30 - 45 years’ nursing experience. Ten (34%) respondents indicated a master’s degree in nursing as their highest academic qualification. The positions these respondents held were varied, with nurse educators 10 (34%) having the greatest representation (see Table 3). Twelve (41%) respondents were currently employed in the hospital setting and eight (28%) were community based. Eight (28%) respondents identified which department they worked in which included intensive care (2), coronary care, operating theatre, emergency, endoscopy, recovery and justice/mental health. All the respondents except two spoke English as their main language.
The means, standard deviations and percentage of strongly agree/agree for each of the 13 items in the survey are presented in Table 4. Cronbach’s Alpha for the overall consistency for the survey is 0.854 presented in Table 5.
The 13 individual characteristics elicited “strongly agree” or “agree” responses from more than 79% of respondents with seven of the items eliciting a response
Table 3. Demographics for Phase 2.
of 90% and above with the response for the characteristic “involves pattern recognition” was 97% and “knowledge based” was 96%. The means and standard deviations for each of the characteristics range from a high of 4.79 (“essential for safe practice”) to a low of 4.10 (“knowledge based on theory”) (see Table 4).
Table 4. Means, standard deviation and frequency scores for Phase 2 survey (in descending order).
Table 5. Cronbach’s alpha reliability statistics.
The aim of this study was to establish if the previously identified characteristics of clinical judgement by our team  accurately represented the perceptions of clinical judgement by nurse educators, academics and clinicians using an online survey. This aim was achieved as over 60% of the nurse academic and nurse scholar respondents in phase 1 identified 12 of the 13 characteristics as being characteristics of clinical judgement. The characteristic that had a low agreement was a “cyclical process”. This is interesting as the respondents did identify that clinical judgement is a reflective process and that it involved evaluating the care given and making changes to the patient’s management plan, which according to Nielsen, Stragnell  does infer a cyclical process.
This study’s findings support previous literature where scholars suggest clinical judgement is essential for safe and effective nursing care      . While safe and effective care can be observed it can also be viewed as an outcome and thus needs further exploration. Interestingly, the characteristic with the highest percent agreement was “pattern recognition and synthesis” which is the ability for the early recognition of changes in the patient’s condition which  identified as the difference between an expert and a novice nurse.
Including two surveys in the study design helped to identify the characteristics more definitively more than a single survey. Generally, there was variability in the responses between the two phases. In phase 1 the characteristics which scored the highest were “interpretation of patient/client’s needs” and “knowledge based on experience” whereas in phase 2, “pattern recognition and synthesis” and “knowledge based on practical skills” scored the highest. Differences in responses could be reflective of the measure as the phase 1 survey forced a Yes/No response whereas in phase two respondents could report the degree to which they agreed with the characteristics. Also, there was a different context from which the participants viewed clinical judgement in phase 1 as the respondents were nurse academics and the second phase respondents were mostly clinicians (80%). Benner, Tanner  , Lasater  and Tanner  do state that clinical judgement is context dependent and therefore a variability of results would be expected. However, the study does show an agreement with the characteristics and reflects how important each characteristic is in relation to clinical judgement.
6. Strengths and Limitations
The strength of the study allows the characteristics of clinical judgement to be easily described so it can be applied to nursing research and education. Although there was the potential for larger numbers of participants using social and professional networks the response rate for the two phases of the survey remained low despite reminders. This is not uncommon when surveying nursing populations  . Despite a low response rate, the respondents were drawn from a variety of experienced nurses, both clinicians and nurse academics.
By using percentage agreement, while it is a simple and viable way to analyze the data as only two responses used, it does not provide a discrete analysis of participant agreement as a Likert scale.
The 13 characteristics identified accurately represented the nurses’ perception of clinical judgement. Identifying the characteristics allows nurses and educators to describe the process of clinical judgement, might enable the identification of teaching strategies to promote the development of clinical judgement. To develop these strategies, all of the characteristics need to be incorporated.
The identification of the characteristics has increased the knowledge of the cognitive process of clinical judgement. This increase in the knowledge can be used to educate nursing students and guide the practice of registered nurses. When designing learning strategies and research projects to foster clinical judgement care needs to be taken to include all the identified characteristics.
 Levett-Jones, T., et al. (2010) The “Five Rights” of Clinical Reasoning: An Edeucational Model to Enhance Nursing Students’ Ability to Identify and Manage Clinically “at Risk” Patients. Nurse Education Today, 30, 515-520.
 Kavanagh, J. and Szweda, C. (2017) A Crisis in Compentency: The Strategic and Ethical Imperative to Assessing New Graduate Nurses Clinical Reasoning. Nursing Education Perspectives, 38, 57-62.
 Monagle, J., et al. (2018) New Graduate Nurse Experiences in Clinical Judgment: What Academic and Practice Educators Need to Know. Nursing Education Perspectives.
 Missen, K., McKenna, L. and Beauchamp, A. (2016) Registered Nurses’ Perceptions of New Nursing Graduates’ Clinical Competence: A Systematic Integrative Review. Nursing and Health Sciences, 18, 143-153.
 El Haddad, M., Moxham, L. and Broadbent, M. (2013) Graduate Registered Nurse Practice Readiness in the Australian Context: An Issue Worthy of Discussion. Collegian, 20, 233-238.
 Van Graan, A., Williams, M. and Koen, M. (2016) Clinical Judgement within the South African Clinical Nursing Environment: A Concept Analysis. Health SA Gesondheid, 21, 33-45.
 Wright, K. (2005) Researching Internet-Based Populations: Advantages and Disadvantages of Online Survey Research, Online Questionnaire Authoring Software Packages, and Web Survey Services. Journal of Computer-Mediated Communication, 10.
 Xu, S. and Lorber, M. (2014) Interrater Agreement Statistics with Skewed Data: Evaluation of Alternatives to Cohen’s Kappa. Journal of Consulting and Clinical Psychology, 82, 1219-1227.
 Benner, P.R.N.P.F., Tanner, C.A.R.N.P.F. and Chesla, C.A.R.N.D. (2009) Expertise in Nursing Practice, Second Edition: Caring, Clinical Judgment, and Ethics. Springer Publishing Company, New York.