Preliminary construction of evaluation indicator system for inpatients’ nursing service needs in tertiary general hospital

Sho-Ling Li, Yn Cui, Xio-Hong Lu, Xio-Min Liu, Ru-Ting Gu, Li-Li Wei

aDepartment of Vasculocardiology, The Affiliated Hospital of Qingdao University, Qingdao, Shandong 266000, China

bDepartment of Otorhinolaryngology Head and Neck Surgery, The Affiliated Hospital of Qingdao University, Qingdao, Shandong 266000, China

cThe Emergency Clinic, The Affiliated Hospital of Qingdao University, Qingdao, Shandong 266000, China

dDepartment of Nursing, The Affiliated Hospital of Qingdao University, Qingdao, Shandong 266000, China

Abstract: Objectives: To construct a comprehensive evaluation indicator system for inpatients’ nursing service needs in tertiary general hospital and to provide evidence for identifying and meeting the needs of inpatients’ nursing services.Method: We used the Delphi method to conduct two rounds of expert consultations with 41 experts.Result: The indicator system consisting of 5 first-level indicators and 48 second-level indicators was preliminarily constructed.Conclusions: We formed an evaluation indicator system for inpatients’ nursing service needs in tertiary general hospital and classified it into five categories: hospital environment, nursing attitude, nursing skills, information exchange, and emotional support. The indicator system is scientific and reliable. It can provide a basis for nursing staffs to identify and meet the needs of inpatients’ care services.

Keywords: inpatients · nursing service · needs · Delphi method

1. Introduction

With further advancement of a new round of medical reform, improving medical services as a key task at this stage and nursing services is an important part of it.1The concept of modern nursing service has been required to meet the needs of the patients, find the potential needs, predict the future needs, and provide the patients with professional and humanistic care services, which is also important to improve the patients' satisfaction.2To meet the needs of patients, nursing services should be able to identify their needs accurately and in time. However, the subjectivity of patients and the dynamics of disease increase the difficulty of recognition, which requires normalization of nursing service and practical standard of conduct.3In particular, the number of inpatients in the tertiary general hospital (hereinafter referred to as the patient) is large and the condition is heavy. Therefore, higher requirement for nursing services whether it can meet the needs of patients is an important manifestation of the comprehensive level of nursing services.4At present, the studies on the needs of hospitalized patients in China and other countries are mostly based on Maslow's hierarchy of needs theory. Although it can reflect the needs of the patients well, it cannot be directly converted into the clinical practice which is convenient for operation and evaluation. Most of the researches are based on quantitative or qualitative descriptive status analysis, neither they fully explore the underlying causes of it nor did they form a tool to guide clinical work. Therefore, at the hospital level, it is an urgent problem to establish the general evaluation system and to identify, evaluate, and satisfy the needs of the nursing service accurately and in time.5The purpose of this study is to establish a preliminary evaluation indicator system of nursing service requirements for inpatients in the tertiary general hospital using Delphi method to provide reference for measuring and evaluating the needs of nursing service and improving clinical work.

2. Materials and methods

2.1. Establishment of a research coordination group

The research coordination group consists of six members, including three experts, all of whom have postgraduate qualification, deputy directors, and above; three coordinators, all of whom have postgraduate qualification, two intermediate titles, and one junior title.

2.2. Forming an expert consultation questionnaire

On the basis of extensive reading of literature6-10and formerly semi-structured interviews,11referring to the “Quality Care Service Evaluation Rules (2014 Edition)” and the “Notice on Further Deepening Quality Care and Improving Care Services,” a preliminary draft of the patient care service needs evaluation indicator system was formed. In addition, intending to sample six experts in advance, according to the experts' suggestion, after discussion and revision, the first round of consultation volume was finally formed. The consultation volume covers 5 first-level indicators such as hospitalization environment, nurse attitude, nursing skills, information notification, and emotional support and 70 second-level indicators. According to the Likert 5 scale, the importance and feasibility of the items are divided into five levels: “not important” to “very important” and “not feasible” to “very feasible,” and they are assigned 1-5 points in turn. The first-level indicator of the volume filled in the importance of assignment, revision comments, and additional entries, and the second-level indicators increased the feasibility assignment. Also, the general survey of experts and their familiarity and judgment basis were also included in it.

2.3. Select experts in consultation

The principle of selection is that experts should be familiar with the subject and have authority in the industry, and they should also be familiar with wellinformed consent and have ability to cooperate. According to the purpose of this study, the selection criteria of experts for consultation are as follows: (1) Nursing management experts: Associate Dean of Nursing, Director or Deputy Director of Nursing Department of tertiary general hospital, with master's degree and above, engaged in nursing management for at least 10 years. (2) Clinical nursing specialist: Head nurse of tertiary general hospital, with bachelor degree or above, engaged in clinical nursing for at least 10 years. (3) Nursing education specialist: Engaged in nursing education for at least 10 years, with master's degree or above. (4) Experts in health administration departments: At least 5 years in charge of nursing work at municipal and above health administrative departments, had working experience in tertiary general hospital, with bachelor degree or above, with deputy level and above. (5) Head of the Third Party Accreditation Agency12: Had previous work experience in the health industry.

2.4. The implementation of expert consultation

Two rounds of expert consultation were conducted from July 2015 to December 2016. We used the method of destination sampling, selected experts working in nursing management, clinical nursing, and nursing education or scientific heads of third-party accreditation agencies with nursing work experience, who are familiar with the subject and with authoritative and representative, and informed well and willing to cooperate as consultant. The number of experts was based on the sample size of the consultation, depending on the size of the research question and the purpose of this study. According to epidemiology and statistical methods,13the consultation experts are well represented between 15 and 50. This study was aimed at the nursing needs of inpatients in tertiary general hospitals, and the scope and scale are relatively large. According to the actual situation, 41 experts were finally consulted. According to the actual situation of the experts, it was conducted in either way by personal distribution, e-mail, or online questionnaires. After retracting the first round of questionnaires, the items that meet the following conditions are retained: importance, feasibility assignment mean ≥4.0; coefficient of variation ≤0.25; reference perfect ratio ≥0.1. We collated and returned the results of first round to experts for the second round of consultation. The research coordination group held meetings to discuss experts' suggestions and integrate expert opinions. When the expert opinions are basically consistent, the consultation was concluded. Finally, 5 firstlevel indicators and 48 second-level indicators were identified.

2.5. Data statistics method

Excel software was used to build the database, and the database was imported into SPSS 17.0 software for processing. Descriptive statistics are used to calculate the mean, standard deviation, and coefficient of variation of the importance and feasibility of each indicator (except for the primary indicator). The reliability of the expert's correspondence is tested by means of authority, enthusiasm, and coordination. The comparison of consultations of coordination of two rounds was done using chi-squared test, andPvalues ＜0.05 were considered to reflect a significant difference.

3. Results

3.1. General information of experts

We successfully contacted 41 experts from 17 provinces and municipalities whose information are as follows: an average age of 47 ± 4.12 years and an average working age of 24 ± 3.79 years; education: 6 doctors, 29 masters, and 6 undergraduates; titles: 21 seniors (including professors), 13 vice seniors (including associate professors and deputy directors), and 7 intermediates; work units: 29 experts from hospitals, 8 experts from colleges and universities, 1 expert from health planning committee, 3 experts from third-party evaluation agencies, and some experts have work experience of two or more units.

3.2. Experts’ authority

The degree of expert opinion authority (Cr) is used to determine the reliability of the results of the consultation. It is the arithmetic average of the degree of familiarity (Cs) and the coefficient of judgment (Ca), which is obtained by the experts' self-evaluation. Cr ³ 0.7 is acceptable reliability. Cr ³ 0.8 indicates that the experts have a greater grasp of the choice of content.14The Cr values of the two rounds of consulting experts in this study were 0.76 and 0.86, so in this consultation experts' authority is reliable.

3.3. Experts’ activeness

Experts' activeness refers to the degree of concern, participation, and cooperation of experts in the research, which is illustrated by the response rate of questionnaires and the proportion of experts who make recommendations. It is generally believed that a recovery rate of more than 70% is a good survey. The higher the response rate and the greater the number of experts' proportion of making recommendations show the higher level of activeness of the experts. The response rates of the two rounds of this study were 82% and 94%, and the effective rates of response were 97% and 100%. The experts who made recommendations in the two rounds accounted for 54% and 21%, which indicates that the experts are highly active.

3.4. The coordination of experts’ opinion

The degree of experts' opinion coordination is mainly expressed by coefficient of variation (CV) and coordination coefficient (W). CV is the degree of coordination of all experts on a certain indicator; the smaller the CV is and the higher the degree of coordination mean more unified of the experts' opinion. The CV value range of the second round of all indicators is 0.05-0.21, and W is the degree of coordination of all indicators for all experts. The greater the W is and the higher the degree of coordination show the more unified of the experts' opinions.15Under normal circumstances, W fluctuates in the range of 0.4-0.5, indicating that the experts' opinions are well coordinated.14The W values of the two rounds of coordination coefficient was statistically significant,P＜ 0.05. The specific figures are shown in Table 1.

3.5. Modify indicators

In the first-level indicator, “information notification” was changed to “information exchange.” In the second-level indicator, in the hospital environment dimension, the “environmental cleanliness” and “the ward ventilation and no smell” were combined into “the ward is clean and odorless.” “Timely handling monitor alarm sounds,” “common patients in the same room,” and “internal entertainment resources” were deleted and “the convenience of living areas” was increased; in dimension of nursing attitudes, “speak softly,” “keep smiling,” and “timely humor” were deleted and “in special circumstances, with the ability to do things in time, and do extra things for patients” was changed to “in special circumstances for patients to solve urgent problems”; “apply patient-like title” was changed to “apply courtesy title”; in the dimension of nursing skills, “the same process for different nurses” was changed to “practicing according to law,” and the “correct and effective nursing operation” was changed to “standardized skilled nursing operation,” and “the comprehensive assessment of patients before operation” was added; in the dimension of information exchange, “information is provided with written materials” was changed to “different forms of health education, content is targeted,” and “security knowledge notification (fire channel, accident prevention, etc.)” was added; in the emotional support dimension, “quickly solve pain” was changed to “quickly and effectively treat pain,” and “encourage patients to express their emotions freely” was changed to “encourage patients to seek emotional venting methods.”

Table 1. The experts' opinion coordination coefficient.

3.6. Inquiries results

We adopted the amendments of the experts to delete, modify, and add relevant items. For the items that satisfy the importance, the feasibility assignment mean ≥4.0, the coefficient of variation ≤0.25, and the reference perfect ratio ≥0.1 were retained. Finally, the patient care service demand evaluation index system was constructed as shown in Table 2.

Table 2. Evaluation indicator system for inpatients' nursing service needs in tertiary general hospital.

First-level indicator Second-level indicator Importance score Coefficient of Feasibility score Feasibility (mean ± standard deviation)variation of coefficient of importance (CV)variation (CV)Timely processing and feedback of problems 4.67 ± 0.595 0.13 4.44 ± 0.660 0.15 reflected by patients Often inspect the ward and discover patients' 4.39 ± 0.747 0.17 4.53 ± 0.563 0.12 needs in time Solve urgent problems for patients under special 4.41 ± 0.615 0.14 4.32 ± 0.727 0.17 circumstances Careful operation 4.55 ± 0.632 0.14 4.26 ± 0.545 0.13 P yo ro ua rsc e ti lv f e dl y u ri in nt gr o td hu ec se h ift 4.58 ± 0.614 0.13 4.11 ± 0.681 0.17 Appeal courtesy 4.48 ± 0.795 0.18 4.15 ± 0.758 0.18 Nursing skills Strictly observe the n au n d rs i pn rg a co tp i ce i n ra gt io acn c s oy rs dt ie nm g 4.50 ± 0.218 0.16 4.23 ± 0.774 0.18 to law Standardize and perform nursing operation skillfully 4.96 ± 0.535 0.11 4.30 ± 0.837 0.19 and soft operation Can be successful at o sun ce c t ei m sse f,u o l t rh ee cr ow vi es re y in 4.69 ± 0.604 0.13 4.70 ± 0.535 0.11 time Predictive discovery and treatment of nursing 4.55 ± 0.642 0.14 4.52 ± 0.586 0.13 problems H toa sn pd es c h if y icg ai e tione n sa c c ording 4.56 ± 0.564 0.12 4.37 ± 0.556 0.13 S th t er i c ct h im ecp kl e sm y se t n et ma t i on of 4.55 ± 0.564 0.12 4.50 ± 0.682 0.15 A ans dsi s l i t f ei n c d aa reil y a ctivities 4.88 ± 0.331 0.07 4.40 ± 0.855 0.19 Teaching patients or their families basic nursing 4.67 ± 0.540 0.12 4.30 ± 0.750 0.17 skills Comprehensive assessment of patients 4.69 ± 0.535 0.11 4.25 ± 0.622 0.15 before operation Have both therapeutic communication and daily 4.59 ± 0.615 0.13 4.40 ± 0.770 0.18 communication Provide information platform and do a good 4.79 ± 0.412 0.09 4.24 ± 0.741 0.17 job of continuing care I en xf co hr m ana g ti eon I an nf o dr m ta rt gi m ete el dy, de tailed, 4.56 ± 0.564 0.12 4.24± 0.819 0.19 Asking about eating habits and guiding 4.69 ± 0.471 0.10 4.32 ± 0.843 0.20 dietary requirements Health education is diverse in form and 4.69 ± 0.471 0.10 4.21 ± 0.846 0.20 content is targeted Safety knowledge notification (fire exit, 4.29 ± 0.310 0.07 4.44 ± 0.705 0.16 accident prevention, etc.)Communication before, during, and after 4.27 ± 0.529 0.12 4.47 ± 0.615 0.14 operation

First-level indicator Second-level indicator Importance score Coefficient of Feasibility score Feasibility (mean ± standard deviation)variation of coefficient of importance (CV)variation (CV)Listen and answer q enu ce os t ui o ran gs e w pit ah t ip e a nt t i se n t oc e, 4.55 ± 0.666 0.15 4.47 ± 0.825 0.18 make decisions P emay o a ti t ot e nn at li o c hn at o n gp ea st i en ts' 4.42 ± 0.672 0.15 4.65 ± 0.646 0.14 Emotional support P es ro te te ec m t pa tients' self-4.38 ± 0.609 0.14 4.24 ± 0.579 0.14 Q treu aic t k pl y a ia nn d effectively 4.55 ± 0.564 0.12 4.56 ± 0.660 0.14 E sen ec ko u er ma g oe t i op na at li e vn et ns t it no g 4.58 ± 0.663 0.14 4.18 ± 0.846 0.20 H coe nlp f idp ea nt i ce en t s build 4.63 ± 0.647 0.14 4.39 ± 0.827 0.19 C in o dn i vs idid ue ar l t ch he a p raa c ti te en ri t ss t'i cs 4.73 ± 0.452 0.10 4.09 ± 0.714 0.17 U lifn e d se i t r us at a tin o d n t he patients' 4.79 ± 0.485 0.10 4.36 ± 0.699 0.16 Encourage relatives and friends to give emotional 4.73 ± 0.517 0.11 4.19 ± 0.891 0.21 support to patients

4. Discussion

4.1. Analysis of representativeness,enthusiasm, and authority of experts

The choice of experts is the key to the Delphi's letter of consultation. The experts participating in this study have good regional representation and subject representativeness. In addition, the experts from third-party accreditation bodies reduced bias to a certain extent. The experts put forward revision opinions on the language expression and specific content of the questionnaire, making the indicator system more scientific and accurate. From the questionnaire recovery rate, the proportion of experts who make recommendations, the Cr value of the two rounds inquiries, the W value, and the CV value of the second round, it is known that the enthusiasm and authority of the experts were high, indicating that the opinions of the experts through the two rounds of correspondence are basically consistent and the construction of this indicator system is relatively successful.

4.2. Analysis of the contents of the indicator system

This study was based on the principle of facilitating the work of first-line nurses in clinics. It was different from the previous theoretical framework of Maslow's needs. Based on the category of nursing services, the internal design of each dimension refers to the level of Maslow's needs, and the concept of holistic nursing and human care was combined in the design of the item.9,16The design of the secondary indicator considers both the importance and feasibility. The demand is determined by motivation to determine a person's mood and behavior, while the nurse has to concern about the patients' emotions and behavior, and also to close the needs behind it. Due to the discomfort of the disease, the patients urgently need a quiet and comfortable rest environment, and fresh and interesting stimulation; comfortable and warm environment can improve the mental state of the patient.17Therefore, the hospital environment dimension requires safe, quiet, and convenient living conditions, as well as a beautiful physical environment and a warm human environment.16Attitude is a psychological term that refers to the individual's stable psychological tendency to a particular subject, mainly through behavior and expression. In interpersonal communication, a positive attitude can give the contact person a sense of identity and belonging.18Therefore, the patients' evaluation of nursing behavior was largely a response to the attitude of the nurse, so the attitude in the nursing work greatly affects the patients' evaluation of the entire nursing service and even medical services. Therefore, this dimension had been set up with humanistic care items, such as “harmony, enthusiasm, equality, and initiative, courtesy” and professional items such as “timely and wholeheartedly.”

Nursing skills are the core of nursing services and directly affect patients' prognosis.19Most of the patients may pay attention to whether their familiar operations cause discomfort, which requires nurses to think about their feelings and needs from the perspective of patients. In addition, this also suggests that the design of this dimension can not only be stuck in the patients' perspective, but also provide normative and humanistic care skills with a professional perspective. Therefore, the dimension includes “instructing daily activities, operating practices, safety, and proficiency” and items such as “predictive, adequate assessment, and comfort.”

The experts suggested changing the information notification to information exchange to reflect the twoway nature of the information. Although the information between the nurses and patients is asymmetric, however, the more information nurses know about patients, the more specific and targeted services they can provide, and the more they reflect the importance of human care and communication in nursing services, so they are adopted. At present, the use of the network in nursing is increasing, and it is more convenient for patients to obtain health education knowledge, which is conducive to patients to choose the best medical care plan according to their own situation.20Therefore, the information exchange dimension includes both communication of disease, diet, and safety, as well as the communication of daily health education and nursing operations.

A study showed that emotional support is the largest gap between patients' perception and expectation.21Emotion is the attitude experience of whether an objective thing satisfies self-demand, and it focuses more on social needs. Different hospitalization periods and special physical conditions can make the patients' emotions change greatly in a short time. If the patients' different emotional changes can be expected or captured in time, it is easier to understand the patients' reaction behavior and targeted intervention. Taking into account the current situation of the patients with the same sympathy will allow the patients feel the care and understanding of the nurse from the heart.22In addition, different patients face diametrically opposite emotions when facing the same problem. Therefore, emotional support must be personalized. Hospitalization belongs to a life event, while paying attention to its adverse effects on life. It is necessary to guide patients to think about its positive side, help patients to establish a correct outlook on life and values, and even sublimate their emotions, but there is less research and application at this level. Therefore, the emotional support dimension is based on the needs of the patients' social level, and it fully considers the patients' subjective initiative.

4.3. Limitations of this study

Although the research experts had certain regional and academic representations, there may still be some limitations due to the Delphi technology itself. Before the questionnaire was formed, the interviewed patients were all from the same hospital and there may be some bias.11In addition, this study is aimed at patients in general departments such as internal medicine, surgery, and obstetrics and gynecology. It is not classified and stratified according to department, hospitalization time, and patients' demographic data. Does this evaluation system truly reflect the patients' demand for nursing services? It needs to be verified through further exploration and practice.

5. Conclusions

Finally, we formed an evaluation indicator system for inpatients' nursing service needs in tertiary general hospital and classified it into five categories: hospital environment, nursing attitude, nursing skills, information exchange, and emotional support. The evaluation indicator system for inpatients' nursing service needs in tertiary general hospital was formed, which provided a scientific evaluation tool for the identification, evaluation, and satisfaction of inpatients' nursing service needs in tertiary general hospital.

Ethical approval

Ethical issues are not involved in this paper.

Conflicts of interest

All contributing authors declare no conflicts of interest.