Guidelines for evaluating dissertations for qualitative research methods

1. Organization and activities of a dissertation committee

Type of committee	A committee which consists of members from both inside and outside of the organization is desirable. Outside members of the organization means from both outside of the university/college and outside of the graduate school.
Evaluation criteria
	The committee includes experts of the research area as members.
	The committee includes experts of qualitative research methods as members.
	The committee members are selected by considering the student’s request.
	The committee members from the outside of the organization are selected by considering the students’ request.
	There is an agreed upon standard to select the outside members.
	At least one of the committee members advises in the writing of the research proposal.
	The committee has the consent of the student with the evaluation criteria of the research proposal.
	More than two committee members guide the research following the proposal.
	Evaluation of the qualitative research method is conducted when research outcomes are evaluated.
	Accountability is accomplished in the process of the examination.
	The rights of the student are protected throughout the examination process (Regarding the result of the examination, the rules for the appeal are secured).

2.Aspects of evaluating dissertations

	Evaluation criteria	Clue for evaluation
1	Research problem is appropriate	・The research problem, which is identified, based on a thorough literature review is appropriate for knowledge development in the related areas.
2	Research question is appropriate	・The specific research question is logically congruent to the research problem
3	A thorough literature review is conducted	・Literature review is conducted thoroughly in the related areas. ・The merits and the weak points of the literature in the area are understood and any possible research problems in the future are considered adequately. ・The research problem and question are appropriately located in the accumulation of knowledge by research conducted before.
4	The significance of the research is clear.	・Based on literature review, the significance of the research in the area is described.
5	The reason and appropriateness of selecting the research method is clear.	・The reason of selecting the research method is clearly stated based on the research question. ・The philosophical base of the research method is understood. ・The research purpose and the method are consistent.
6	Data are appropriate to answer the research question.	・The appropriateness of data related to the research question is explained. ・The appropriate data is obtained.
7	The reason of selecting the research participants is appropriate.	・The selection standard of research participants is described.
8	Research is conducted ethically.	・Ethical considerations for research participants are appropriately stated. ・The way of protecting the research participants’ human rights is clear.
9	The research method is understood thoroughly and used appropriately.	・The research method is understood and the research process is described clearly. ・The steps of analysis are clearly stated.
10	The quality of data is high (including the presentation in defense).	・Data indicate reality. ・The trustworthiness of data is secured. ・The quotation is indicated the research phenomenon properly.
11	The rigor of the results is secured.	・The operationalization of the concept for rigor is conducted. ・Member checking is conducted to secure trustworthiness. ・The way of securing the applicability and confirmability is described and conducted. ・The evaluation method of the rigor for analysis is described.
12	In-depth interpretation of data (in-depth analysis) and conceptualization is conducted.	・The analysis and interpretation of data are not only based on the order of the interview questions but also beyond them. ・The original question about the phenomenon is mostly answered.
13	The results are supported by the data.	・The theme and categories are produced by data. ・The way of supporting the results and considerations by data is described ・The Interpretation of data is understandable. ・The quotations are appropriate and amount of the quotations is adequate. ・The quotations and their interpretations are consistent.
14	The research produces new knowledge.	・The different viewpoints about phenomenon are presented. ・The results include new findings (Produced concepts are new). ・New insight is presented. ・A new aspect is recognized.
15	The results find an answer to the research question.	・The results about the phenomenon support the research question. ・The results achieve the research purpose.
16	The results are logically described.	・The results are described understandably so that other people can use the findings.
17	The implications about one’s own research are described.	・The location of the knowledge constructed by this research is clearly described in the related area. ・The utilization of the research is clearly stated. ・The implications for practice, research, education are discussed.
18	The limitations of the research are described.
19	The research contributes to nursing science.