Advances in Information Systems (General Track)

Paper Type

Complete

Paper Number

1594

Description

Information systems is increasingly engaged in the research approach of Design Science Research, a research paradigm that answers a question relevant to human problems by creating innovative artifacts. With the help of those artifacts new knowledge is added to the body of scientific evidence, which directly contributes to solving industrial and societal problems. A critical phase in the design science process is the evaluation of the artifacts to demonstrate utility, quality, and effectiveness. Although there is consensus that evaluation is an essential phase in the design science process, it is surprisingly little used in practice. This paper presents a systematic literature review of twenty-four examined research articles published in eight literature and conference databases to determine issues that can arise during the evaluation phase. The findings are six issues with Consistent Basis being the most frequently mentioned, which includes little guidance and support for the planning and implementation of evaluation.

Share

COinS
 
Aug 9th, 12:00 AM

Identification of Issues in Design Science Research Evaluation – A Literature Review

Information systems is increasingly engaged in the research approach of Design Science Research, a research paradigm that answers a question relevant to human problems by creating innovative artifacts. With the help of those artifacts new knowledge is added to the body of scientific evidence, which directly contributes to solving industrial and societal problems. A critical phase in the design science process is the evaluation of the artifacts to demonstrate utility, quality, and effectiveness. Although there is consensus that evaluation is an essential phase in the design science process, it is surprisingly little used in practice. This paper presents a systematic literature review of twenty-four examined research articles published in eight literature and conference databases to determine issues that can arise during the evaluation phase. The findings are six issues with Consistent Basis being the most frequently mentioned, which includes little guidance and support for the planning and implementation of evaluation.

When commenting on articles, please be friendly, welcoming, respectful and abide by the AIS eLibrary Discussion Thread Code of Conduct posted here.