This is part 4 of a 5 part series on using case study research methods in information systems research

This essay provides an overview and review of Darke, Shanks & Broadbent’s (1998) article titled “Successfully completing case study research: combining rigour, relevance and pragmatism” published in the Information Systems Journal in 1998. In this paper, Darke, Shanks & Broadbent (hereafter known as ‘the authors’) provide an excellent overview of using case studies in information system research.  In providing this overview, the authors have touched on every aspect of the use of case studies and provided guidance on how to prepare for, perform and present research to ensure rigor and relevance.

Unlike papers that attempt to show the case study as a means to perform information systems research, this paper provides a great deal of pragmatic advice in an easy to read and comprehend manner.  Compared to other papers like Lee (1989), Eisenhardt (1989), Gable (1994) and Kaplan & Duchon (1988), this paper is much more readable and informative, especially for students and practitioners new to the world of information systems research.   This paper would be an ideal ‘first step’ for any person moving into the world of using case studies in information systems research. Once the concepts of this paper are understood and mastered, it would seem much easier for the novice information system research to move on to the more involved articles mentioned previously.

The main contribution of this paper is found in the five frequently asked questions that the authors constantly hear about case study research (Darke, et al., 1998).  These five questions are summarized and briefly discussed in the following paragraphs.

The first frequently asked question has to do with the types of research that can be addressed using the case study approach.  The authors suggest, based on research from other authors, that the case study is best used in those circumstances where a phenomenon needs to be studied in its real-world environment in the context in which it exists (Benbasat, Goldstein, & Mead, 1987; Darke, et al., 1998; Yin, 2009).  In addition, the case study research approach is a better fit when the theory of a phenomenon is not fully formed nor understood (Benbasat, et al., 1987; Darke, et al., 1998; Yin, 2009).

The second frequently asked question revolves around the design and scope of a case study so that it can answer a research question in an appropriate manner.  The first step in designing a research project is to develop a valid and significant research question (Darke, et al., 1998). The second step in designing and scoping a case study project is to perform an in-depth literature review to understand existing theory and research. Lastly, the researcher needs to consider the usefulness and interest in their research topic to ensure that the project will be well received once complete.

The third question that the authors constantly receive has to do with obtaining the approval of an organization targeted for inclusion in the case study.  This approval and participation is key since the research may not be usable or achievable without the consent of the organization and people included in the research project.

The fourth question deals with the effective use of data collected during the case study research project.  The authors provide guidance on effectively collecting, storing and using data during (and after) a research project.  Suggestions and tips are given for collecting data during research and how to ensure that data is available for review after the research project is complete.

The fifth question is arguably the most important as it deals with writing up the research for others to consume. While the previous questions are important, the inability to clearly state reason and outcome of the research project in a meaningful way will cause any research project to flounder.  The authors suggest that any research project should be written up well but the since the case study shows real-world phenomenon in a real-world setting, the researcher must go to great lengths to show that the research was designed and performed in a rigorous manner.

As mentioned, the authors provide a great deal of background information about the use of case studies.  This background includes the various approaches for case studies, why case study research should and shouldn’t be used and how data can be collected and utilized within the case study framework.   In addition, the authors provide a  great contribution by describing providing answers to commonly asked questions about the case study research approach.

References

• Benbasat, I., Goldstein, D. K., & Mead, M. (1987). The case research strategy in studies of information systems. MIS Q., 11(3), 369-386.
• Darke, P., Shanks, G., & Broadbent, M. (1998). Successfully completing case study research: combining rigour, relevance and pragmatism. Information Systems Journal, 8(4), 273-289.
• Eisenhardt, K. (1989). Building Theories from Case Study Research. The Academy of Management Review, 14(4), 532-550.
• Gable, G. G. (1994). Integrating case study and survey research methods: an example in information systems. European Journal of Information Systems, 3(2), 112-126.
• Kaplan, B., & Duchon, D. (1988). Combining qualitative and quantitative methods information systems research: a case study. Management Information Systems Quarterly, 12(4), 571-586.
• Lee, A. S. (1989). A scientific methodology for MIS case studies. MIS Q., 13(1), 33-50.
• Yin, R. K. (2009). Case Study Research: Design and Methods (Vol. 5): SAGE.

This is part 2 of a 5 part series on using case study research methods in information systems research.

This essay provides an overview and review of Lee’s article titled “A Scientific Methodology for MIS Case Studies” published in MIS Quarterly in 1989. In this paper, Lee (hereafter known as ‘the author’) provides a review of using scientific methods during case study research in the information systems field.

The scientific model used by the author is based on the natural science model found in social science research and described in detail by many researchers.  On of these researchers, Behling (1980), describes the use of research methods similar to the natural science model in organizational behavior as being widely accepted and used (Behling, 1980).  This natural science model is the basis for the author’s model for us in MIS case studies.

The author defines an MIS case study as “the examination of a real-world MIS as it actually exists in its natural, real-world setting” (Lee, 1989, p. 34). This definition, while excellent, introduces a few problems with respect to the use of the scientific model described by the author.  These issues, described in detail by the author, are summarized in the next few paragraphs.

The first problem has to do with controlling the observations during the research. With the definition given of real-world system in real-world settings, it is virtually impossible to control variables and/or settings thereby taking away the scientific approaches used to control variables that are found in other types of research.

The second problem has to do with making controlled deductions from the research being performed. When looking at real-world situations using case studies, it is rare to have controlled, quantitative data to make controlled deductions.  Without quantitative data, the qualitative data that is gathered must be interpreted, which could leave room for interpretation errors.  It is worth nothing that Cavaye (1996) and Kaplan & Duchon (1988) provide some evidence that quantitative data can and is used within case research (Cavaye, 1996; Kaplan & Duchon, 1988).

The third problem revolves around the replicability of the results of the case study. Again, since the case study is looking at real-world systems in a real-world setting, it will extremely difficult for a researcher to find the exact same set of variables configured in exactly the same way (people, technology, political atmosphere, etc). This inability to replicate the case study makes it difficult for future researchers to validate and verify the results reported in the case.

The fourth problem has to do how the research and result can made to be generalizable to other problems and locations. Being as the case study is composed of real-world, non-replicable events and interactions, researchers must find ways to show that the case study outcome is valid and prepare for arguments from critics.

While the problems listed above are quite serious, the author provides excellent advice to overcome these issues while using case research for real-world systems.  The author argues that these problems can be overcome by providing for the requirements of “falsifiability, logical consistency, predictive power exceeding that of competing theories and survival of the empirical tests aimed at falsifying it” (Lee, 1989, p. 37).  Using these four requirements as guidelines, a researcher can use the case study method as defined by the author to ensure quality research.

As an example of a case study using this approach, the author provides a review of Markus (1983) “Power, Politics and MIS Implementations” case study.  This study describes an MIS implementation and looks at the competing theories on resistance to MIS implementation theories (Markus, 1983).   The author provides a detailed description of how Markus has met the four requirements to overcome the problems associated with using the scientific model for case study research.

This paper might have provided more insight if it had taken wider view of the types of research that might be undertaken.  This paper takes a positivist approach to case study research without providing and insight into how an interpretivist approach might provide different approaches to information systems research. In addition, the quickness of the author to disregard the availability of quantitative data in case study research for information systems researchers is disturbing. Cavaye (1996), Kaplan & Duchon (1988) and Gable (1994) have shown that quantitative data can be used in MIS case study research quite effectively.

This paper provides a significant contribution to IS research by describing the use of case studies as a scientific method for studying management information systems.  Although there are some limitations, the problems described and the descriptions for overcoming these problems are excellent.

References

• Behling, O. (1980). The Case for the Natural Science Model for Research in Organizational Behavior and Organizational Theory. Academy of Management Review, 5(4), 483-490.
• Cavaye, A. L. M. (1996). Case study research: A multi‐faceted research approach for IS. Information Systems Journal, 6, 227-242.
• Gable, G. G. (1994). Integrating case study and survey research methods: an example in information systems. European Journal of Information Systems, 3(2), 112-126.
• Kaplan, B., & Duchon, D. (1988). Combining qualitative and quantitative methods information systems research: a case study. Management Information Systems Quarterly, 12(4), 571-586.
• Lee, A. S. (1989). A scientific methodology for MIS case studies. MIS Q., 13(1), 33-50.
• Markus, M. L. (1983). Power, politics, and MIS implementation. Commun. ACM, 26(6), 430-444.

As part of my doctorate work, I’ve been looking at many different research methodologies.  One of the more interesting qualitative methods is the use of the case study in information systems research.

While reviewing the case study, I found a few articles that discuss the use of the case study approach in the field of inforamtion systems and that i’d provide a brief review of each.

Over the coming weeks, I’ll be publishing reviews of the following articles:

• Cavaye, A. L. M. (1996). Case study research: A multi‐faceted research approach for IS. Information Systems Journal, 6, 227‐242.
• Lee, A. S. (1989). A Scientific Methodology for MIS Case Studies. MIS Quarterly, 13(1), 33‐50.
• Walsham, G. (1995). Interpretive case studies in IS research: Nature and method. European Journal of Information Systems, 4(2), 74‐82
• Darke, P., Shanks, G., & Broadbent, M. (1998). Successfully completing case study research: combining rigour, relevance and pragmatism. Information Systems Journal, 8(4), 273‐289.

My plan is to publish one review per week.  Check back later this week for the first article review.