Towards a new framework for evaluating systemic problem structuring methods

Midgley, Gerald, Cavana, Robert Y., Brocklesby, John, Foote, Jeff L., Wood, David R. R. and Ahuriri-Driscoll, Annabel (2013) Towards a new framework for evaluating systemic problem structuring methods. European Journal of Operational Research, 229 1: 143-154. doi:10.1016/j.ejor.2013.01.047

Author Midgley, Gerald
Cavana, Robert Y.
Brocklesby, John
Foote, Jeff L.
Wood, David R. R.
Ahuriri-Driscoll, Annabel
Title Towards a new framework for evaluating systemic problem structuring methods
Journal name European Journal of Operational Research   Check publisher's open access policy
ISSN 0377-2217
Publication date 2013-08-16
Sub-type Article (original research)
DOI 10.1016/j.ejor.2013.01.047
Volume 229
Issue 1
Start page 143
End page 154
Total pages 12
Place of publication Netherlands
Publisher Elsevier North-Holland
Collection year 2014
Language eng
Formatted abstract
Operational researchers and social scientists often make significant claims for the value of systemic problem structuring and other participative methods. However, when they present evidence to support these claims, it is usually based on single case studies of intervention. There have been very few attempts at evaluating across methods and across interventions undertaken by different people. This is because, in any local intervention, contextual factors, the skills of the researcher and the purposes being pursued by stakeholders affect the perceived success or failure of a method. The use of standard criteria for comparing methods is therefore made problematic by the need to consider what is unique in each intervention. So, is it possible to develop a single evaluation approach that can support both locally meaningful evaluations and longer-term comparisons between methods? This paper outlines a methodological framework for the evaluation of systemic problem structuring methods that seeks to do just this.

Highlights ► Provides a new evaluation framework for systemic problem structuring methods. ► Integrates case study and comparative evaluation approaches. ► Provides a questionnaire for practitioners to use in the context of the framework.
Keyword Problem structuring methods
Soft operational research
Evaluation of methods
Participative methods
Systems methodology
Systems thinking
Assessing public-participation
Group decision-making
Devils advocacy
Q-Index Code C1
Q-Index Status Confirmed Code
Institutional Status UQ

Document type: Journal Article
Sub-type: Article (original research)
Collections: School of Agriculture and Food Sciences
Official 2014 Collection
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 17 times in Thomson Reuters Web of Science Article | Citations
Scopus Citation Count Cited 16 times in Scopus Article | Citations
Google Scholar Search Google Scholar
Created: Sun, 16 Jun 2013, 00:14:31 EST by System User on behalf of School of Agriculture and Food Sciences