Testing and evaluating the applicability and effectiveness of the new idea-configuration-evaluation (ICE) method of conceptual design

Abstract

In a previous paper, we introduced the process of developing a new prescriptive method for conceptual engineering design called ICE (idea-configuration-evaluation), and demonstrated its application in detail. The new design model is based on the well-established theoretical foundation of C–K theory and the empirically derived parameter analysis method. In this paper, we describe the testing and evaluation of the model’s formulation through a design experiment that examines the performance of external participants when applying it. Two categories of evaluation metrics are used: applicability and effectiveness of the method. Nine quantitative and qualitative metrics describe aspects such as the ease of teaching and using the design procedure, and its support of creativity and innovation. The experiment took place in an academic environment and the results were obtained by analyzing detailed written design reports, assessing characteristics of the final solutions, and examining replies to reflective questionnaires. The conclusions from the study are that the ICE model presents a clear and concise step-by-step procedure, is conducive to teaching and practicing design, captures the dynamics and rationale of the conceptual design process, and can therefore lead to viable and innovative conceptual designs. Another, general contribution of the paper is in delineating the application of a plurality of measures in a non-comparative assessment of a design method.