Subjective Evaluation Data Research Articles

Treating fuzziness in subjective evaluation data

This paper proposes a technique to deal with fuzziness in subjective evaluation data, and applies it to principal component analysis and correspondence analysis. In the existing method, or techniques developed directly from it, fuzzy sets are defined from some standpoint on a data space, and the fuzzy parameters of the statistical model are identified with linear programming or the method of least squares. In this paper, we try to map the variation in evaluation data into the parameter space while preserving information as much as possible, and thereby define fuzzy sets in the parameter space. Clearly, it is possible to use the obtained fuzzy model to derive things like the principal component scores from the extension principle. However, with a fuzzy model which uses the extension principle, the possibility distribution spreads out as the explanatory variable values increase. This does not necessarily make sense for subjective evaluations, such as a 5-level evaluation, for instance. Instead of doing so, we propose a method for explicitly expressing the vagueness of evaluation, using certain quantities related to the eigenvalues of a matrix which specifies the fuzzy parameter spread. As a numerical example, we present an analysis of subjective evaluation data on local environments.

Effectiveness of the Tier 1 Program of the Project P.A.T.H.S.: Preliminary Objective and Subjective Outcome Evaluation Findings

There are two tiers of programs in the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes). In the Tier 1 Program, teaching units based on different positive youth development constructs are covered. Pre- and post-test data utilizing the Chinese Positive Youth Development Scale (CPYDS) and post-test subjective outcome evaluation data were collected from 546 students who participated in the 20h Tier 1 Program of the P.A.T.H.S. Project. Results showed that high proportions of the respondents had positive perceptions of the program and the instructors, with 85.3% of the respondents regarding the program as helpful to them. Positive changes in the program participants in many measures of positive youth development were also observed. Although there were some increases in problem behavior in some areas, adolescent problem behavior was generally stable. The present study provides preliminary support for the effectiveness of the Tier 1 Program of the Project P.A.T.H.S. in Hong Kong.

차량의 흡기부밍소음 평가지수 개발

In this paper, an index for the evaluation of vehicle intake booming noise is developed through a correlation analysis of objective measurement data and subjective evaluation data. First, intake orifice noise is measured at the wide-open test condition. And then, acoustic transfer function between intake orifice noise and interior noise at the steady state condition is estimated. Simultaneously, subjective evaluation was carried out with a ten-scale score by 8 engineers. Next, the correlation analysis between the psycho-acoustic parameters derived from the measured data and the subjective evaluation is performed. The most critical factor was determined and the corresponding index for the intake booming noise is obtained from the multiple factor regression method. At last, the effectiveness of the proposed index is validated.

自動車の音質評価データべースの作成(Part I 乗り物の音色・音質改善技術,特別オーガナイズドセッション「音色・音質設計技術〜開発者と利用者・第三者を繋ぐ」,振動・騒音改善技術)

This paper describes a large-scale automotive sound quality evaluation database created by the JSAE Sound Quality Evaluation Research Technical Committee. This database was created by conducting subjective evaluation tests under controlled conditions and using common procedures. It involves the subjective evaluation data for the interior sounds of accelerating gasoline passenger cars by 101 Japanese test subjects, and for the exterior sounds of diesel trucks at idle by 143 Japanese test subjects. Moreover, the subjects' profiles data (gender, age, sound quality specialists, and so on) are included. We can carry out various analyses on automotive sound quality and some effective results for improvements of sound quality can be obtained by using this database.

A methodology for supporting research and scholarship

The Office for Nursing Research and Scholarship was established in the spring of 1999 in a school of nursing on a large health sciences campus. In the first 2 years of operation, 11 federal grants were developed and submitted; 5 are currently funded, 3 have received competitive priority scores, 2 are in revision, and 1 awaits review. Intramural and private funding and preparation of manuscripts for publication have noticeably increased during this interval. Objective and subjective evaluation data from users are encouraging and provide a means for continuous formative evaluation and improvement. Recently, we conducted a systematic assessment of our office, focusing on service use, successful aspects, and organization. Through the assessment, we identified a methodology for organization and the essential elements needed to support successful research and scholarship. This article describes the essential services and how they are interrelated and delivered and how we structure staff responsibilities to facilitate delivery.

Representation of the subjective evaluation of the fabric hand using fuzzy techniques

This article presents a fuzzy logic–based method for representing and analyzing results of subjective evaluation on the fabric hand given by experts in fashion or quality inspection. This method permits the generation of a quantitative criterion characterizing the quality of textile products and modeling relationships between the subjective fabric hand evaluation and objective numerical data measured on the Kawabata evaluation system (KES). © 2003 Wiley Periodicals, Inc.

感性評価データの主成分分析に関する考察

対象を直感的に評価することによって得られたいわゆる感性データに対するファジィ主成分分析について、既存の方法とは異なる2つのアプローチを検討する。 1つはデータ自身のファジィ化、もう1つは荷重パラメータのファジィ化である。 ともに評価者間の評価の違いをある意味で保存しつつ、評価におけるあいまい性を反映した主成分得点をファジィ数で表現しようとするものである。前者は評価した対象を評価のあいまい性を考慮して分析するためのものであり、後背は新たに得られたクリスプな評価データからファジィ主成分得点を予測するためのものである。数値例として、地域環境の感性評価データの分析例を紹介する。

What makes an automated teller machine usable by blind users?

Fifteen blind and sighted subjects, who featured as a control group for acceptance, were asked for their requirements for automated teller machines (ATMs). Both groups also tested the usability of a partially operational ATM mock-up. This machine was based on an existing cash dispenser, providing natural speech output, different function menus and different key arrangements. Performance and subjective evaluation data of blind and sighted subjects were collected. All blind subjects were able to operate the ATM successfully. The implemented speech output was the main usability factor for them. The different interface designs did not significantly affect performance and subjective evaluation. Nevertheless, design recommendations can be derived from the requirement assessment. The sighted subjects were rather open for design modifications, especially the implementation of speech output. However, there was also a mismatch of the requirements of the two subject groups, mainly concerning the key arrangement.

Rationality in the mind's eye: An alternative test of rational expectations using subjective forecast and evaluation data

The purpose of this paper is to examine if business managers' forecasts are rational in a constructionist sense. Adherents to constructivism believe that human senses do not convey “real reality”, but rather a set of experiences that are conditioned by beliefs and differences in innate cognitive attributes to yield a constructed and inherently subjective perception. We examine whether managers' forecasts, when measured against their own perceptions of reality, are rational. The Conference Board provides a data base that asks managers for a subjective prediction of the future, and a subjective evaluation of the past. Both the forecast and the evaluation are subjective, conceived in the mind of the forecaster. If rational expectations is a theory that accurately represents the decision process, then it should be reflected in data where the forecaster computes not only the prediction, but also the value of the parameter that was predicted. Thus, this data allows forecasts to be tested for rationality using managers' own perceptions as the basis for judgement. If rational expectations is an accurate representation of how economic actors form forecasts, then a mind's eye evaluation should show evidence of this rationality. Yet, though the managers generate both the forecast and the evaluation, they failed four of the five traditional tests for rationality.

Tissue Softness Evaluation by Mechanical Stylus Scanning

A mechanical stylus surface analyzer (MSSA) system and the corresponding software were used to conduct standard surface analysis procedures. The MSSA instrumentation measures surface characteristics of soft bathroom tissue products. This paper describes the applicability of MSSA and how human tactile response may be modeled through characterization of surfaces. The concepts of passive and active touch as related to human perceived softness are reviewed. In particular, parameters pertinent to these kinds of tactile exploration are mentioned, as well as how they can be used to build a better model of human tactile response. A novel frequency analysis parameter called the frequency index for tactile sensitivity (FITS) is based on tissue paper surface analysis results from MSSA and provides the basis for the human response model. Included is a review of subjective human softness evaluation data for select tissues gathered to represent actual human responses. The MSSA and optical image analysis (OIA) data were collected on the same tissues, and the FITS parameter was found using MSSA. Also, MSSA data were used to reproduce an old standard parameter for evaluating tissue softness called the human tactile response (HTR) index. Since it is not possible to exactly reproduce HTR, the reproduced parameter calculated in this study is called HTR equivalent (HTR_EQ). Finally, standard deviation of luminance (SDL) and loosely bonded surface fibers (LBSF) parameters are determined for select tissues using OIA. Correlation results of the human data with FITS, HTR—EQ, SDL, and LBSF are discussed; FITS correlates best with the human response data and, together MSSA and FITS, has the ability to model human response to the softness of tissue paper products.

Treatment of Chronic Tension‐type Headache With Hypnotherapy: A Single‐blind Time Controlled Study

We investigated the effectiveness of a special hypnotherapy technique in the treatment of chronic tension-type headache. A waitinglist control group was used to control for the changes in headache activity due to the passage of time. The results showed significant reductions in the number of headache days (p less than 0.05), the number of headache hours (p less than 0.05) and headache intensity (p less than 0.05). The improvement was confirmed by the subjective evaluation data gathered with the use of a questionnaire and by a significant reduction in anxiety scores (p less than 0.01).

A study on subjective evaluations of printed color images

Fuzzy measures and fuzzy integrals are applied to build an evaluation model of printed color images. First, subjective evaluation data of seven people are collected by pairwise comparisons. The subjects give 16 kinds of evaluations for each color proof. Then a two-layer evaluation model is proposed based on the result of factor analysis. In this study, the authors adopt Choquet's integral as a form of fuzzy integral because it has good properties compared with other forms of fuzzy integrals. A relaxation-method-like procedure has been devised to identify fuzzy measures of the two-layer model. After its effectiveness is confirmed with artificial data, the algorithm is applied to actual subjective evaluation data. This gives us results, revealing that the seven subjects are divided into two groups whose evaluation characteristics are structurally different from each other.

Correlations between harmonic distortion, sound field characteristics and reproduced sound quality change in listening tests for loudspeakers.

This paper examines whether or not distortion actually has an effect on perceived sound quality when the amount of harmonic distortion caused by a loudspeaker is near the previously reported threshold values of 2 to 10%. For this evaluation, three physical measurements and two listening tests are performed with full-range cone and horn loudspeaker types. According to correlation analysis between the two domain measurements, the total harmonics of 0.6 to 3% are in close correlation to the subjective evaluation data. As a result, the aural detection threshold for harmonic distortion is assumed to be much lower than the previously reported values. Additionally, it appears that most of the difference in sound quality can be explained by three physical characteristics; harmonic distortion, partial-space-power frequency response and dispersion index.

An experimental study on membership functions in a fuzzy reliability analysis of structures.

It is obvious that not only statistical data, but also human subjective judgments play an important role in determinig the reliability index of a structure. For this reason the author previously proposed a reliability analysis method in which subjective values were treated in the calculation using the concept of a fuzzy set. In this paper, the experimental relation between the subjective evaluation data and objective data is discussed. Carbon fracture test pieces were prepared, whose surface roughness were varied continuously. And their strength were precedently evaluated in liguistic expressions, then 4-point bend tests were conducted. Using the subjective evaluation data, the membership function of the surface roughness was determined, and then the membership function of the strength was presumed by comparing the membership function and the statistical data on the strength. Finally the relationship between two membership functions were argued. This result can be applied to obtain a fuzzy reliability index.

The Structure of Information in Online and Paper Technical Manuals

An experiment was conducted to compare online computer manuals to paper manuals. For each type of manual there were two different database structures – a linear (sequential) structure and a tree structure. The results showed that people using the paper manuals were faster at performing a switch setting task based on information in the manual than were people using the online manuals. No significant differences were found in speed of performance between the linear and tree structures. Nor were there any differences in the number of correct switch settings for the different types of manuals. The subjective evaluation data revealed that the online manuals were rated as better and judged to be more organized than the paper manuals.

Interview training with adolescents—A controlled group study incorporating generalization and social validation

Ten school-leavers were allocated either to an interview-training group (E) or a discussion control group (C) for three sessions. For E group a combination of modelling, coaching, roleplay, feedback and discussion was used to train both verbal and non-verbal interview skills. An attempt was made to programme generalization of treatment effect into training and subjective evaluations of interview skill were made by an experienced Personnel Officer to assess the social importance of the skills trained. After C group had completed three sessions to control for the non-specific effects of being in therapy, they received the same training as E group. Subjects were assessed using videotaped roleplayed interviews at the beginning and end of each training phase. After training E group showed significant improvements on both global and specific ratings of interview skill compared to C group; there was evidence of generalization and maintenance of treatment effect and the social importance of the skills trained was substantiated by the subjective evaluation data. C group then went on to replicate the changes in E group.