Direct Rating Method Research Articles

Exploring the Effectiveness of Evaluation Practices for Computer-Generated Nonverbal Behaviour

This paper compares three methods for evaluating computer-generated motion behaviour for animated characters: two commonly used direct rating methods and a newly designed questionnaire. The questionnaire is specifically designed to measure the human-likeness, appropriateness, and intelligibility of the generated motion. Furthermore, this study investigates the suitability of these evaluation tools for assessing subtle forms of human behaviour, such as the subdued motion cues shown when listening to someone. This paper reports six user studies, namely studies that directly rate the appropriateness and human-likeness of a computer character’s motion, along with studies that instead rely on a questionnaire to measure the quality of the motion. As test data, we used the motion generated by two generative models and recorded human gestures, which served as a gold standard. Our findings indicate that when evaluating gesturing motion, the direct rating of human-likeness and appropriateness is to be preferred over a questionnaire. However, when assessing the subtle motion of a computer character, even the direct rating method yields less conclusive results. Despite demonstrating high internal consistency, our questionnaire proves to be less sensitive than directly rating the quality of the motion. The results provide insights into the evaluation of human motion behaviour and highlight the complexities involved in capturing subtle nuances in nonverbal communication. These findings have implications for the development and improvement of motion generation models and can guide researchers in selecting appropriate evaluation methodologies for specific aspects of human behaviour.

Fermatean Fuzzy Group Decision-Making Based CODAS Approach for Taxation of Public Transit Investments

The provision of public goods is always a controversial issue in many aspects. Even some additional financial resources can provide public transit systems, the tax revenues constitute a significant part of the investments in practice. Yet, governments should make an important decision regarding tax schemes. This article focuses on how to identify the best tax scheme to finance public transit investments. A three-phase Fermatean fuzzy group decision-making approach is developed to solve the highlighted problem. Qualifications and experience of experts are considered to distinct their reputations. A Fermatean fuzzy direct rating method is introduced to evaluate criteria importance. A Fermatean fuzzy combinative distance-based assessment method is formulated to assess tax schemes. The study provides valuable policy implications and decision-making guidelines using a real-life case. The results show that beneficiaries of public services should pay more, and tax collectors are encouraged to use progressive tax schemes instead of the equal distribution of the cost to the taxpayers. The sensitivity analysis to changes in the threshold parameter is given. The comparative analysis with all state-of-the-art Fermatean fuzzy set based multicriteria decision-making methods is provided. The Fermatean fuzzy group decision-making approach is highly robust and reliable. The approach can solve other public transportation problems.

Using the OKR Method and Fuzzy Logic to Determine the Level of Sustainability in Restaurants

Restaurants are one of the main sources of wealth in the tourism sector and have significant potential in the fight against poverty reduction and the lack of development of local communities. However, in relation to the emission of greenhouse gases and the generation of waste, they are seen as two of the less sustainable sectors of the world. This study has the objective of providing a method to determine the level of sustainability in restaurants by means of modeling the OKR method and fuzzy logic. For this, 100 key results from the environmental, social, and economic dimensions were selected, using the fuzzy direct rating method to validate and weight the key results. The method is shown in advance, noting how and at what intensity the key results are inserted in the restaurant, indicating the strong and weak points of each restaurant in regard to sustainability. The results of this study contribute by providing a method that measures the level of sustainability in restaurants, identifies the current panorama and existing challenges, and allows for a complete mapping for the elaboration of strategies for improvements in organizational sustainability.

Efektivitas Sign System dan Intensitas Informasi Petunjuk Arah sebagai Media Komunikasi Visual Kota Lama Semarang

The city of Semarang has excellent tourist destinations and its own characteristics that become its strengths, namely the Old City History Tour which utilizes buildings from the Dutch colonial era in Semarang City. To support Semarang City tourism known by tourists, an effective and communicative information media is needed so that visitors know the identity of an object, signs and directions to the next destination, one of which is the use of a media sign system. This study aims to examine how effective the use of the sign system and the intensity of information instructions that have been applied to tourist areas around the Kota Lama Semarang are by using the Direct Rating Method (DRM), through a quantitative research method approach. The variables used are the effectiveness of the sign system, the intensity of directions and visual communication media. The results of the research that were processed by 100 respondents were that there was no relationship between the effectiveness of the sign system and information on directions in the Kota Lama Semarang, there was no relationship between the effectiveness of the sign system and the visual communication media in the Kota Lama Semarang, there was no relationship between the information instructions directions with visual communication media in the Kota Lama Semarang. These three results mean that the three variables are not related to each other, this could be because the sign system in the Old City of Semarang is not functioning as it should, because it should be a sign system that can provide good information to visitors and have attractive visuals. , but in reality this is not the case, namely that the sign system in the city of Semarang does not or does not provide information to visitors and also the sign system does not have good visuals so that it is less able to attract visitors in the Kota Lama Semarang.

EFEKTIVITAS IKLAN TERHADAP KEPUTUSAN WISATAWAN MEMBELI TIKET PESAWAT DI TRAVELOKA.COM

This research was conducted to analyze the Effectiveness of Advertising on Tourist Decisions in Purchasing Flight Ticket on the Online Travel Agent Traveloka.com using the EPIC Model and Direct Rating Method (DRM) and its Effect on the Flight Ticket Purchase Decision partially and simultaneously. This research method uses data collection techniques in the form of observation, questionnaires, and literature study. The technique of determining the sample using a purposive sampling method. The data analysis technique used quantitative descriptive analysis and multiple linear regression analysis. The results of this study indicate that Traveloka.com advertising using the EPIC Model method in measuring the advertising communication approach has been effective in introducing products in the form of flight tickets with a value of 4,008 and the Direct Rating Method in measuring good value advertising messages in conveying messages with a value of 79.44. EPIC Model's multiple linear regression analysis on Purchasing Decisions has a positive effect with a significant value of 0.015, the Direct Rating Method has a positive effect with a significant value of 0.003, while simultaneously or simultaneously, the Effectiveness of Advertising on Purchasing Decisions has a positive and significant effect. Based on the results obtained, the effectiveness of advertising can have an influence on purchasing decisions made by buyers through advertisements that contain information about existing products.

Peningkatan Kreativitas User dengan MS-Word dan Canofile dalam Manajemen Dokumen Surat Masal bagi Guru dan Santri Remaja TPQ Nurul Huda Sunter Muara, Jakarta Utara

ENHANCING USER CREATIVITY WITH MS-WORD AND CANOFILE IN THE MANAGEMENT OF MASS LETTER DOCUMENTS FOR TEENAGE TEACHERS AND SANTRI OF TPQ NURUL HUDA SUNTER MUARA, JAKARTA UTARA. The conditions that are seen today, many small agencies at this time so easily become worse because of data processing constraints that are not or have not yet adapted to technological advances resulting in very rapid setbacks, because they are unable to keep up with technological trends. even middle and upper agencies can experience the same thing that will experience a downturn. Thus the implementation of this community service provides solutions for small institutions such as TPQ Nurul Huda Sunter Muara to be able to adjust to wrestling about computer technology, especially in word and database Canofile applications. Starting from the results of the free test process, it was seen that on average many did not know it, after going through this training process with high enthusiasm and enthusiasm, participants were asked to return to fill in the instrumentation in the form of a questionnaire as a barometer post test and the results were processed using the Direct Rating Method, which is processed mathematically, by using five variables and ten indicator questions. The results obtained and processed using a combination of these two applications, given good results seen from the graphic display with an average weight is 4.61 and 76.93. Thus, through computer training activities which are bridged in the form of community service, it can be said that there is an increase in good learning outcomes, although there are still psychomotor variables that must be improved, so that these psychomotor variables require routine and continuous treatment.

Pelatihan Internet Pembuatan Blog bagi Guru-Guru HIMAPAUDI Kecamatan Kemayoran, Jakarta

INTERNET TRAINING OF BLOG MAKING FOR TEACHERS OF HIMAPAUDI OF KEMAYORAN DISTRICT, CENTRAL JAKARTA. In the current era of Digitization 4.0, all data and information must use technology based on a fully computerized system, where output is displayed and produced in electronic form. Thus the need for internet for HIMAPAUDI Teachers is in dire need and necessary for Internet training. Especially in the case of making BLOGs. Blog creation training using Blogspot by following the rules for making Blogs. Before the training process, the pretest test was conducted, the results of which were decidedly less than expected. After going through the training process, participants were asked to fill out instrumentation in the form of a questionnaire, and the results were processed using the direct rating method, method combined with pure mathematics, using five variables and 10 question indicators, it turns out the results obtained using a combination of these two methods give the predicate value very well and through the graphic line the results are scoring 87.27. Thus it can be said that there is an increase in learning outcomes through this training. Thus the training process can provide a significant improvement in the achievement of the progress of HIMAPAUDI teachers in the Kemayoran District, Central Jakarta.

ANALISIS EFEKTIVITAS IKLAN TELEVISI KOPI INSTAN TOP COFFEE ENDORSER ”IWAN FALS”

This study aims to measure the effectiveness of television advertising endorser Top Coffee "Iwan Fals". The method used Direct Rating Method (DRM) and EPIC. Type of this study is a survey. The objects are students of universities in Malang. The data collection technique is non-probability sampling with convenience sampling technique. Direct Rating Method (DRM) and the EPIC methods are analytical tools to measure the effectiveness of television advertising endorser Top Coffee "Iwan Fals". The result of Direct Rating Method indicates that ads endorser has a good category, and EPIC result shows that ads endorser is more effective. Based on the overall results from both analysis can be concluded that television advertising endorser Top Coffee "Iwan Fals" is good and effective. Keywords: Effectiveness, Direct Rating Method, Method EPIC

Comparison analysis for subjective and objective weights of financial positions of container shipping companies

This paper explores the positions of financial ratios identified utilizing both subjective and objective weighting methods—the consistent fuzzy preference relation (CFPR) and entropy—based on questionnaires collected from experts and the financial statements of major shipping companies in Taiwan and Korea. The comparison of perceptions of financial ratios by country and by expert group illuminates some financial aspects that experts may have ignored or not paid close attention to during the business operating process, especially in today’s turbulent world shipping market. The major results of this paper show that experts in the two countries have different perceptions of the debt-to-equity ratio and that by combining the results of objective and subjective weights, categorization of financial ratios by quadrant can help decision-makers find business options and strategies to improve the financial performance of their companies. This research approach may be applied to other business entities, improving on the direct rating method used in previous studies.

Development and evaluation of measurement tools for conceptual profiling of unbranded products

All objects including brands, products and packaging have conceptual (implicit) associations and consequently a conceptual profile. Along with its sensory profile this defines and characterises the object. Together these influence our attitudes, our affective reactions (feelings and pleasure) and our behaviour towards it. The conceptual content of a brand is usually clear and readily accessible via established brand personality measures. However, until recently, the conceptual content of product per se has received scant attention.The conceptual content of an unbranded product derives from two sources: the fundamental nature of the product category (‘category effect’) and within-category sensory differences amongst related products (‘sensory specific effect’). The latter leads to subtle variations in conceptual content that are important in the context of product optimisation but may be difficult to measure.Best–worst scaling (BWS) is an indirect method of scaling that has been found to be particularly useful for measurement of ‘soft’ or abstract attributes that are not easily quantified. It has been applied previously to conceptual profiling of brands and products. This study compares the utility of BWS versus a direct rating method (an online technique known as bullseye) for accessing the conceptual content of six unbranded orange juices. Degree of familiarisation with the research process and the juices (intensive familiarisation versus a simple warm-up) was added as a second variable, thereby creating four methodological cells to compare.Irrespective of familiarisation protocol, BWS proved to be more effective than bullseye in eliciting the ‘sensory specific effect’. However the biggest effect was associated with the familiarisation protocol, where intensive familiarisation engendered more effective discrimination amongst the juices than the simple warm-up, irrespective of scaling methodology. We conclude that intensive familiarisation is of great benefit to the conceptual profiling of unbranded products for product development.Within a product’s conceptual profile, BWS and bullseye discriminated amongst the conceptual terms to a similar degree. Previous studies have tended to find that BWS gives greater discrimination amongst the choice items than rating scales. We suggest that the nature of the choice items and the number of decisions required from participants both affect the relative discrimination of the two methods.

Analisa Efektivitas Komunikasi Pemasaran Produk Aqua Menggunakan Customer Response Index Melalui Kegiatan Promosi

Promotion is crystallization of a form of marketing communication, modern marketing communication should be able to communicate the brand or Its products to consumers in an integrated way, so consumers will know more about the benefits of the product. To find products that are marketed to consumers, certainly needs to be measured in evaluating how much the strength of the product is received by consumers. Many methods are used in determine level of effectiveness of communication conducted as Customer Decision Model (CDM), EPIC Model, Direct Rating Method (DRM), and Customer Response Index (CRI).Custormer Response Index (CRI) is one that often used in the measurement of the effectiveness of marketing communications products. Variables used to measure the effectiveness of marketing communication consists of five variables including Awareness, Comphrehend, Interest, Intention, and Action. In connection with the acquisition value is performed with CRI can be seen from the results of recent advertising campaigns through the media. If the CRI points earned exceeds 50% or more, then said to the effectiveness of marketing communications well worth it. For the research results through media advertisements broadcast television advertising products aqua value of marketing communications effectiveness gets 59% of acquisition value, this means that the measurement of the effectiveness of marketing communications products using the method Custormer Response Index (CRI) produces assessments that can be said to be good. With reference to the acquisition of data, can be seen how much the consumer is not how much consumer response and the response, it was said as a response index.

On measuring quantitative interpretations of reasonable doubt.

Beyond reasonable doubt represents a probability value that acts as the criterion for conviction in criminal trials. I introduce the membership function (MF) method as a new tool for measuring quantitative interpretations of reasonable doubt. Experiment 1 demonstrated that three different methods (i.e., direct rating, decision theory based, and MF) provided significantly different and uncorrelated interpretations of reasonable doubt, although all methods predicted verdicts equally well, and showed inter-individual variability in interpretations. In Experiment 2 only the direct rating method demonstrated a significant effect of judicial instructions on reasonable doubt. In both experiments, the MF method showed intra-individual variability in interpretations of reasonable doubt. The methods may be capturing different aspects of the concept of reasonable doubt. These findings have implications for the validity of past research findings on reasonable doubt and for the utility of triangulation of methods in future research.

Weight approximations in multi‐attribute decision models

AbstractThe use of surrogate weights based on rankings has been proposed as a method for avoiding difficulties associated with the elicitation of weights in multi‐attribute decision analysis. When the simple multiattribute rating technique using swings (SMARTS) method is being employed it has been suggested that rank order centroid (ROC) weights are the best surrogate weights to use. This study shows that ROC weights are appropriate to use as a substitute for original weights that are constrained to sum to a fixed total (usually 1 or 100) as used in the point allocation method. If, however, the original weights are determined without any initial restrictions, as in the direct rating method, and are then normalized, which is the common procedure in SMARTS analysis, then the ROC weights do not provide the best approximations to the original weights. This paper shows how to obtain rank order distribution (ROD) weights that provide a better approximation than the ROC approach to unrestricted original weights. The paper also shows that, as the number of attributes in a decision problem increases, the ROD weights approximate to the more easily calculated rank sum weights. Copyright © 2003 John Wiley & Sons, Ltd.

Testing the accuracy enhancement of pairwise comparisons by a Monte Carlo experiment

A statistical experiment was designed to check if the pairwise comparisons method, which was introduced by Fechner in 1860 and developed by Thurstone in 1927, really improves the accuracy of estimation of stimuli. The experiment has been designed and implemented to minimize statistical bias. The accuracy improvement by the pairwise comparisons method (when compared with the direct rating method) is decisive: the mean value of the improvement exceeds 500% and a 95% confidence interval is (4.657, 5.389).