Development and validation of a standard area diagram set to aid assessment of severity of loquat scab on fruit

Abstract

A standard area diagram set (SAD) to aid visual assessment of loquat scab (caused by Fusicladium eriobotryae) severity on fruit was developed and evaluated for improving accuracy, precision and reliability of visual estimates. The SAD set contains eight black and white diagrams of diseased fruit with severity values from 2 % to 98 %. To evaluate the SADs, a group of 20 raters (comprising 10 ‘experienced’ and 10 ‘inexperienced’ raters) assessed the same set of 50 images three times, the first without SADs and the second and third using the SADs as an aid. Only for the group of inexperienced raters did SADs significantly improve accuracy (bias correction factor, C b = 0.93 without SADs and 0.98 with SADs), precision (correlation coefficient, r = 0.88 without SADs and r = 0.96 with SADs) and overall agreement (Lin’s concordance correlation coefficient, ρ c = 0.82 without SADs and ρc with SADs = 0.95) of the estimates. Accuracy and precision of the estimates by inexperienced raters were significantly higher than those obtained by the experienced raters, especially for the second assessment with SADs. Inter-rater reliability was improved when SADs were used by inexperienced raters, whereas a high degree of intra-rater reliability was obtained by both experienced and inexperienced raters when using SADs. The SADs developed in this study were useful for obtaining more accurate, precise and reliable assessments of loquat scab for inexperienced raters, and should be used as an aid for assessing scab in epidemiological studies or monitoring for decision-making purposes.