Interobserver agreement of digital dermatitis M-scores for photographs of the hind feet of standing dairy cattle

Abstract

Digital dermatitis (DD) is the leading infectious cause of lameness in dairy cattle, and it affects their welfare and productivity worldwide. At the herd level, DD is often assessed while cows are standing in a milking parlor, and lesions are most commonly evaluated using the M-score. The objective of this study was to examine the interobserver agreement for M-scores of the feet of standing cattle, based on digital color photographs of dairy cattle hind feet. A total of 88 photographs and written descriptors of the M-score were sent to 11 scorers working at 10 different institutions in 5 countries. The scorers received no formal training immediately before scoring the photographs; however, all regularly used the M-score to score DD. The answers for 36 photographs were excluded from the analysis because the photograph either had more than 1 M-stage as mode or not all scorers assigned an M-score to it. The M-scores of the 11 scorers from 52 photographs were available for analysis. Interobserver agreement was tested using Gwet's agreement coefficient (AC1) and the mode was assumed correct. Overall, moderate agreement emerged for the M-score (AC1 = 0.48). For the individual M-stages, almost perfect agreement existed for M0 (AC1 = 0.99), M1 (AC1 = 0.92), and M3 (AC1 = 0.82), and substantial agreement for M2 (AC1 = 0.61), M4 (AC1 = 0.65), and M4.1 (AC1 = 0.71). This outcome indicates the degree of individual variation in M-scoring in this context by unstandardized, experienced European observers, particularly for the M2, M4, and M4.1 stages. Standardized training is likely to improve the consistency of M-scoring and thus the generalizability of future DD research results on this important endemic disease.