Inter- and Intrarater Agreement of CT Brain Calcification Scoring in Primary Familial Brain Calcification

Abstract

BACKGROUND AND PURPOSE: The total calcification score (TCS) is a visual rating scale to measure primary familial brain calcification (PFBC)–related calcification severity on CT. We investigated the inter- and intrarater agreement of a modified TCS. MATERIALS AND METHODS: Patients aged $18 years with PFBC or Fahr syndrome who visited the outpatient clinic of a Dutch academic hospital were included. The TCS was modified, for example, by adding hippocampal calcification, and ranged from 0 to 95 points. Fifteen raters evaluated all CTs, of whom 3 evaluated the CTs twice. Their entrustable professional activity (EPA) level ranged from II (medical student) to V (neuroradiologist). Agreement was assessed by using the intraclass correlation coefficient (ICC) for the total score. Kendall’s W and weighted Cohen k were used to determine the inter- and intrarater agreement for individual locations, respectively. RESULTS: Forty patients were included (mean age 60 years, 53% women). The median modified TCS was 34 (range 4–76). For all EPA levels, the interrater agreement of the modified TCS was excellent (ICC ¼ 0.97 [95% CI 0.95–0.98]). The Kendall W values were good to excellent for commonly affected locations, but poor to moderate for less commonly affected locations for raters with lower levels of expertise. The intrarater agreement of the modified TCS was excellent. The Cohen k of most locations were substantial to almost perfect. CONCLUSIONS: The modified TCS can be used with excellent reproducibility of the overall amount of brain calcifications and with limited training, although for some individual calcification locations more expertise is needed.