Facial aesthetic outcome analysis in unilateral cleft lip and palate surgery using web-based extended panel assessment.
BACKGROUND AND AIM
The reproducible measurement of aesthetic outcomes after cleft lip and palate (CLP) surgery remains elusive, and there is no internationally recognised system. The aim of this pilot study was to better understand how humans rate post-operative aesthetic outcome after unilateral cleft lip and palate (UCLP) repair using a novel web-based rating platform with an extended panel of surgeon raters.


METHODS
Cropped images of 5-year-old UCLP patients were arranged in a randomly generated sequence within a web-based aesthetic scoring tool as part of an agreement/reliability study. Assessors rated the appearances of patients using a five-point Likert-type scale on two occasions. A mixed-effect statistical model was adopted to analyse the effects of rater, image and timing.


RESULTS
Images of 76 patients were scored by 29 UK-based cleft surgeons. Intra-rater variability was found, and the linear weighted kappa was 0.56. This allowed identification of the most and least consistent raters. The random image effect (p < 0.001) suggested that a broad range of aesthetic outcomes were included in the current study. Surgeon raters in this study were likely to score the images more preferably at the second assessment.


CONCLUSIONS
A web-based scoring system provides extended data capture, and mixed-effect statistical modelling reveals the effect that time, image and rater have on the scorings. The selection and training of raters, in combination with an exemplary yardstick, might improve inter- and intra-rater agreement. The development of objective measures based upon digital facial recognition can replace the highly variable subjective human influence on rating the aesthetic outcome.
['Bella|H|H|', 'Kornmann|N S S|NS|', 'Hardwicke|J T|JT|', 'Wallis|K L|KL|', 'Wearn|C|C|', 'Su|T-L|TL|', 'Richard|B M|BM|']
D002675:Child, Preschool D002971:Cleft Lip D002972:Cleft Palate D004954:Esthetics D006801:Humans D020407:Internet D008485:Medical Audit D017063:Outcome Assessment, Health Care D010865:Pilot Projects D019651:Reconstructive Surgical Procedures D015203:Reproducibility of Results D012189:Retrospective Studies D012984:Software D016896:Treatment Outcome
Aesthetic outcome Cleft lip Scoring system Random effects Web based