Validation of a Novel Cutaneous Neoplasm Diagnostic Self-Efficacy Instrument (CNDSEI) for Evaluating User-Perceived Confidence With Dermoscopy

Kelly C. Nelson; Ashley E. Brown; Amanda Herrmann; Chloe Dorsey; Julie M.  Simon; Janice M. Wilson; Stephanie A. Savory; Lauren E. Haydu

doi:10.5826/dpc.1004a88

Validation of a Novel Cutaneous Neoplasm Diagnostic Self-Efficacy Instrument (CNDSEI) for Evaluating User-Perceived Confidence With Dermoscopy

Authors

Kelly C. Nelson Department of Dermatology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
Ashley E. Brown McGovern Medical School, The University of Texas Health Science Center at Houston, Houston, TX, USA
Amanda Herrmann Department of Pathology, The University of Texas Health Science Center at Houston, Houston, TX, USA
Chloe Dorsey Department of Surgical Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
Julie M. Simon Department of Surgical Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
Janice M. Wilson Department of Dermatology, The University of Texas Medical Branch, Galveston, TX, USA
Stephanie A. Savory Department of Dermatology, The University of Texas Southwestern Medical Center, Dallas, TX, USA
Lauren E. Haydu Department of Dermatology, The University of Texas Medical Branch, Galveston, TX, USA

Keywords:

dermoscopy, construct validation, early detection, melanoma, dermatology education, self-efficacy, validation study, medical image interpretation

Abstract

Background: Accurate medical image interpretation is an essential proficiency for multiple medical specialties, including dermatologists and primary care providers. A dermatoscope, a ×10-×20 magnifying lens paired with a light source, enables enhanced visualization of skin cancer structures beyond standard visual inspection. Skilled interpretation of dermoscopic images improves diagnostic accuracy for skin cancer.

Objectives: Design and validation of Cutaneous Neoplasm Diagnostic Self-Efficacy Instrument (CNDSEI)—a new tool to assess dermatology residents’ confidence in dermoscopic diagnosis of skin tumors.

Methods: In the 2018-2019 academic year, the authors administered the CNDSEI and the Long Dermoscopy Assessment (LDA), to measure dermoscopic image interpretation accuracy, to residents in 9 dermatology residency programs prior to dermoscopy educational intervention exposure. The authors conducted CNDSEI item analysis with inspection of response distribution histograms, assessed internal reliability using Cronbach’s coefficient alpha (α) and construct validity by comparing baseline CNDSEI and LDA results for corresponding lesions with one-way analysis of variance (ANOVA).

Results: At baseline, residents respectively demonstrated significantly higher and lower CNDSEI scores for correctly and incorrectly diagnosed lesions on the LDA (P = 0.001). The internal consistency reliability of CNDSEI responses for the majority (13/15) of the lesion types was excellent (α ≥ 0.9) or good (0.8≥ α <0.9).

Conclusions: The CNDSEI pilot established that the tool reliably measures user dermoscopic image interpretation confidence and that self-efficacy correlates with diagnostic accuracy. Precise alignment of medical image diagnostic performance and the self-efficacy instrument content offers opportunity for construct validation of novel medical image interpretation self-efficacy instruments.

References

Ferrante di Ruffano L, Takwoingi Y, Dinnes J, et al. Computer-assisted diagnosis techniques (dermoscopy and spectroscopy-based) for diagnosing skin cancer in adults. Cochrane Database Syst Rev. 2018;12:CD013186. DOI: 10.1002/14651858.CD013186. PMID: 30521691.

Dinnes J, Deeks JJ, Grainge MJ, et al. Visual inspection for diagnosing cutaneous melanoma in adults. Cochrane Database Syst Rev. 2018;12:CD013194. DOI: 10.1002/14651858.CD013194. PMID: 30521684.

Patel P, Khanna S, McLellan B, Krishnamurthy K. The need for improved dermoscopy training in residency: a survey of US dermatology residents and program directors. Dermatol Pract Concept. 2017;7(2):17-22. DOI: 10.5826/dpc.0702a03. PMID: 28515987.

Chen YA, Rill J, Seiverling EV. Analysis of dermoscopy teaching modalities in United States dermatology residency programs. Dermatol Pract Concept. 2017;7(3):38-43. DOI: 10.5826/dpc.070308. PMID: 29085718.

Project ECHO: Early Melanoma Diagnosis. Accessed August 14, 2019. https://www.mdanderson.org/education-training/global-outreach/project-echo/programs/early-melanoma-diagnosis.html

Artino AR Jr, La Rochelle JS, Dezee KJ, Gehlbach H. Developing questionnaires for educational research: AMEE Guide No. 87. Med Teach. 2014;36(6):463-74. DOI: 10.3109/0142159X.2014.889814. PMID: 24661014.

Gondim Teixeira PA, Cendre R, Hossu G, et al. Radiology resident MR and CT image analysis skill assessment using an interactive volumetric simulation tool—the RadioLOG project. Eur Radiol. 2017;27(2):878-887. DOI: 10.1007/s00330-016-4384-5. PMID: 27165134.

Seagull FJ, Bailey JE, Trout A, Cohan RH, Lypson ML. Residents' ability to interpret radiology images: development and improvement of an assessment tool. Acad Radiol. 2014;21(7):909-15. DOI: 10.1016/j.acra.2014.03.010. PMID:24928160.

Burrell AMG, Allan JL, Williams DM, Johnston M. What do self-efficacy items measure? Examining the discriminant content validity of self-efficacy items. Br J Health Psychol. 2018;23(3):597-611. DOI: 10.1111/bjhp.12306. PMID:29520897.

Bandura A. Guide for constructing self-efficacy scales. In: Pajares F, Urdan T, eds. Self-Efficacy Beliefs of Adolescents. Information Age Publishing, Inc.; 2006:307-337.