Assessing the quality and reliability of videos on Tetralogy of Fallot: Youtube analysis
Poster #: 010
Session/Time: A
Author:
Himali M Patel, MS
Mentor:
Rose M Cummings, DO
Research Type: Digital Health Research
Abstract
INTRODUCTION:
Patients and families increasingly use online platforms to obtain information about unfamiliar medical diagnoses. YouTube has become a prominent source of health-related content. Given the complexity and variable clinical presentation of Tetralogy of Fallot, evaluating the accuracy of such publicly available information is critical. To date, no studies have assessed the quality, reliability, or engagement of YouTube videos addressing Tetralogy of Fallot. This study aims to systematically evaluate these videos using three validated scoring tools to determine their accuracy and reliability for patient education.
METHODS:
We conducted a Youtube analysis with the keywords: "Tetrology of Fallot, " on August 11, 2025 in Norfolk, VA. We selected the top 50 videos on YouTube for further analysis. YouTube shorts, identical videos, multipart videos, videos not in English, and videos that did not address the primary concern were excluded from the study. A total of 36 videos were included in this study. The quality and reliability of these videos were evaluated by two raters using the modified DISCERN (m-DISCERN) questionnaire, the Global Quality Scale (GQS), and JAMA benchmark by two raters, blind to one another. Other qualitative data was also obtained such as the type of video, video presenter, and target audience. Quantitative data regarding video interaction was also obtained from each video including the number of views, likes, and the duration of the video.
RESULTS:
A total of 36 eligible YouTube videos on Tetralogy of Fallot were included in the analysis. The videos had a mean view count of approximately 156,910 views, with 14 of them having over 100,000 views. The average video duration was 8 minutes and 48 seconds with the mean number of likes being 1884. The majority of these videos were targeted directly towards patients and families (20 videos). Inter-rater reliability analysis demonstrated no significant differences between evaluators across the scoring tools. The mean (±SD) GQS (scale 1-5) was 2.94 ± 0.97, mean m-DISCERN score (scale of 0-5) was 2.36 ± 0.84, and the mean JAMA score (scale 0-4) was 2.07 ± 0.74.
CONCLUSION:
YouTube videos on Tetralogy of Fallot demonstrate low overall quality, reliability, and transparency when evaluated using standardized assessment tools. Given the increasing reliance of patients and families on online resources for health information, these findings highlight the need for more accurate, high-quality educational content on Tetralogy of Fallot.
Patients and families increasingly use online platforms to obtain information about unfamiliar medical diagnoses. YouTube has become a prominent source of health-related content. Given the complexity and variable clinical presentation of Tetralogy of Fallot, evaluating the accuracy of such publicly available information is critical. To date, no studies have assessed the quality, reliability, or engagement of YouTube videos addressing Tetralogy of Fallot. This study aims to systematically evaluate these videos using three validated scoring tools to determine their accuracy and reliability for patient education.
METHODS:
We conducted a Youtube analysis with the keywords: "Tetrology of Fallot, " on August 11, 2025 in Norfolk, VA. We selected the top 50 videos on YouTube for further analysis. YouTube shorts, identical videos, multipart videos, videos not in English, and videos that did not address the primary concern were excluded from the study. A total of 36 videos were included in this study. The quality and reliability of these videos were evaluated by two raters using the modified DISCERN (m-DISCERN) questionnaire, the Global Quality Scale (GQS), and JAMA benchmark by two raters, blind to one another. Other qualitative data was also obtained such as the type of video, video presenter, and target audience. Quantitative data regarding video interaction was also obtained from each video including the number of views, likes, and the duration of the video.
RESULTS:
A total of 36 eligible YouTube videos on Tetralogy of Fallot were included in the analysis. The videos had a mean view count of approximately 156,910 views, with 14 of them having over 100,000 views. The average video duration was 8 minutes and 48 seconds with the mean number of likes being 1884. The majority of these videos were targeted directly towards patients and families (20 videos). Inter-rater reliability analysis demonstrated no significant differences between evaluators across the scoring tools. The mean (±SD) GQS (scale 1-5) was 2.94 ± 0.97, mean m-DISCERN score (scale of 0-5) was 2.36 ± 0.84, and the mean JAMA score (scale 0-4) was 2.07 ± 0.74.
CONCLUSION:
YouTube videos on Tetralogy of Fallot demonstrate low overall quality, reliability, and transparency when evaluated using standardized assessment tools. Given the increasing reliance of patients and families on online resources for health information, these findings highlight the need for more accurate, high-quality educational content on Tetralogy of Fallot.