J Intensive Care Med. 2021 Mar 10:885066621999979. doi: 10.1177/0885066621999979. Online ahead of print.
PURPOSE: Instructional videos of medical procedures can be a useful guide for learners, demonstrating proper and safe technique. Open publishing sites such as YouTube are readily accessible, however the content is not peer reviewed and quality of videos vary greatly. Our aim was to evaluate a learner's ability to interpret the quality of openly published content by comparing their rating of the most popular central line insertion videos on YouTube to expert evaluations.
METHOD: YouTube search results for "central line placement" sorted by views or relevance compiled a list of the four most common videos. A fifth gold standard video, published by the New England Journal, was included, however was not found in the top results. Eleven expert practitioners from varying medical specialties (Critical Care, Surgery, Anesthesia, & Emergency Medicine) evaluated the 5 videos, utilizing a 22-item Likert scaled questionnaire emphasizing: preparation, sterility, anatomy, technique, & complications. Videos were compared as a composite average of the individual items on the survey. The highest, lowest, and 3rd ranked videos were evaluated by 45 residents ("learners") in varying specialties (Internal Medicine, Emergency Medicine, Surgery, Anesthesia) and post graduate year (PGY). Learners assessed the videos using the same scale. A Welch T-test assessed statistical significance between the two groups. Subgroup analysis compared experts against different PGY and specialty cohorts.
RESULTS: The lowest scored video among the experts and learners was the most popular on YouTube, with 858,933 views at the time of inclusion. Though lowest in rank, this video was judged higher by learners than the experts (2.63/5 vs 2.18/5, P = 0.0029). The 3rd ranked video by experts with 249,746 views on YouTube, was also rated higher by learners (3.77/5 vs 3.45/5, P = 0.0084). The gold standard video by NEJM had 320,580 views and was rated highest by both the experts and learners (4.37/5 vs 4.28/5, P = 0.518). Subgroup analysis showed similar results with learners rating the videos overall better than experts, this was particularly true in the PGY-1 subgroup.
CONCLUSION: The most popular central line insertion video was the worst rated by both experts and learners. Learners rated all the videos better than the expert. YouTube videos demonstrating medical procedures including central line insertion should come from peer reviewed sources if they are to be incorporated into educational curriculum.