Predict your next investment

BUSINESS PRODUCTS & SERVICES | Consulting & Outsourcing / Management & Strategy Consulting
discernhealth.com

See what CB Insights has to offer

Stage

Acquired | Acquired

About Discern Health

Discern Health is a health economics and outcomes research (HEOR) consulting firm that provides strategic direction and policy solutions to life sciences companies, government and nonprofit agencies, and health insurers.On July 28, 2020, Discern Health was acquired by the W2O Group, terms of the transaction were not disclosed.

Discern Health Headquarter Location

1120 North Charles Street Suite 200

Baltimore, Maryland, 21201,

United States

410-542-4470

Latest Discern Health News

TikTok as a Health Information Source: Assessment of the Quality of Information in Diabetes-Related Videos

Sep 1, 2021

Journal of Medical Internet Research This paper is in the following e-collection/theme issue: May 13, 2021 TikTok as a Health Information Source: Assessment of the Quality of Information in Diabetes-Related Videos Authors of this article: 2School of Information Management, Nanjing University, Nanjing, China 3School of Economics and Management, Nanjing University of Science and Technology, Nanjing, China 4Nanjing Jiangning Maternal and Child Health and Family Planning Service Center, Nanjing, China *these authors contributed equally Abstract Background: Diabetes has become one of the most prevalent chronic diseases, and many people living with diabetes use social media to seek health information. Recently, an emerging social media app, TikTok, has received much interest owing to its popularity among general health consumers. We notice that there are many videos about diabetes on TikTok. However, it remains unclear whether the information in these videos is of satisfactory quality. Objective: This study aimed to assess the quality of the information in diabetes-related videos on TikTok. Methods: We collected a sample of 199 diabetes-related videos in Chinese. The basic information presented in the videos was coded and analyzed. First, we identified the source of each video. Next, 2 independent raters assessed each video in terms of the completeness of six types of content (the definition of the disease, symptoms, risk factors, evaluation, management, and outcomes). Then, the 2 raters independently assessed the quality of information in the videos, using the DISCERN instrument. Results: In regard to the sources of the videos, we found 6 distinct types of uploaders; these included 3 kinds of individual users (ie, health professionals, general users, and science communicators) and 3 types of organizational users (ie, news agencies, nonprofit organizations, and for-profit organizations). Regarding content, our results show that the videos were primarily about diabetes management and contained limited information on the definition of the disease, symptoms, risk factors, evaluation, and outcomes. The overall quality of the videos was acceptable, on average, although the quality of the information varied, depending on the sources. The videos created by nonprofit organizations had the highest information quality, while the videos contributed by for-profit organizations had the lowest information quality. Conclusions: Although the overall quality of the information in the diabetes videos on TikTok is acceptable, TikTok might not fully meet the health information needs of patients with diabetes, and they should exercise caution when using TikTok as a source of diabetes-related information. J Med Internet Res 2021;23(9):e30409 Introduction Diabetes has become one of the most prevalent chronic diseases throughout the world. According to a recent report by the International Diabetes Federation, the estimated global prevalence of diabetes in people aged 20-79 years reached 493 million in 2019, accounting for 9.3% of the total world population [ 1 ]. Crude estimates of diabetes prevalence are 13.0% for US adults [ 2 ] and 12.8% for Chinese adults [ 3 ]. This high prevalence of diabetes results in huge financial burdens and losses for societies. In 2019, diabetes and related complications led to approximately 4.2 million deaths globally and resulted in US $760 billion of health expenditures [ 1 ]. Therefore, there is a pressing need to take action in managing diabetes. Individuals living with diabetes can actively manage their chronic condition. Early studies suggest that intensive blood glucose control can greatly reduce the risk of complications from the disease [ 4 - 6 ]. However, effective blood glucose control is not an easy task among people living with diabetes. Adequate glycemic controls require a constellation of actions, such as a customized diet, exercise plans, regular self-assessments of blood glucose levels, and optimized medication [ 7 ]. According to one study, in 2013, only 25.8% of patients with diabetes had received treatment in China, and only 39.7% of those treated had adequate blood glucose control [ 8 ]; such low treatment and adherence rates may be associated with people’s limited knowledge of the disease [ 9 ]. People living with diabetes often have diverse needs for information regarding their chronic condition, such as basic information on diabetes and the effectiveness of treatment options, on the sequelae of diabetes, blood glucose control, etc [ 10 ]. Nevertheless, they usually encounter many difficulties finding relevant and easy-to-understand information on their conditions [ 11 ]. Emerging internet technologies provide opportunities for better health communication and patient education. The internet has shifted the role of patients from passive information recipients to active information seekers [ 12 ]. General health information consumers use social media platforms (eg, discussion forums, microblogs, and group chatting) to seek both instrumental advice and emotional support [ 13 - 15 ]. Patients with diabetes who actively use social media for information, according to recent evidence, are associated with having lower glycated hemoglobin values [ 16 ]. A possible explanation for this is that social media provides patients with many opportunities to gain health knowledge, thereby increasing patient activation (ie, the ability and willingness that equip patients to take active action in managing their health care) [ 17 ]. Therefore, it is essential to utilize social media for better health communication for managing diabetes conditions. Despite the considerable benefits of social media, its use for health communication has some limitations. In the literature, the quality of the information is the most extensively mentioned concern [ 18 ]. The possibility of encountering faulty health information on social media increases risks for patients, who may make health decisions on the basis of inaccurate information [ 19 ]. The quality of unmoderated information poses challenges for both patients and health care providers. On one hand, patients need to be able to distinguish high-quality information sources from low-quality ones [ 20 , 21 ]; one the other, health professionals and institutions are expected to respond to and combat health misinformation to protect the public [ 22 ]. Therefore, it is important to examine the quality of health information on social media. Recently, an emerging short video app, TikTok, has attracted the interest of health care researchers [ 23 ]. During the COVID-19 pandemic, health-related videos on TikTok were widely viewed and shared. For example, COVID-19–related videos on the app have been watched approximately 93.1 billion times [ 24 ]. TikTok contains many videos about diabetes; however, their quality remains unstudied. To address this gap, this study aimed to systematically assess the quality of the information in diabetes-related videos on TikTok. Methods Search Strategy and Data Extraction Using the keyword “糖尿病” (“diabetes” in Chinese), we searched TikTok during the period from January 20-25, 2021, and we retrieved the first 250 videos delivered by TikTok’s recommended sorting process. We included the videos directly related to diabetes and excluded videos on other topics, commercial advertisements, and videos with no sound. After the screening, we obtained 199 videos for further data extraction and analysis ( Figure 1 ). We retrieved and extracted the basic information for each video, including the URL, publication date, name of the uploader, type of uploader (individual vs organization), uploaders’ verification status, length of the video, number of times it was shared, and number of “likes” and comments it received. The extracted data were recorded in Excel (Microsoft Inc). ‎ Measures We measured 2 aspects of diabetes-related videos on TikTok: their content and the quality of their information. First, we adopted the coding schema proposed by Goobie et al [ 25 ] to rate the quality of six types of content: the definition of the disease, signs/symptoms, risk factors, evaluation, management, and outcomes. Two raters assessed each video independently and scored how sufficiently the video addressed each of the content types on a 3-item scale: 0 points (no content), 1 point (some content), 2 points (extensive content). To rate the quality of the information, we adopted the DISCERN instrument. According to a systematic review [ 26 ], since its publication in 1998, DISCERN has been one of the most widely adopted instruments for assessing the quality of health information. It is a brief questionnaire that enables its users to assess the quality of health information concerning treatment choices [ 27 ]. The instrument consists of 16 questions, with response choices based on a 5-point scale, ranging from 1=poor to 5=good. These 16 questions are divided into 3 sections. The first 8 concern the reliability of the publication, such as whether its aims are clear and whether it is relevant, balanced, and unbiased. The scores for this section indicate whether the publication can be trusted as a source of information for choosing a treatment for a particular disease. The 7 questions in the second section focus on the details of treatment choices, such as whether the publication describes how each treatment works and explains its risks and benefits. The scores for this section reflect the quality of the publication’s information about treatment choices (including self-care). The third section consists of 1 final question, based on all the previous ones; it asks users to rate the overall quality of the publication as a source of information about treatment choices. Of note is the fact that, although the original DISCERN instrument was designed for evaluating written publications, it has been widely used for assessing health-related videos. For example, researchers have used it to evaluate YouTube videos informing patients about treatments for cancer [ 28 , 29 ] and diabetes [ 30 ]. Rating process Two authors (WK and LS) worked on the rating tasks; both are certified physicians who work at endocrinology departments at 2 local hospitals. The raters independently scored each video for its coverage of the 6 types of content and applied the 16 questions of the DISCERN instrument. Interrater reliability was assessed with SPSS (version 22, IBM Corp). The interrater reliability for each of the 6 items relating to video content ranged from 0.813 to 0.981, and all of the reliability coefficients are highly significant at an error margin of 0.1%. The interrater reliability for each of the 16 items of the DISCERN instrument ranges from 0.898 to 0.991, and all of the reliability coefficients are highly significant at an error margin of 0.1%. These results indicate satisfactory interrater reliability. Results Video Sources We identified 2 primary sources of the videos: individual and organizational users. We further identified 3 types of video creators among individual users: health professionals, science communicators, and general users. Among organizational users, we identified three types of sources: news agencies, nonprofit organizations, and for-profit organizations. The results suggest that individual users published most of the videos (n=156, 78.4%). Among individual users, health professionals contributed the most videos (n=138, 69.3%), followed by general users (n=12, 6.0%), and science communicators (n=6, 3.0%). We noted that only 43 videos were uploaded by organizational users, and these accounted for 21.6% of the videos in our sample. Among organizational users, news agencies contributed the most videos (n=31, 15.6%), followed by nonprofit organizations (n=7, 3.5%) and for-profit organizations (n=5, 2.5%) ( Table 1 ). In our sample, the shortest video lasts only 13 seconds, while the longest lasts 407 seconds. On average, the videos are approximately 1 minute long. All videos were published after 2019. The earliest video had been on TikTok for 589 days, while the latest one was published 3 days prior to the day we collected the data. The videos in the sample received 2.75 million “likes” and 157,700 comments and were shared 305,200 times. Table 2 shows the characteristics of the videos, described by the median numbers across different sources. Table 1. Descriptions of video sources. Source type

Predict your next investment

The CB Insights tech market intelligence platform analyzes millions of data points on venture capital, startups, patents , partnerships and news mentions to help you see tomorrow's opportunities, today.

CB Insights uses Cookies

CBI websites generally use certain cookies to enable better interactions with our sites and services. Use of these cookies, which may be stored on your device, permits us to improve and customize your experience. You can read more about your cookie choices at our privacy policy here. By continuing to use this site you are consenting to these choices.