Wisepill Technologies

Jun 10, 2021

Journal of Medical Internet Research This paper is in the following e-collection/theme issue: August 06, 2020 . Acceptability of the Medication Event Reminder Monitor for Promoting Adherence to Multidrug-Resistant Tuberculosis Therapy in Two Indian Cities: Qualitative Study of Patients and Health Care Providers Acceptability of the Medication Event Reminder Monitor for Promoting Adherence to Multidrug-Resistant Tuberculosis Therapy in Two Indian Cities: Qualitative Study of Patients and Health Care Providers Authors of this article: 2Department of Public Health and Community Medicine, Tufts University School of Medicine, Boston, MA, United States 3Center for Global Public Health, Tufts University School of Medicine, Boston, MA, United States 4Division of Geographic Medicine and Infectious Diseases, Tufts Medical Center, Boston, MA, United States *these authors contributed equally Department of Public Health and Community Medicine Tufts University School of Medicine 136 Harrison Ave Abstract Background: Patients with multidrug-resistant tuberculosis (MDR-TB) face challenges adhering to medications, given that treatment is prolonged and has a high rate of adverse effects. The Medication Event Reminder Monitor (MERM) is a digital pillbox that provides pill-taking reminders and facilitates the remote monitoring of medication adherence. Objective: This study aims to assess the MERM’s acceptability to patients and health care providers (HCPs) during pilot implementation in India’s public sector MDR-TB program. Methods: From October 2017 to September 2018, we conducted qualitative interviews with patients who were undergoing MDR-TB therapy and were being monitored with the MERM and HCPs in the government program in Chennai and Mumbai. Interview transcripts were independently coded by 2 researchers and analyzed to identify the emergent themes. We organized findings by using the Unified Theory of Acceptance and Use of Technology (UTAUT), which outlines 4 constructs that predict technology acceptance—performance expectancy, effort expectancy, social influence, and facilitating conditions. Results: We interviewed 65 patients with MDR-TB and 10 HCPs. In patient interviews, greater acceptance of the MERM was related to perceptions that the audible and visual reminders improved medication adherence and that remote monitoring reduced the frequency of clinic visits (performance expectancy), that the device’s organization and labeling of medications made it easier to take them correctly (effort expectancy), that the device facilitated positive family involvement in the patient’s care (social influences), and that remote monitoring made patients feel more cared for by the health system (facilitating conditions). Lower patient acceptance was related to problems with the durability of the MERM’s cardboard construction and difficulties with portability and storage because of its large size (effort expectancy), concerns regarding stigma and the disclosure of patients’ MDR-TB diagnoses (social influences), and the incorrect understanding of the MERM because of suboptimal counseling (facilitating conditions). In their interviews, HCPs reported that MERM implementation resulted in fewer in-person interactions with patients and thus allowed HCPs to dedicate more time to other tasks, which improved job satisfaction. Conclusions: Several features of the MERM support its acceptability among patients with MDR-TB and HCPs, and some barriers to patient use could be addressed by improving the design of the device. However, some barriers, such as disease-related stigma, are more difficult to modify and may limit use of the MERM among some patients with MDR-TB. Further research is needed to assess the accuracy of MERM for measuring adherence, its effectiveness for improving treatment outcomes, and patients’ sustained use of the device in larger scale implementation. J Med Internet Res 2021;23(6):e23294 Background Multidrug-resistant tuberculosis (MDR-TB) is a major global challenge to tuberculosis (TB) control. In 2018, approximately 484,000 people worldwide were estimated to have developed MDR-TB, including approximately 130,000 people in India [ 1 ]. Despite considerable advances in therapy in the last decade, treatment outcomes remain poor for individuals with MDR-TB, with treatment success rates of 56% worldwide and 48% in India for the 2017 patient cohort [ 1 ]. Although some of the variability in treatment outcomes may be attributable to the composition of the patient’s drug regimen [ 2 ], suboptimal adherence to medications may be another critical problem contributing to poor MDR-TB treatment outcomes. Successful adherence for diseases with a prolonged treatment course, such as MDR-TB, requires a high level of dosing implementation (ie, taking a medication dose on a given day) and persistence (ie, taking medications for the entire duration of therapy [ 3 ]). Factors contributing to nonadherence are complex and include therapy-related (eg, toxicities [ 4 ]), psychosocial (eg, alcohol use [ 5 ], depression [ 6 ], and stigma [ 7 ]), structural (eg, distance from clinics and medication costs [ 8 , 9 ]), and health system–related challenges (eg, poor user experience with the health system). Patients with MDR-TB face particularly high levels of drug toxicity [ 4 ] and psychosocial barriers, including depression, substance use disorders, stigma, and discrimination [ 10 ]. These challenges may lead to poor outcomes and increased transmission of drug-resistant strains. As such, there is an urgent need for new strategies to improve medication adherence in patients with MDR-TB. Many TB programs have historically used directly observed therapy (DOT) to monitor adherence; however, recent studies have questioned the efficacy of this strategy for improving clinical outcomes [ 11 - 13 ] and raised concerns that DOT adversely affects patient autonomy [ 14 , 15 ]. Limited autonomy with DOT may be greater for patients receiving MDR-TB treatment, given the prolonged course of therapy required. In addition, recent recommendations favoring the use of regimens containing only oral medications may decrease the required frequency of clinic visits for patients with MDR-TB if they are allowed to take therapy without in-person observation [ 16 ]. In recent years, driven by the global expansion of cellular networks, there has been a growing use of digital adherence technologies (DATs) as alternative approaches for monitoring adherence to TB medications [ 3 ]. These technologies, which include cellphones, digital pillboxes, and ingestion sensors, have the potential to improve clinical outcomes via multiple pathways [ 3 ]. Although there are numerous DATs aimed at addressing nonadherence in patients with drug-susceptible TB [ 3 ], few have attempted to address the more complex medication regimens taken by patients with MDR-TB [ 17 ]. The Medication Event Reminder Monitor (MERM) is a digital pillbox that has been designed to monitor MDR-TB treatment in resource-constrained settings by using relatively affordable evriMED technology produced by Wisepill Technologies. This system is designed to be used with multiple blister-packaged medications in MDR-TB regimens, incorporates visual and audible reminders for daily dosing and refills, compiles dosing histories by capturing data on pillbox opening as a proxy for dose ingestion, and transmits these data to a server so that health care providers (HCPs) can remotely visualize patients’ dosing histories. By providing near real-time adherence data, the MERM may facilitate the identification of high-risk patients and prompt early intervention by HCPs to reduce nonadherence. When compared with facility-based DOT, in which patients travel to clinics to be observed taking medications, monitoring by using the MERM may reduce the required frequency of patient visits to TB clinics. Pilot studies of digital pillboxes conducted in Uganda and China with patients with drug-susceptible TB and in South Africa with patients with MDR-TB have shown these devices to have relatively high acceptability [ 17 - 19 ]. A cluster randomized trial conducted in China with patients with drug-susceptible TB found digital pillboxes to be effective in reducing the percentage of patient months with high nonadherence [ 20 ]. However, subsequent studies on the large-scale implementation of these digital pillboxes in China have revealed challenges in their uptake. For example, after accounting for patients who were not eligible to use these pillboxes, refused to use them, withdrew from using them early in treatment, or were shifted to monitoring with DOT, only approximately 49% and 39% of patients with TB used digital pillboxes in a sustained manner in a single province [ 21 ] and 30 counties [ 22 ], respectively, in China. In addition, a study of the MERM conducted in Vietnam with patients with drug-susceptible TB found that only approximately half of the patients used the device as intended, with many separating the time when the pillbox was opened from the time that doses were ingested, because of concerns about the device’s portability [ 23 ]. These existing studies evaluating the use of digital pillboxes reveal variability in patient acceptance in different contexts and highlight a relative paucity of data on the use of these devices for patients with MDR-TB. Objectives In this study, based on qualitative interviews with patients and HCPs, we evaluated the MERM’s ability to monitor adherence to MDR-TB therapy during pilot rollout in the government’s National TB Elimination Program (NTEP) in 2 Indian cities. Although this novel strategy has potential advantages, previous research has not been conducted in India to evaluate whether patients will accept and use the MERM, to identify potential modifiable and nonmodifiable barriers to its acceptability, and to understand how its implementation might impact HCP work efficiency and quality of care. Understanding the acceptability of MERM during pilot implementation is also important because recent studies of other DATs in India suggest that suboptimal acceptability and use by patients could reduce the accuracy of these technologies for measuring adherence [ 24 ], which might in turn greatly reduce the value of real-time adherence data for guiding interventions. We analyze our findings using the Unified Theory of Acceptance and Use of Technology (UTAUT), a framework that synthesizes constructs that predict engagement with novel technologies [ 25 , 26 ]. Methods Ethical Approvals This protocol received approval from the Indian Council of Medical Research-National Institute for Research in TB Institutional Ethics Committee (FWA00005104) on March 7, 2017. The study was approved by the Brigham and Women’s Hospital Institutional Review Board (FWA00000484) on January 31, 2017, and the Tufts Health Sciences Institutional Review Board (FWA00004517) on June 6, 2018. Written informed consent was obtained from all the participants. Study Setting This study was conducted in 2 Indian cities with a high TB burden in the general population [ 27 , 28 ]: Chennai (estimated population of 7.1 million in metropolitan area), in the southern Indian state of Tamil Nadu, and Mumbai (estimated population of 18.4 million in the metropolitan area), in the western Indian state of Maharashtra. Mumbai in particular has one of the world’s most severe urban epidemics of drug-resistant TB [ 29 - 31 ]. All patients in Chennai spoke Tamil, and all patients in Mumbai spoke Hindi or Marathi. Consistent with the broader population of patients with TB who seek government care in India, more than half of whom earn less than US $2 a day of income [ 32 ], patients with MDR-TB in these 2 cities come from socioeconomically disadvantaged backgrounds. MERM Implementation Medications are dispensed in blister packs, and each drug is placed in a different partitioned compartment within the MERM, which facilitates storage and organization of the multiple medications that comprise MDR-TB regimens ( Figure 1 ). In India’s pilot implementation, the container and internal partitions were made of cardboard. The device was provided to patients at different time points in the continuation phase of therapy when injectable agents had generally been discontinued and patients were only taking oral medications. At the time of our study, most patients with MDR-TB in India’s NTEP were placed on a standardized drug regimen for a treatment course lasting 24 to 27 months, with the continuation phase consisting of levofloxacin, ethionamide, cycloserine, and ethambutol taken once daily [ 33 ]. Patients who were provided the MERM subsequently used it for the remaining duration of treatment. The MERM was programmed to provide audible and visual reminders to take medications at a specific time each day, per patient and HCP preference. The visual reminder consisted of a blinking green light corresponding to a label encouraging the patient to take a dose; separate yellow and red lights blink to alert patients about the need to refill medications and replace the MERM’s battery, respectively. The audio reminder consisted of a ringing sound that occurred at the same time as the visual dose-taking reminder. The device contained a removable battery-powered module. Triggered by a magnetic sensor, this module captures and stores data each time the container is opened as a proxy for medication ingestion. These data on patient engagement with the MERM were transmitted every 72 hours using cellular networks and recorded on a computer server. HCPs could log into an app on a mobile device or a website, where each patient’s adherence history was presented as a color-coded calendar in which green suggested that the MERM was opened on a given day (suggesting dose ingestion), whereas red suggested that the device was not opened (suggesting that the dose was not ingested). These dosing histories were meant to help HCPs have individualized discussions with patients regarding their adherence. In addition, a series of probable missed doses would result in automated SMS text messaging notifications prompting HCPs to intervene with these patients, who might be at a higher risk for unfavorable outcomes. ‎ Figure 1. The Medication Event and Reminder Monitor in a cardboard version used for the initial rollout among patients with multidrug-resistant tuberculosis in India. The device includes partitions for organizing medications, medication labels inside the box lid, and a digital module that provides reminders and captures adherence data. This cardboard version was provided by Wisepill Technologies. Recruitment of Study Participants and Collection of Qualitative Data Interviews were conducted by 3 field researchers in Mumbai (1 man and 2 women) and 3 field researchers in Chennai (2 men and 1 woman), all of whom had a master’s degree in social work or another social science field who underwent a 2-day training in qualitative interviews at the National Institute for Research in TB in Chennai. Study participants included patients with MDR-TB and HCPs. We use the term MDR-TB to describe patients with confirmed resistance to isoniazid and rifampin as well as individuals who were diagnosed as having rifampin-resistant TB using Xpert MTB/RIF (Cepheid, Inc) because patients with rifampin-resistant TB in India are treated as having likely MDR-TB. Data collection was conducted a few months after the MERM was introduced in Mumbai and Chennai for monitoring patients with MDR-TB from October 2017 to September 2018. Before the rollout of the MERM, HCPs were extensively trained on the appropriate use of the MERM. HCPs dispensed medication refills in the MERM for patients with MDR-TB in the continuation phase of therapy after any injectable agents (eg, kanamycin) were discontinued. Field researchers met patients at MDR-TB clinics, where patients were screened for inclusion in the study. At these clinics, HCPs were recruited for the study, including health visitors (individuals with at least a high school level of education who monitor therapy), senior treatment supervisors (individuals with at least a high school level of education who supervise health visitors), medical officers (doctors with an MBBS or higher degree), and district TB officers (doctors who supervise TB care across a district). For patients, an unannounced home visit was made at least 3 weeks after enrollment into the study to conduct the qualitative in-depth interviews regarding the MERM, which lasted about 45 minutes. A pill count was also conducted to better understand the patients’ adherence to medications. We ensured a minimum of 3 weeks lapsed between when a patient was consented to the study and when the unannounced home visit was conducted. This time gap minimized the impact of temporary changes in medication adherence that may result from the patient knowing that he or she will be visited as part of the study (ie, the Hawthorne effect). For HCPs, interviews lasted about 30-45 minutes and were conducted in a private space in the TB clinic. To ensure uniformity in data collection, separate patient and HCP interview guides, each consisting of open-ended and semistructured questions with follow-up probes, were used to conduct the interviews. Examples of questions from the patient interview guide are provided in Multimedia Appendix 1 . The interview questions had the goal of assessing key constructs in the UTAUT framework. Interviews were conducted in Tamil, Hindi, or Marathi and audio recorded. They were later transcribed and translated to produce deidentified English language transcripts. To ensure translation accuracy, one-fourth of the English transcripts were evaluated against the original audio recordings for correctness and completeness. Analytical Framework: UTAUT The UTAUT integrates constructs from previous literature on technology acceptance into a single framework [ 25 , 26 ]. Of these constructs, 3—performance expectancy, effort expectancy, and social influences—help to predict the intention of individuals to use a technology, which is necessary, but not sufficient, to result in actual use. Performance expectancy refers to the perceived usefulness of technology for users. For example, for patients with MDR-TB, this may refer to the extent to which the MERM is perceived to improve their medical care, whereas for HCPs, it may refer to the extent to which it is perceived to improve the quality or efficiency of their work. Effort expectancy refers to the ease of using the technology. For patients, this may refer to the effort required to correctly understand the different functions of the digital pillbox (eg, storage function and reminders), whereas for HCPs, this may refer to the effort required to use and understand the web-based adherence dashboard and SMS text messaging reminders that notify HCPs about nonadherent patients. Social influences refer to how other individuals may influence a person’s acceptance and use of technology. For patients, this may include family members or community residents, whereas for HCPs, this may include coworkers. Of these 3 constructs, performance expectancy has the strongest influence on the intention to use a technology [ 25 ]. Facilitating conditions, the fourth construct in the UTAUT, is thought to directly affect the actual use of a new technology. Facilitating conditions comprise the underlying infrastructure to enable the use of a technology. For patients with MDR-TB, we interpreted this broadly to include factors in the TB program, such as the quality of counseling regarding the MERM provided to patients and any outreach to patients by HCPs that might have been prompted by adherence data from the MERM. For HCPs, we interpret this to include the quality of training they received before the rollout of the MERM and any higher-level support they received during the rollout process. Analysis of Qualitative Data Transcribed interviews were coded using a thematic approach and analyzed using Dedoose software (version 8.0.35; SocioCultural Research Consultants, LLC). The study team first identified possible codes (ie, themes) related to the central research question from the data collected by using the qualitative interview guides as a foundation and the UTAUT as an organizing framework. The transcripts were then independently coded by 2 researchers for relevant themes using descriptive content analysis. In parallel, the researchers tracked new codes that were added to the coding scheme to describe unexpected themes that emerged. The two researchers frequently met to reconcile inconsistencies in the application of codes and to ensure that emergent codes were added to the coding scheme. Because all coding differences were reconciled by consensus, we did not assess the interrater reliability between the coders. We analyzed the data to identify emergent themes that could influence the acceptability and use of MERM. Emergent themes were organized within the 4 UTAUT constructs, and illustrative quotations were selected for each theme. In reporting our findings, we follow the principles of qualitative research by avoiding the quantification of codes (or themes) from our data [ 34 ]. In our findings, we report not only common themes (ie, those that emerged most frequently) but also salient themes (ie, themes reported by a minority that are still important). We also specifically did not classify each patient based on whether they reported a high or low acceptance or use of the MERM. In contrast, we focus on reporting specific features of the MERM that were associated with higher or lower acceptance of the device because individual patients might find some components to be acceptable while simultaneously finding other components to be unacceptable. For example, a patient might appreciate the MERM’s organization of medications but, at the same time, have concerns about the audible reminder because of fear that it could lead to the disclosure of her or his MDR-TB diagnosis. In addition, there is often individual variation in whether patients accept a particular technology [ 35 ]. As such, we avoid making a blanket declaration that the device is either acceptable or unacceptable to the larger patient population with MDR-TB in India. Results Characteristics of Study Participants We interviewed 65 patients with MDR-TB, for whom the median age was 33 years (range 18-75 years). Home visits were conducted for a median of 5 weeks (range 3-8 weeks) after the patients started using the MERM. Most patients were men, had some primary or secondary school education, and lived in the Chennai metropolitan area ( Table 1 ). We interviewed 10 HCPs, with a median age of 35 years (range 29-54 years). They had a median of 5.5 years of work experience in the NTEP (range 2-15 years). Most HCPs were men, had an undergraduate education, and had jobs as health visitors ( Table 2 ). Table 1. Descriptive statistics for patients with multidrug-resistant tuberculosis being monitored with the Medication Event Reminder Monitor. Characteristic Several factors were associated with a higher acceptance of MERM ( Textbox 1 ). With regard to performance expectancy (perceived usefulness), many patients felt that the reminders prevented them from forgetting to take their medications and helped them take it at the same time every day, with most preferring audible ( Textbox 1 ; quote 1) and a few preferring visual (quote 2) reminders. One patient described the following benefits of audible reminders: I finish my breakfast before 10 O’ clock and wait for the alarm to ring. The alarm is useful because even when I forget it reminds me to take the tablets. [Patient, male, 49 years] Some patients also appreciated the yellow light, which served as a reminder to return to the clinic for medication refills. Before being given their medications in the MERM, patients with MDR-TB usually visited clinics more frequently (eg, daily or weekly) for closer monitoring by HCPs. Some patients appreciated that remote monitoring of adherence resulted in reduced time and money spent on clinic visits (quote 3), as described by the following patient: I previously had to visit the hospital three or four times in a month, but now I am going there once a month, so it is very good that you have provided this box. It is like a blessing for me. [Patient, male, 39 years] Several patients also appreciated the manner in which the MERM stores, organizes, and provides helpful internal labeling of medications. Patients previously stored medication blisters in plastic bags or a cardboard box provided by the TB program that did not have internal partitions to organize medications (quotes 4 and 5). These findings speak both to favorable perceived usefulness (ie, performance expectancy) of the MERM for organizing medications and favorable ease of use (ie, effort expectancy) because most patients found it easy to follow and understand the MERM’s internal labels that guide pill taking, as noted by the following patient: There are different compartments for each tablet, so they don’t get mixed with each other....It is helpful. I like the arrows with the dots that explain how many of each medication I need to take. [Patient, male, 38 years] With regard to social influences, several patients reported that the audible reminder function promoted increased involvement of family members in their TB care (quotes 6-8), although occasionally such involvement was because of annoyance from the audible reminder (quote 7) or perceptions that the MERM facilitated government surveillance (quote 8). In some cases, however, this family involvement was prompted by the positive perception that the MERM represents an extension of the care provided by HCPs: As soon as the alarm rings, my son immediately runs to me and says “Your doctor is calling you. Go and take your medicine and then do your work.” [Patient, male, 49 years] Counseling of patients by HCPs in the appropriate use of the MERM is an important facilitating condition. The quality of counseling was assessed indirectly based on whether patients had appropriate or inappropriate knowledge of the functions of the MERM. There was variability in patient understanding of the MERM; however, most patients expressed a correct understanding of its medication labeling (quote 9) and other basic functions. For example, the following patient correctly interpreted the different lights on the MERM, reflecting appropriate counseling: If red color [light] blinks there is no charge; if the green color blinks, it signals that the tablets have to be taken at 10 O’ clock; and if the yellow color blinks, it means that the tablets are going to run out. [Patient, male, 22 years] Some patients reported that HCPs deployed the MERM in a manner that strengthened the patient-HCP relationship (quote 10). These findings highlight aspects of the MERM’s perceived usefulness (performance expectancy), as well as favorable facilitating conditions in the health system’s implementation of this technology. For example, patients appreciated that HCPs seemed to use the adherence data generated by the MERM in a positive manner, which resulted in patients feeling caredfor remotely: If I don’t open the [pill]box, somebody from the health center calls me to find out whether I have taken the tablets or not. They care for me. [Patient, male, 61 years] Representative quotations on factors facilitating the acceptance of the Medication Event Reminder Monitor by patients based on constructs in the Unified Theory of Acceptance and Use of Technology (UTAUT). Performance expectancy Reminders promote medication adherence Quote 1: “The sound of the alarm forces me to take the medicine on time.” (Patient, female, aged 42 years) Quote 2: “Even when the alarm is not audible, the light is useful, especially when I am not near the box.” (Patient, male, aged 25 years old) Remote monitoring reduces clinic visits Quote 3: “I can do work at home properly now and do not have to worry about going to the health center.” (Patient, female, aged 27 years) Effort expectancy Ease of pill taking because of better medication storage, organization, and labeling Quote 4: “Previously, I kept the tablets in a plastic cover, but now they are safer in the box. I used to be so confused, as there were so many medicines to take. Now it is easier.” (Patient, female, aged 21 years) Quote 5: “The pills were previously given in an ordinary cardboard tablet box, which does not have an alarm, but this box has an alarm to remind me.” (Patient, male, aged 61 years old) Social influences Promotes family involvement in patient’s care Quote 6: “When the alarm rings and I am outside my house, they send a person to inform me to take my pills.” [Patient, male, aged 49 years] Quote 7: “My mother complains when I delay taking the medicines. She would say, ‘The box has been making noise constantly’ and makes sure I take the medicines so the noise will stop.” (Patient, male, aged 44 years) Quote 8: “There is a camera in the box, so if you don’t take the pills, people in Delhi will come to know. So take your pills.” (Mother of a 25-year-old male patient) Facilitating conditions Correct understanding of the Medication Event Reminder Monitor, reflecting appropriate counseling Quote 9: “I take the tablets according to the dots shaded in each column above the compartment.” (Patient, female, aged 28 years) Medication Event Reminder Monitor strengthens patient-health care provider relationship Quote 10: “At the time of discharge...[a] health worker explained the MERM box and told me about the need to take my medicines regularly and that the box would help remind me. Those words motivated and encouraged me. My anxiety was reduced, and I was filled with happiness.” (Patient, male, aged 53 years) Textbox 1. Representative quotations on factors facilitating the acceptance of the Medication Event Reminder Monitor by patients based on constructs in the Unified Theory of Acceptance and Use of Technology (UTAUT). Barriers to Patient Acceptance and Use of the MERM Patients also experienced barriers to the acceptance and use of MERM ( Textbox 2 ). A few patients admitted a lack of understanding regarding the purpose of the MERM, which suggests limitations in performance expectancy (perceived usefulness) for this minority of individuals: I did not know that when I don’t take pills, it will be shown [to HCPs] by a computer. [Patient, female, aged 45 years] More commonly, patients described limitations in effort expectancy (ease of use). For example, one patient described how the MERM’s lack of portability led him to remove medication blisters from the device, which would result in the MERM recording adherence inaccurately: I take my pills out of the box when I leave for work and put them in my pocket. I cannot carry such a big box to work that makes so much noise when I open it. I take the medicines [at work] when I am free. I do not benefit from the alarm or the light [audible and visual reminders] because I leave the box at home. [Patient, male, aged 21 years] Other patients similarly described how the device’s large size served as a barrier to taking it to work ( Textbox 2 ; quote 11) or storing it inside the house (quote 12). In addition, some of these concerns were related to stigma and privacy. Patients were concerned that the device’s size and the loud sound of the audible reminder would draw attention and potentially raise questions about the patient’s underlying medication condition (quote 13). Some patients found the audible reminder to be a major annoyance (quote 14). For example, one patient propped the box open to prevent the alarm from going off: The alarm is too loud. So to avoid it [from going off], I put a paper in between the box and the lid and take the medicine. [Patient, female, aged 18 years] This action breaks the magnetic seal on the lid of the MERM and interferes with the recording of daily dose taking, thereby resulting in an inaccurate adherence record. Patients also found that the body of the MERM, which is made of commercial-grade cardboard, poorly withstood the humidity and monsoon weather conditions in India. Medication labels peeled from the box (quote 15), and the box’s shape became distorted: My box bulged after it had rained continuously, and the inside of the house became damp, so it would be better if the box was made out of plastic. [Patient male, aged 48 years] A few patients found the MERM medication labels to be challenging; however, some of these difficulties may have reflected poor organization of medications in the box by HCPs, such that medications were not in the partitions corresponding to the appropriate labels: This box is useful as there are instructions about its use, but sometimes the arrows [labeling each medication] don’t match with the [correct] medicines. I get confused. [Patient, male, aged 40 years] Patients reported various other technical problems that limited the ease of using the MERM, including weak cellular signal in the patient’s home resulting in the nonreporting of doses taken (quote 16), failure of the device’s battery (quote 17), and malfunction of the reminder lights (quote 18). With regard to social influences, several patients reported concerns regarding violations of the privacy and confidentiality of their MDR-TB diagnoses, which reflects the stigma surrounding this disease. As described earlier, patients were particularly concerned about stigma when traveling with the MERM (quote 13), but many patients were equally concerned about stigma when taking the device with them to clinic visits (quote 19), when friends or relatives visited the home (quote 20), or when family members heard the audible reminder, even if the device was hidden (quote 21). One patient was even concerned that the audible reminder was loud enough to draw the attention of her neighbors: When the alarm rings, my neighbors can hear it. I am scared that they will come to know about my disease. [Patient, female, aged 21 years] With regard to facilitating conditions, some patients conveyed an incorrect understanding of the functions of the MERM (quote 22). For example, when asked about the visual reminders, the following patient conveyed an incorrect understanding: I have to close the box when the yellow light blinks and I understand that if the red light blinks the tablets are going to be over. [Patient, female, aged 75 years] Representative quotations on barriers to acceptance and use of the Medication Event Reminder Monitor by patients based on constructs in the Unified Theory of Acceptance and Use of Technology (UTAUT). Effort expectancy Size, portability, and storage problems Quote 11: “Sometimes I have to go for work for 2 or 3 days, and during that time I can’t carry this big box to the workplace. A smaller box with an alarm would be useful when I go for work.” (Patient, male, aged 41) Quote 12: “I keep my box in a hen cage [outside of the house], because my children used to play with it. I don’t have a place in my home to keep the box where my children won’t reach it.” (Patient, male, aged 33 years) Quote 13: “How can I carry this big box when I have to attend a marriage function in my village? I am sure my relatives will ask me questions when I take the medicines out of the box and when they hear the alarm sound. I usually take the medicines out of the box when I travel and leave the box at home.” (Patient, female, aged 45 years old) Audible reminder is too loud Quote 14: “The sound is so loud, even the neighbors can hear it....Maybe it [the audible reminder] is useful for elders but not for youngsters like me because I feel irritated when it alerts me.” (Patient, female, aged 18 years) Limited durability of the box and labels Quote 15: “The label in the box is not properly fixed and it has started peeling off.” (Patient, female, aged 18 years) Other technical problems with the Medication Event Reminder Monitor Quote 16: “Sometimes due to [cellular] signal problems, although I was opening the box, these doses were not reported. I received calls from the health center [in which HCPs told me] to keep the box [at locations in the house] where the network might be better.” (Patient, male, aged 38 years) Quote 17: “The alarm did not ring once and when I took it to the centre, they told that the box has run out of charge and needs to be replaced or recharged.” (Patient, male, aged 44 years) Quote 18: “I am confused because all the three lights were glowing every day.” (Patient, female, aged 37 years) Social influences Problems related to privacy and stigma Quote 19: “When I carry the box when leaving the health center, people know that I have TB. This is embarrassing, so I try to hide it, but it is too big.” (Patient, male, aged 39 years) Quote 20: “Suppose that my relatives visit my home. The box’s alarm could ring in front of everybody....They may come to know that I have this disease. I would be so embarrassed in front of them. So, I don’t like this box.” (Patient, female, aged 18 years) Quote 21: “I keep the MERM inside the cupboard in my bedroom. I go inside my bedroom and take the medicine [privately]. If the alarm goes off and there is somebody at home, they sometimes ask me where that sound came from.” (Patient, male, aged 49 years) Facilitating conditions Incorrect understanding of the Medication Event Reminder Monitor, reflecting suboptimal counseling Quote 22: “The green color light helps me as a reminder but the red color means danger, which indicates that I have to go for the refill.” (Patient, female, aged 18 years old; description reflects incorrect understanding of the meaning of each light) Textbox 2. Representative quotations on barriers to acceptance and use of the Medication Event Reminder Monitor by patients based on constructs in the Unified Theory of Acceptance and Use of Technology (UTAUT). Findings From HCPs The interview findings revealed both facilitators of and barriers to HCP acceptance of the MERM ( Figure 2 ). Facilitators of HCP Acceptance and Use of the MERM For HCPs, perceptions of positive performance expectancy (ie, perceived usefulness) were the strongest facilitators of their acceptance and use of the MERM. In particular, most HCPs felt that remote monitoring of adherence was beneficial for both patients and HCPs. During the pilot implementation of the MERM, patients with MDR-TB were generally dispensed 1 month of medications. Clinic visits to pick up medications, which were previously required on a weekly or biweekly basis, were reduced substantially under the assumption that remote monitoring minimized the need for more frequent in-person monitoring. Most HCPs felt that patients benefited from this reduction in required clinic visits, as described in the following quotation: Patients now do not have to travel long distances, spending their money to collect their drugs every week, or sometimes twice a week. Most of our MDR TB patients come from distant villages, and transportation is very difficult. We feel comfortable giving them a month’s supply in the box [MERM] as it is easier for them to take and the light and alarm [reminders] help them to take their drugs on time. [Senior treatment supervisor] Reduced frequency of patient visits decreased the workload for many HCPs, resulting in decreased stress: Previously, we had to supervise therapy on a daily basis [ie, DOT]. But now the patients come [to the clinic] only once a month, so our work pressure has reduced. [Senior treatment supervisor] Some HCPs reported that the decreased workload allowed them to focus more on each patient interaction, as well as other tasks, which increased job satisfaction: I have more time now to check whether patients have taken their tablets or not. I am also able to concentrate on other tasks as well, which gives me more satisfaction in my work. [Health visitors] With regard to social influences, some HCPs perceived that providing medications in the MERM, compared with the cardboard box previously used to dispense medications, was potentially less stigmatizing for patients because some cardboard boxes contained messages regarding TB: The good thing about the MERM is that it does not carry any messages on TB [on the outside of the box], so there is no stigma attached to it. Patients can carry it freely. [Medical officer] Barriers to HCP Acceptance and Use of the MERM HCPs also reported barriers to the acceptance of the MERM for both patients and HCPs. With regard to performance expectancy, HCPs found intermittent (every 72 h) updating of patients’ adherence records to be the most significant limitation to the MERM’s perceived usefulness, as described by the following HCP: It takes 72 hours for the [MERM] dashboard to show that the patient has taken medications. This makes it difficult for us to monitor the patient’s drug intake on a daily basis. We cannot take action as promptly and lose time. [Pharmacist] With regard to effort expectancy (ease of use), many HCPs felt that the size of the MERM made transporting the device to clinic visits prohibitive: It is good [for patients] to have a device like the MERM, but...it is difficult to carry, as they need to go by bus and train. We need to provide them with a big bag for [the device]. [Health visitors] The MERM’s size also resulted in challenges for HCPs themselves: Even for us [HCPs] at the health centers, it is difficult to find space to store these MERM boxes. [Senior treatment supervisor] Consistent with findings from the patient interviews, HCPs described a lack of cellular signal in patients’ homes as a barrier to MERM use for rural patients in particular. This barrier contributed to limitations in HCPs’ ability to obtain adherence data from and communicate with patients: Some of the patients are not willing to use the box [MERM], as people living in the villages are not always getting [adequate cellular] signal, so the device is not working. [Senior treatment supervisor] During the pilot implementation of the MERM, HCPs found that some facilitating conditions on the part of the health system were suboptimal. For example, some HCPs felt that the single-day training provided would be insufficient for new personnel: One day of training will be difficult if we have newly recruited staff, because they have to understand the [MDR TB] program, and then undergo training [in use of the MERM]. [Senior treatment supervisor] Some barriers to implementation arose from more fundamental challenges in the MDR-TB program. For example, MDR-TB medications were supposed to be dispensed in the MERM on a monthly basis; however, some medications were sometimes understocked. This problem was easier to manage when patients were refilling medications on a weekly or more frequent basis because fewer medications had to be dispensed at any given visit. MERM implementation therefore worsened challenges related to the understocking of drugs: Sometimes MDR-TB drugs are not available, and so we are not able to give all the medicines required....How do we leave that compartment [in the MERM for a specific medication] empty, and what can we tell the patient? [Pharmacist] Finally, some personnel felt that when problems were identified with the implementation of the MERM, they did not have channels to communicate these challenges: When we started using the MERM, we were excited about the device. When patients came back for their medication refills, they raised concerns with regard to technical problems—the alarm, light, texture and size of the box, for example. I was not sure who to notify. Maybe we could have had those who made the device discuss our feedback so it could be improved? [Senior treatment officer] Principal Findings This study describes the evaluation of a low-cost digital pillbox aimed at promoting medication adherence among patients with MDR-TB during pilot implementation in India’s NTEP. We find that acceptability of the MERM is variable; some features of the technology facilitate acceptability, whereas other features and contextual factors serve as barriers to engagement by some patients. Although previous studies have evaluated the use of similar digital pillboxes as part of TB care [ 3 , 18 - 20 , 22 , 23 ], to our knowledge, only one previous study conducted in South Africa [ 17 ] has evaluated the use of these technologies for patients with MDR-TB, who face unique challenges, including the complexity of their medication regimens, prolonged duration of therapy, increased risk of drug toxicities, and greater disease-related stigma. In addition, our study is unique in that it assessed the perspectives of both patients and HCPs. Implications of Findings From Patients With MDR-TB Multiple factors increase patient acceptance and the use of MERM. For most patients, audible and visual signals served as helpful reminders to take medications. Forgetfulness is a common barrier to adherence [ 36 ]. Although often thought of as a cognitive problem, forgetfulness may also reflect other life challenges faced by patients, such as depression or spending long hours at work. In a qualitative study in India assessing the acceptance of 99DOTS, a cellphone-based DAT used to monitor patients with drug-susceptible TB, most patients reported that SMS text messages were not useful reminders to take medications because these messages were lost amid a high volume of spam SMS text messages [ 35 ]. In contrast, an advantage of the MERM was that the reminders drew patients to the site where medications were stored. This increased the likelihood that patients with MDR-TB immediately took their doses, which may promote habit formation in pill taking behavior [ 37 , 38 ]. In addition, the MERM’s reminders sometimes transformed household social dynamics by drawing family members into patients’ TB care, a finding also reported in studies of other DATs [ 35 ]. Patients appreciated aspects of the MERM’s design—in particular, the secure storage provided by the box, the labels to help patients take an appropriate number of tablets of each medication, and the organization of different medications facilitated by internal partitions. These features were valued in light of the complexity of MDR-TB treatment regimens, which include at least 4 or 5 different medications, as well as the fact that MDR-TB medications had previously been dispensed in a cardboard box without internal partitions to separate medications or labels to guide pill taking. In some patients, MERM enhanced their relationship with the health system. Most patients appreciated saving time and money by not having to visit the clinic as often because the frequency of routine clinic visits for patients with MDR-TB was reduced during the MERM pilot implementation. Although this resulted in decreased face-to-face interactions with HCPs, some patients actually described feeling more cared for. This feeling was derived from the perception that HCPs were remotely watching over their clinical progress, as well as from positive responses to actual phone or in-person outreach by HCPs, guided by patients’ adherence data. Previous studies evaluating the use of DATs to support HIV and TB treatment adherence in Uganda, India, and South Africa similarly found that remote monitoring enhanced some patients’ perceptions of the care provided by the health system [ 17 , 35 ]. This may be one of the behavioral pathways by which DATs may motivate patients to adhere to treatment. Patients also reported barriers to the acceptance and use of MERM. Some of these barriers may be modified by altering the MERM’s design or implementation ( Textbox 3 ). For example, the loud volume of the audible reminder—a common complaint from patients also reported in a previous study of the MERM from China [ 18 ]—could potentially be modified or the audible reminder disabled completely, ideally based on patients’ personal preferences. As another example, during pilot implementation, the MERM was made of commercial-grade cardboard, which did not wear well in India’s humid weather conditions. Redesigning the MERM using plastic would be feasible and minimize weather-related damage, although it would likely increase the cost of the device. Other technical problems, such as battery failure or inappropriate blinking of the reminder lights, could likely be addressed with product improvements in future iterations of the MERM. Recommendations for improving the Medication Event Reminder Monitor device and its implementation, based on findings from patients with multidrug-resistant tuberculosis and health care provider interviews. Design of the device