Open-source automated insulin delivery in type 1 diabetes

Abstract

Background

Open-source automated insulin delivery (AID) systems are used by many patients with type 1 diabetes. Data are needed on the efficacy and safety of an open-source AID system.

Methods

Download a PDF of the Research Summary.

In this multicenter, open-label, randomized, controlled trial, we assigned patients with type 1 diabetes in a 1:1 ratio to use an open-source AID system or a sensor-augmented insulin pump (control). The patients included both children (defined as 7 to 15 years of age) and adults (defined as 16 to 70 years of age). The AID system was a modified version of AndroidAPS 2.8 (with a standard OpenAPS 0.7.0 algorithm) paired with a preproduction DANA-i insulin pump and Dexcom G6 CGM, which has an Android smartphone application as the user interface. The primary outcome was the percentage of time in the target glucose range of 70 to 180 mg per deciliter (3.9 to 10.0 mmol per liter) between days 155 and 168 (the final 2 weeks of the trial).

Results

A total of 97 patients (48 children and 49 adults) underwent randomization (44 to open-source AID and 53 to the control group). At 24 weeks, the mean (±SD) time in the target range increased from 61.2±12.3% to 71.2±12.1% in the AID group and decreased from 57.7±14.3% to 54.5±16.0% in the control group (adjusted difference, 14 percentage points; 95% confidence interval, 9.2 to 18.8; P<0.001), with no treatment effect according to age (P=0.56). Patients in the AID group spent 3 hours 21 minutes more in the target range per day than those in the control group. No severe hypoglycemia or diabetic ketoacidosis occurred in either group. Two patients in the AID group withdrew from the trial owing to connectivity issues.

Conclusions

In children and adults with type 1 diabetes, the use of an open-source AID system resulted in a significantly higher percentage of time in the target glucose range than the use of a sensor-augmented insulin pump at 24 weeks. (Supported by the Health Research Council of New Zealand; Australian New Zealand Clinical Trials Registry number, ACTRN12620000034932.)

First-of-Its-Kind Study Compares Open-Source Automated Insulin Delivery to Sensor-Augmented Pump Therapy

Results from the CREATE Trial demonstrated open-source automated insulin delivery (AID) systems are a safe and effective therapy for people with type 1 diabetes. Findings from the randomized controlled trial (RCT) comparing open-source AID to sensor-augmented pump therapy (SAPT) were presented today at the 82nd Scientific Sessions of the American Diabetes Association® (ADA).

Open-source AID systems were developed to reduce the burden of living with diabetes by combining an insulin pump, continuous glucose monitor (CGM), and an algorithm that automatically adjusts insulin delivery every five minutes to keep glucose levels in target range. The technology was developed by people with diabetes and shared openly, commonly referred to as open-source, so that others could evaluate the system and choose to use it themselves. These open-source systems were available for years before commercial AID systems and are used by people with type 1 diabetes worldwide. 

The CREATE Trial is the first randomized controlled trial to evaluate the safety and efficacy of the most commonly used open-source AID system. The study compared open-source AID, using the OpenAPS algorithm from a version of AndroidAPS implemented in a smartphone with the DANA-i™ insulin pump and Dexcom G6® CGM, to SAPT. A diverse population of patients, many of whom had little or no experience with AID, were recruited to a 24-week, multi-center RCT, which included children (7–15 years) and adults (16–70 years), to examine efficacy and safety of open-source AID. 

Results of the trial included:

  • The primary outcome was the percent of time in target sensor glucose range (TIR; 3.9-10 mmol/L [70-180 mg/dL]) between open-source AID and SAPT during the last two weeks of the RCT.
  • Both children and adults achieved more time in range (TIR), when using the open-source AID system compared to treatment without automation (SAPT).
    • 97 patients (48 children and 49 adults) were randomized.
    • The overall treatment effect resulted in a 14% difference in TIR, favoring the open-source AID treatment group.
    • Mean TIR (±SD) at study end was 74.5±11.9% using AID (Δ+ 9.6±11.8% from run-in; P<0.001) for adults and 67.5±11.5% (Δ+ 9.9±14.9% from run-in; P<0.001) for children. TIR did not improve in the SAPT group.
    • 60% of participants using open-source AID met the TIR target set by international guidelines of >70%, compared to just 15% in the SAPT arm.
    • Only two participants withdrew from AID due to hardware issues.
    • No severe hypoglycemic or diabetic ketoacidosis events occurred in either treatment group. There was no increase in overall hypoglycemia.
    • The improvement in time in range in both children and adults using open-source AID was immediate and sustained for the study duration.

“We were encouraged to see the greatest improvements in time in range were in those who had the lowest time in range at the start of the study. This supports the finding that a wide range of people with diabetes who want to use this technology could benefit from it, regardless of their outcomes with previous therapies,” said Dana Lewis, diabetes researcher, a founder of the open-source artificial pancreas movement, OpenAPS, and study investigator. 

“While open source AID is not yet approved by the FDA, we know people worldwide are using it to manage their diabetes. Our findings demonstrate that this is a safe and effective technology and adds to the body of evidence supporting use of open-source AID for improving glycemic outcomes,” commented Dr. Martin de Bock, pediatric endocrinologist at the University of Otago, Christchurch, New Zealand, and lead investigator of the study.

The authors hope these findings provide both people with diabetes and clinicians with additional information to use when evaluating open-source AID options for people living with diabetes. 

Research presentation details:
 

Dr. de Bock, in conjunction with study investigators, presented the findings of the trial during the oral presentation listed below: 

  • The CREATE Trial: Randomized Clinical Trial Comparing Open-Source Automated Insulin Delivery with Sensor Augmented Pump Therapy in Type 1 Diabetes
  • Presented on Monday, June 6 from 2:15–2:30 p.m. CT

L

deFor more information, please contact the ADA Scientific Sessions media team onsite at the Ernest N. Morial Convention Center from June 3–7 by phone at 504-670-4902, or by email at [email protected]

# # #

Access Denied

Your access to the NCBI website at www.ncbi.nlm.nih.gov has beentemporarily blocked due to a possible misuse/abuse situationinvolving your site. This is not an indication of a security issuesuch as a virus or attack. It could be something as simple as a runaway script or learning how to better use E-utilities,http://www.ncbi.nlm.nih.gov/books/NBK25497/,for more efficient work such that your work does not impact the ability of other researchersto also use our site.To restore access and understand how to better interact with our siteto avoid this in the future, please have your system administratorcontact [email protected]

To the Editor: Burnside et al. (Sept. 8 issue)1 report the superiority of an open-source automated insulin delivery (AID) system over a commercial sensor-augmented insulin pump with respect to glycemic control in patients with type 1 diabetes who were enrolled in a multicenter, randomized, controlled trial. The open-source AID system is an innovative way to refine insulin-delivery algorithms and is cost-effective; nevertheless, these systems lack regulatory approval.2 A previous descriptive study was biased because the highly motivated and technology-adept patients had selected the open-source AID system.3 The current trial overcame such selection bias through randomization. However, there were some deficiencies . . .

Do-It-Yourself (DIY) automated insulin delivery (AID) solutions use continuous glucose sensors, open source software running on a smartphone, and insulin pumps to create systems that deliver insulin continuously in response to changes in subcutaneous glucose. The algorithm code is available to download from freely available software development platforms such as GitHub which host non-executable code. Implementation of the systems is supported by on-line guides, peer support from expert users and developers, and in some cases, at DIY AID meetings. Increasing uptake of these systems has highlighted the legal, ethical, technical and policy challenges for the diabetes community.

Position statements from Diabetes UK,1 Diabetes Australia2, and The UK Juvenile Diabetes Research Foundation (JDRF)3 have addressed the increasing uptake of “Do-It-Yourself (DIY)” automated insulin delivery (AID) solutions for people living with type 1 diabetes (T1DM). These statements differ slightly in some aspects but are clear that, while people with T1DM using open solutions should have access to appropriate multidisciplinary medical support and education, the systems themselves are not approved medical products that are underpinned by an evidence base for safety or efficacy, and their use renders device warranties invalid. The statements are also clear that open source systems cannot be endorsed by their authors. Concurrently, JDRF is working with partners in industry to enable the development of DIY AID systems4 while the rapid pace of recent advancements in diabetes technologies suggests that multiple AID systems will be commercially available in the near future.

From the published reports of selected user cohorts, and from anecdotal evidence, clinically meaningful benefits in glucose outcomes, and reductions in self-management burden are possible with DIY AID systems: HbA1c, time in range (TiR), and improvements in sleep were reported by an early selection of users in 2016,5 and an update of the data two years later – including selected reports of national use in Italy and Korea – suggested the same benefits.6 Self-reported data of DIY AID users in social media suggest similar improvements in glucose control, diabetes burden and quality of life.7 However, these reports lack baseline data and are subject to a considerable selection bias.8 A more recent analysis of clinical data from 34 DIY AID users included baseline data using sensor-augmented pump therapy and suggested clinically meaningful improvements in TiR, HbA1c, hypoglycaemia, and glucose variability but were again taken from a small, highly selected patient group.9 The Open Project, funded by the European Union, is undertaking further research including the DIWHY Survey into motivations, barriers and retention of DIY AID in the real world.10

At present, the clinical governance, regulatory, and medico legal status of DIY AID is unknown. There is no system established for systematic documentation of adverse events and no data are collected appropriately to evaluate safety and efficacy in a broad base of users. For DIY AID, squaring the circle of regulation, governance, medicolegal status, ethics, and personal choice is a novel challenge, and is one that has only recently been enabled by improvements in continuous glucose monitoring (CGM), wireless and processing bandwidth, and insulin pumps.11 No single group of professionals or users can address this challenge alone – a collaborative approach is required. In this perspective, we explore some of the ways that a multidisciplinary approach may unlock the potential for open source solutions to be implemented more widely for people with T1DM in a way that is acceptable to all stakeholders, while ensuring sensitivity to the priorities of existing users.

Data

Wider implementation, support and funding of open source systems for people with T1DM depend wholly on data demonstrating safety and effectiveness. Ideally, health economic evaluation including clear inclusion criteria will also be available in due course. In order to achieve this a robust data collection system must be established to independently collate data at a national, or preferably international level, with associated resources required to achieve this. Data are already voluntarily collected from some users of OpenAPS, but the repository is limited to times when the system is operational and does not include entry (or exit) data12 − a prospective dataset must include key glucose and non-glucose outcomes from before and after the use of open source systems. An example of this is the Swedish National Diabetes Register13 and it may additionally be feasible to extract data from established electronic health records for users of DIY systems.

An open, rolling data collection system enabling longer term follow-up is critical, along with baseline demographics to enable identification of characteristics most associated with improvements in meaningful outcomes. This necessitates moving beyond early adopters and highly engaged patients to include data more representative of the wider population of people with T1DM. In keeping with the ethos of the open source, community data could potentially be collected remotely from users and healthcare teams as part of usual care. As with all T1DM interventions, understanding the groups of people that receive greatest benefit from DIY AID systems is important and data collection that enables identification of those groups would be powerful. Baseline data collection should therefore extend beyond glycaemic status and basic demographics to include frequency, severity and awareness of hypoglycaemia, psychosocial wellbeing and complication status.

Importantly, any prospective data collection system must also include an adverse event reporting tool, open to users and healthcare teams, with standardised nomenclature for events. An online or anonymous hotline system for users could be established for adverse event reporting and to offer formalised user support. Clinicians involved in the care of people using DIY AID systems should consider that, in many territories, they have a legal obligation to report safety issues to their local health or regulatory authorities. Severe hypoglycaemic events have, without doubt, occurred in people using a DIY AID system, but at present there is no mechanism to report this. A recent FDA notice was sent warning of an adverse event which had been reported while using a DIY AID system.14 While anecdotal reports exist, the lack of a formal reporting system remains a legitimate concern regarding these systems. Finally, open publication of the data must be built in to the system, ideally in real-time or near real-time, as with the Open Prescribing reporting system,15 ensuring users and stakeholders are able to view aggregated data in a transparent way.

Education

Diabetes technology is an adjunct to support and education, and its impact on glucose outcomes is dependent on self-management actions. It is therefore critical in a DIY AID implementation that appropriate education is provided, both to users (where allowable by the medicolegal framework), and to healthcare professionals.

As with all T1DM interventions, an in-depth understanding of the clinical impact, and mechanism of action of DIY AID, is important for healthcare professionals. Previous models of healthcare professional education, dependent on experience gained in clinical scenarios may not be sufficient for technologies used by a small number of people. For effective implementation, centres of expertise may be required to deliver services, and to train healthcare professionals to understand, and to appropriately support, DIY AID in a hub-and-spoke model. Integrated automated solutions will, over time, become standard of care but safe implementation, as with all invasive procedures, requires familiarity and frequent exposure. Healthcare professional expertise can be a limiting factor in technology uptake16,17 and expertise in established technologies may need to be addressed before DIY AID systems can be widely supported.

As with insulin pump therapy, CGM, and insulin pen usage, user and caregiver education is critical to ensure safe and effective use. Healthcare professionals spend a relatively small amount of time with people living with T1DM meaning that achieving optimal outcomes is dependent on empowering people to make treatment decisions in real time and not only at each clinical interaction. Using DIY AID requires an in-depth understanding of the settings which include basal rates, insulin: carbohydrate ratio, insulin sensitivity factor, and insulin on board. These concepts are included in evidence based structured education programmes18 but may require refreshment, as well as support for more complex and adaptable settings and additional tools to enable dynamic changes. At present, a blended model of user education exists with the responsibility for structured education resting with clinical teams and automated insulin delivery support provided by peers. Delivery of structured education is supported by international standards of care19,20,21,22 and is a key component of a T1DM clinical service – its importance is not diminished by AID, but is likely to be enhanced to ensure maximal value is extracted from a complex ecosytem. The ability of the user to understand and adjust the parameters of their open-source platform should be considered when assessing a system’s suitability. Structured education programmes will need to be adapted over time to meet the needs of AID, as has occurred with the evolution of the DAFNE programme to include pump therapy and hypoglycaemia awareness training.23 Creation of an AID specific education curriculum, based on evidence-informed training such as DAFNE would enable support and education to be delivered with quality assurance and auditable standards.

Policy

Widespread implementation of any intervention requires supportive policy to ensure equitable access in line with the evidence base for clinical, and cost, effectiveness. Parallel to frequently reported clinical outcomes, DIY AID systems require policy to assess prioritisation and funding.

At present, open source systems are dependent on a combination of health service, insurer, and personal funding for an insulin pump, insulin pump consumables, CGM system, and insulin. Data for the payer funded contribution to open systems is not available and payer support for commercially available (hybrid) AID systems (for example the Medtronic 670G24) is dependent on local contracting arrangements. This blended funding model, along with an absence of high quality evidence for glucose outcomes and adverse events, makes assessment of the health economic case for DIY AID systems challenging. Generation of larger, more comprehensive datasets, especially if linked to healthcare utilisation through electronic health records, would enable estimation of the cost effectiveness case for DIY systems which would support policy and regulation.

Previous reports have highlighted variation in access to technologies.25 Evidence-based policy to underpin commissioning of systems for people likely to derive clinically important benefit is critical to wider equitable adoption of an open architecture, with funding transparently attached to that. Independent review through health technology appraisal bodies such as the European Network for Health Technology Assessment would then be feasible, providing robust policy support.

Ethical and legal responsibility

The ethical, legal and governance structures underlying DIY AID systems are, at present, unknown and complex, with local variance. To enable equitable access for people living with T1DM, a multi-agency approach is required to assess the risks, and to define clinician, regulatory and manufacturer responsibility and accountability. This needs people with T1DM, health services, lawyers, payers, indemnity and defence organisations, regulators, and industry representation (from device and pharmaceutical manufacturers) to agree a clear governance framework.

In order to facilitate this there is an additional responsibility on the creators of DIY AID systems to seek peer-review of algorithms and interventions. As with any T1DM treatment, peer-review ensures transparency, a referenceable standard, reproducible data, and clarity of expected outcomes. It also allows others to objectively appraise it. In a technical architecture where software versions may be frequently updated, the traditional model of testing, evaluation and publication may not be fit for purpose and newer publication models, such as the open science repository model,26,27 may be more appropriate, with a master framework published in a peer-reviewed format. All published algorithms should share a pre-defined validation metric such as standardised in silico28 testing to enable cross-comparison.

A legal evaluation of DIY AID systems was undertaken in Germany (commissioned by the German Diabetes Association), exploring the medical, criminal and civil law implications in July 2018.29 The detailed response included the following recommendations:

  • The assembly of a DIY AID system is not a criminal offence. However, as the intended purpose of the devices is violated, there is no liability on the part of the manufacturers of the medical devices.

  • People who build DIY AID systems and transfer them to other patients are liable to prosecution under the Medical Devices Act in Germany. The placing on the market, and commissioning of such a system are prohibited. The person who builds and transfers the system is responsible under the Product Liability Act.

  • Healthcare professionals do not have to refer people with T1DM to open source systems.

  • If a person with T1DM expresses interest in such a system or is already using it, the healthcare professional must inform the patient of the improper use of a medical device and of the associated risks, documenting this appropriately.

  • Healthcare professionals should not offer a platform for exchange of DIY AID systems or training – this may be viewed as an application of a medical device contrary to its intended purpose.

  • If a healthcare professional trains people to use DIY AID systems, they become the operator of a medical device with potential liability consequences under the Medical Devices Act.

  • If a healthcare professional links DIY AID user experts with people with T1DM, they may be prosecuted for placing medical devices on the market without CE marking.

  • If medical devices are used contrary to their intended purpose, healthcare professionals are not liable to prosecution under the Medical Devices Act. Under certain conditions, however, criminal liability may be considered for negligent killing or negligent injury.

  • Healthcare professionals are obliged to inform users about the intended use of medical devices.

  • Healthcare professionals must point out the dangers that may arise when using a DIY AID system and should clearly distance themselves from the use of an open system and not encourage patients to use the system.

This legal review is only applicable in Germany, but is an excellent example of providing medicolegal clarity to developers, users and healthcare professionals and serves as a model for other territories to follow.

It is also important to consider the insulin used in AID systems and whether present licensing and prescribing is appropriate. Most insulin prescriptions are completed by primary care and clarity over prescribing in line with local licensing may be required to ensure prescriptions for AID meet local prescribing standards. While governance for prescription, dispensing and use of insulin is held by the healthcare professional, pharmacist and user, there may be additional pharmacovigilance responsibilities for insulin manufacturers which cannot be met when insulin is used in unlicensed systems, and inclusion of insulin manufacturers as a stakeholder in the development of DIY AID reporting systems is critical.

Technology

The United States Food and Drugs Administration (FDA) has introduced the interoperable CGM (iCGM)30 and alternate controller enabled (ACE) pump standards31 which include accuracy and interoperability standards for future automated insulin delivery. At the time of writing, one CGM system and two insulin pumps meet those special measures, and no interoperability standards for a controller have been defined, though it is likely that a controller standard will be created. International work to replicate this may enable open source systems to be available alongside others with an identical level of regulation and, where allowed by manufacturers, for them to be integrated with off-the-shelf components. Currently, some open source systems rely on legacy insulin pumps that are no longer supported, and unauthorized software to link components which were never designed to be compatible. Vulnerabilities in legacy insulin pumps have been highlighted by cyber security experts,32 leading to a security bulletin for some devices by the manufacturer.33 Older equipment and unlicensed software solutions should be replaced with modern equipment and validated communications to support a safer underlying framework for open source systems.

However, while interventions and regulatory standards may mitigate some future challenges, personal choice and availability may still drive open source innovation, and systems may continue to sit outside of enhanced standards of interoperability. Currently, manufacturers of interoperable systems remain more focused on commercial partnerships than on open source development. There is, however, some exploration into how these pathways could be leveraged by the open source community.34 How these systems are classified and regulated will remain a challenge to be addressed and, while the FDA model is one to aspire to and has received advocacy and commercial support, it does not wholly address the issue of DIY AID, and is only applicable in the United States. Implementation of a similar system or wider adoption of the FDA model internationally would accelerate access to all AID systems and would enable more rapid data collection to demonstrate clinical and cost effectiveness.

Future Steps

AID remains a target for people with T1DM, for healthcare professionals, and for the medical device industry. Open source innovation has driven increased uptake of AID solutions, but implementation challenges exist throughout the pathway, with undefined risks to users, healthcare professionals and commercial stakeholders. A multidisciplinary approach including an assessment of regulatory hurdles is required to solve these challenges for all stakeholders. In order to progress the following are required:

  1. 1.

    Creation of an open access prospective data collection tool that includes adverse event reporting and is available to users and healthcare teams. Endpoints should include overall glycaemia (measured by time spent in range 3.9 to 10 mmol/L as well as HbA1c);35 time spent in hypoglycaemia (<3.0 mmol/L);36 the frequency of severe hypoglycaemia; hypoglycaemia awareness and fear; a measure of self-management confidence; quality of life, and a measure of diabetes distress as a minimum. Inclusion of data collected before initiation of AID is critical.

  2. 2.

    Comprehensive data entry by users and healthcare teams, including those not regularly interacting with a specialist team. Data entry must include positive and negative experiences, as well as by those that discontinue DIY AID.

  3. 3.

    Frequent data reporting from the longitudinal dataset which must include potential safety signals reported in the MHRA,37 EUDAMED,38 and MAUDE data bases.39

  4. 4.

    A peer-reviewed framework for all algorithms, including a standardised in silico dataset.

  5. 5.

    Establishment of specialist AID centres to provide quality assured healthcare professional and patient education in a hub and spoke model.

  6. 6.

    Dynamic central policy that reflects the evidence base for clinical, and cost, effectiveness and is linked to funding.

  7. 7.

    A multi-agency approach to regulation, ideally starting immediately and including an independent legal review, with clearly defined goals and responsibilities to address interoperability standards and to manage systems that operate outside of those standards. Efforts at a national and international level will be required with devolved leadership groups in each territory.

Written by Jane