A Strategy for Making Clinical Trials More Successful

In a bid to make clinical trials faster, less costly, and more successful, Amgen is making adaptive trial designs its default setting for clinical research.

Normally, when you hear that a clinical trial was unsuccessful, you assume the drug being tested wasn’t very effective or safe.

In some cases, though, the drug itself might actually be pretty good, but the trial wasn’t designed in a way that would show its true effectiveness and safety.

In fact , designing a trial often involves at least some educated guesswork, so there’s always a risk of making a wrong assumption.

• The study might be too small or too short to show the drug’s real benefits.

• The doses you decide to test may be too low or too high.

• You may be wrong in assuming which types of patients the drug will help.

Since clinical trials are blinded to prevent bias, wrong assumptions may be hard to spot until the trial is finished. Even then, you can’t always know if a study failed because of the drug or the study design.

Fortunately, there are newer ways of designing clinical trials that let you change the design if the data you’re collecting supports that change. Depending on the rules you set before the study begins, you can:

• Eliminate doses that don’t look safe or effective.

• Make the trial larger or longer to better show the drug’s real impact.

• Learn which types of patients the drug really helps and bring in more of them.

Compared to conventional studies, these adaptive clinical trials have the potential to be faster, less costly, and better at showing a drug’s true risks and benefits.

They can help patients by stopping a study sooner if the test drug isn’t working, and they also enable promising drugs to move ahead more rapidly.

That’s why Amgen is using the latest statistical models and real-world data to design studies that are more flexible and informative.

It’s another example of how we’re applying the power of innovation to meet the needs of patients who are facing serious illness.

The world’s tallest structure, Dubai’s Burj Khalifa, cost $1.5 billion to build, which is roughly half the average cost of delivering a new medicine to patients. The price tag for new drug approvals has risen to roughly $2.6 billion, and $2.9 billion if you count the expense of required post-approval studies. The cost of success is so enormous because of all the money invested in drugs that fail: 90 percent of test drugs that enter clinical trials never get approved.

“The single biggest category of spending in R&D is clinical development, and the overwhelming majority of money spent on clinical trials goes toward programs that fail,” says Elliott Levy, senior vice president, Global Development. “As an industry, we need to increase the amount we spend on drugs that reach the market and decrease the amount we spend on those that don’t.”

To tackle this challenge, Amgen has placed a large bet on human genetics, which can help to pinpoint drug targets that are more likely to lead to new medicines. More recently, another promising strategy has emerged that could also boost success in the clinic by changing the way that clinical trials are designed.

“Many of us think of innovation as something that only happens in the laboratory,” said Elliott. “Clinical research is seen as more of a box-checking exercise, where we run fairly cut-and-dried randomized, placebo-controlled studies based on established protocols. But things are actually changing very rapidly in the world of drug development. Truly innovative methods for clinical trial design are maturing or mature.”

Moving from fixed to flexible study designs

In conventional clinical trials, the protocol of a study is set in stone before the first patient is enrolled. “The criteria for the patients you’re enrolling, the doses you test, the outcomes you measure, the study’s duration—all these things are established up front, and you execute the protocol without change,” said Elliott.

Elliott Levy, Senior Vice President, Global Development, Amgen

Newer methodologies, like adaptive clinical trials, are far more flexible. “With adaptive designs, you can monitor the incoming data and modify the protocol based on what you’re learning as the study unfolds,” Elliott noted. The potential changes need to be spelled out before the trial begins. If the pre-established criteria are met, you can make a range of adaptations, including

  • Dropping or adding doses. Eliminating doses that aren’t effective, differentiated, or safe can increase the value and efficiency of the study by allocating more patients to the more informative doses.
  • Increasing the size or duration of a trial, which gives the test drug a better opportunity to demonstrate its true impact.
  • Enriching the study population by adding more of the types of patients who respond to the treatment being investigated.

In addition to generating greater clarity around a test drug’s potential, adaptive designs can also benefit patients. “The sooner we can be confident that a drug or a dose of a drug either works or doesn’t work, the sooner we can either advance that drug or stop evaluating it in patients,” said Rob Lenz, vice president, Global Development. “To me, that’s a great example of patient centricity.”

Amgen’s R&D strategy highlights the role these approaches can play in accelerating drug development and increasing the probability of success. To implement this new aspect of the strategy, Global Development created a new organization last year. The Center for Design and Analysis (CfDA) was established to evaluate advanced trial designs and perform the modeling and simulations needed to support this work. The center includes new departments focused on Data Science, Design and Innovation, and Biostatistical Science.

“Simulating clinical trials can’t make a drug work if it isn’t going to work, but it can help you design an optimized trial with the highest likelihood of providing meaningful and actionable answers.”
Rob Lenz

“We decided to centralize these capabilities so that they can be deployed to all product teams, not just the teams that already happened to have this capability,” said Rob, who heads the CfDA. “These methods can give us the right amount of information to make a decision—not too much and not too little.”

Amgen has doubled down on the new capabilities by launching a major culture and capabilities-focused initiative to accelerate their adoption. “We see these methodologies as critical to our mission of serving patients,” said Cathy Critchlow, a vice president who leads Amgen’s Center for Observational Research. “By reducing spending on programs that will ultimately fail, we can pursue more promising programs than would be possible under the traditional model for clinical research.”

Improving speed and success while reducing cost

In conventional clinical development programs, tradeoffs are required if you want to prioritize speed, or cost, or likelihood of success. “To optimize for success, you often accrue more data at each stage of the program, but that makes the program go slower,” said Elliott. “Optimizing for cost by staging your investment also slows you down, while optimizing for speed tends to drive up the cost. With adaptive designs, we can simultaneously increase our odds of success, reduce our spend, and get to an answer more quickly. That’s what makes these new methodologies so attractive.”

Adaptive designs can boost the odds of success by correcting assumptions that may otherwise obscure a drug’s true potential. “In designing any clinical study, we need to make assumptions,” Rob observed. “We assume the patients will look a certain way; the disease will progress at a certain rate; the doses will perform a certain way; the treatment effect will be a certain amount. Invariably, some assumptions are wrong. That’s why we’re running the trial—to learn these things.”

Feature How Real-World Data is Transforming Drug Development

The risk is the wrong assumption can sink a drug that might otherwise have succeeded. “It’s hard to say what proportion of drug development failures are due to avoidable flaws in trial design, but it’s probably substantial,” said Rob. A few years ago, the FDA published an analysis of the agency’s reasons for delaying or denying approval to 150 new drug submissions received from 2000 to 2012. That analysis pointed to “several potentially preventable deficiencies, including failure to select optimal drug doses and suitable study end points” as major factors in failures and delays.

By providing a mid-course assessment of a clinical trial’s performance, adaptive designs allow for course corrections that may lead to improved results. “In the past, a lot of failures were due to picking the wrong drug targets,” Elliott noted. “As we get better at picking targets by using human genetics, clinical trial design will become the next variable we need to optimize to improve success rates.”

Making adaptive designs Amgen’s default approach

While the concept of adaptive clinical trial design has been around for some time now, adoption of the new paradigm has been slow, at least until recently. “These methods haven’t really taken off in the industry yet because they’re still seen as novel and risky, and it’s easier to default to familiar methods,” Elliott said. “At Amgen, we’ve come to recognize that there’s a much larger risk in not deploying methods that can get medicines to patients faster and more reliably. All of these techniques can increase a trial’s probability of success, and we intend to use them every chance we get.”

Toward that end, Amgen has also enhanced its capabilities in the field of clinical trial modeling and simulation. Simulations can model variables such as the rate of patient recruitment, the time it will take for the drug to have an impact, the size of the impact, etc. The goal is not to predict the study’s results, but rather to show how different study designs will perform under different scenarios.

“With simulations, you may find that the design option that looks the worst is actually the best and can give you an answer faster, at less cost, and with equal or higher odds for the trial’s success.”
Elliott Levy

“Clinical trial modeling is really no different from what you do when you want to shoot a new rocket into space,” said Rob. “You simulate all sorts of weather conditions, fuel consumption, and other variables to design a rocket that performs optimally under a range of conditions. Simulating clinical trials can’t make a drug work if it isn’t going to work, but it can help you design an optimized trial with the highest likelihood of providing meaningful and actionable answers.”

Results from simulations can be surprising and counterintuitive, Elliott said. “As an experienced drug developer, you imagine that you can look at different design options and quickly pick the one that makes the most sense. With simulations, you may find that the design option that looks the worst is actually the best and may give you an answer faster, at less cost, and with equal or higher odds for the trial’s success.”

Adaptive designs are now being used in a number of mid-stage programs in Amgen’s pipeline, including tezepelumab (for atopic dermatitis); AMG 570, a bispecific antibody-peptide conjugate under development for lupus; and AMG 592, an IL-2 mutein Fc fusion protein being investigated for various autoimmune diseases. Amgen’s goal is to use modeling and simulation to inform the design of all of its clinical studies and to use adaptive designs in most studies.

Better data, regulatory openness

Several external factors are making adaptive trials more practical and attractive. The data needed for accurate simulations comes from two sources, both of which are becoming more abundant and reliable. They include real-world data collected from electronic health records and other sources, and patient-level data acquired in previous clinical trials. Data from previous studies have only become available recently through industry collaborations, including the Placebo Standard of Care initiative sponsored by TransCelerate. “These data can help us to estimate the true amount of patient-to-patient variability we’re likely to see in a trial we’re planning,” said Elliott. These insights can help to predict when the data collected in a study will be mature enough to guide adaptive decisions.

The 21st Century Cures Act, passed in 2016, requires the FDA to provide updated guidance on how companies can use adaptive trial designs in a way that satisfies the agency’s evidence standards. “Senior people at the FDA are very open to the idea of what they call simple adaptive designs, and there’s also a growing openness to more complex adaptive designs,” said Rob

One of Global Development’s top priorities now is ensuring that Amgen staff get the training and support they need to adopt the new methods as rapidly as possible. “Intellectually, people understand the new direction and they are enthusiastically behind it,” said Rob. “But there’s still some demystification that needs to be done.”

“We need our physicians and statisticians to know that we encourage them to adopt these methodologies, and they will be honored for their efforts even in cases where the outcome isn’t successful,” Elliott said.

In the long run, Elliott added, Amgen’s scale should give it an edge in the race to reap the benefits that adaptive trial designs can provide. “In very big companies, it’s difficult to rapidly engage the entire organization behind a significant change such as the adoption of innovative clinical trial methodologies. Smaller companies can move more quickly, but may not have the resources and the expertise to make this sort of change. At our scale, Amgen can combine the advantages of big and small organizations.  We are big enough to put considerable muscle behind innovative methodologies, and small enough to move quickly and nimbly. So I’m very optimistic about our prospects to become an industry leader here.”

Subscribe for the latest from Amgen Science.

System error message. Lorem ipsum.
I authorize Amgen and its contractors to use my email address and provide me with updates, informational material, and/or contact me about Amgen Science. I understand that my email address will not be used for any other purposes. I understand that receiving these communications is optional and free and that I have the ability to opt out at anytime. For more information, please see the Amgen privacy policy.