Skip to main content

statswork

Stronger Analysis. Smarter Research. Bigger Savings!
Access expert statistical analysis and research support at Flat 24% Off
Stronger Analysis. Smarter Research. Bigger Savings!
Access expert statistical analysis and research support at Flat 24% Off.

The G-BA Allows More Than One Comparator: Which One Should Your Trial Statistics Be Built Around?

Summary

When several therapies qualify as appropriate comparator therapies (zweckmäßige Vergleichstherapie, zVT), sponsors must determine which comparator-specific claims their evidence must support. Multiple comparators do not automatically require separate trials. The design depends on clinical relevance, available evidence, and the statistical requirements of each intended claim.

Start With the Legal Classification

Section 6(2a) AM-NutzenV allows additional benefit to be demonstrated against each of several equally appropriate comparator therapies, subject to §35a(1) SGB V. It permits comparator-specific demonstrations; it does not prescribe the number of trial arms or guarantee that a particular design will establish additional benefit. [1, 3]

Sections 5(2) and 5(3) distinguish therapeutic improvement for eligible medicines comparable to fixed reference-price medicines from additional-benefit assessment against the appropriate comparator therapy. [2]

For orphan medicines, additional benefit is generally deemed established upon marketing authorisation. However, comparative-evidence obligations can arise when the statutory turnover threshold is exceeded, and the G-BA may require application-accompanying data collection under §35a(3b) SGB V. Assess the individual medicine’s turnover, pathway, and applicable evidence obligations before finalising the protocol. [3]

Translate Each Comparator into an Evidence Requirement

Create a comparator-specific evidence matrix before selecting trial arms.

Evidence field

Planning question

Population and setting

Does the evidence cover the relevant patients and treatment line?

Endpoints

Are patient-relevant outcomes appropriately assessed?

Direct evidence

Is a relevant randomised comparison available?

Estimand and analysis

Are the treatment effect, analysis population, and methods prespecified?

Table 1: Comparator-Specific Evidence Requirements

Identify gaps such as missing endpoints, excluded subgroups, and differences in treatment setting. Separate missing clinical evidence from statistical deficiencies: the former may require new or indirect evidence, while the latter may require redesign or additional analyses.

Choose and Frame the Trial Design

Select the design according to the claims that must be supported.

  • Two-arm trial: Suitable when one comparator addresses the principal claim and other questions can be answered using adequate existing evidence.
  • Multi-arm trial: Consider when several comparators can be studied in the same population under a common protocol.
  • Separate trials: Consider when populations, treatment settings, or clinical requirements are incompatible.
  • Indirect comparison: Consider when direct evidence is unavailable or insufficient and the evidence network supports a credible estimate.

A multi-arm trial can improve comparability through common eligibility criteria, follow-up, and endpoint definitions. However, a shared experimental arm creates correlated pairwise estimates, and multiple confirmatory comparisons require the multiplicity strategy.

For example, a three-arm trial comparing treatment A with comparators B and C can estimate A versus B and A versus C directly. The protocol must specify whether both comparisons must succeed, how type I error will be controlled, and whether the sample size supports each claim.

Design

Main advantage

Main concern

Two-arm

Focused comparison

Other comparators may remain unaddressed

Multi-arm

Consistent study conduct

Multiplicity and joint power

Separate trials

Tailored populations

Between-trial heterogeneity

Indirect comparison

Reuses existing evidence

Transitivity and imprecision

Table 2: Trial-Design Options for Multiple Comparators

Prespecify hypotheses, estimands, endpoints, success criteria, missing-data strategies, and sensitivity analyses.

German HTA statistical analysis

Plan Multiplicity and Power Together

Testing multiple hypotheses without appropriate control can inflate the probability of a false-positive conclusion. Bonferroni adjustment controls family-wise error by dividing the significance level across comparisons. Holm’s procedure also controls family-wise error and is generally less conservative. Hierarchical testing is an option when the sequence is justified and prespecified.

For a time-to-event comparison with a target hazard ratio (HR) of 0.75, two-sided α = 0.05, and 80% power, the Schoenfeld approximation gives approximately 379 required events, assuming proportional hazards and equal allocation between the two groups. [4]

With two comparisons and Bonferroni-adjusted α = 0.025 per comparison, the requirement rises to approximately 460 events per comparison, assuming the same target HR and marginal power.

These figures are approximate and are not additive. In a three-arm trial with equal randomisation and comparable event contributions, 460 events per pairwise comparison correspond to approximately 690 total trial events. Each comparison includes events from two arms, and events in the shared experimental arm contribute to both comparisons. Unequal allocation, different event rates, censoring, and follow-up can change the total requirement.

Finally, 80% power for each comparison does not guarantee an 80% probability that both succeed. If both claims must be demonstrated, assess joint power analytically or through simulation.

Decide Whether Indirect Evidence Can Fill a Gap

Section 4(7) AM-NutzenV permits indirect comparisons in the dossier when direct comparative studies are absent or insufficient to support conclusions about additional benefit. Submission does not guarantee acceptance or establish additional benefit. [5]

Anchored indirect comparisons rely on transitivity: differences between studies must not systematically distort relative treatment effects. Assess populations, effect modifiers, endpoints, follow-up, and study designs. The Bucher method cannot correct important population differences. [6]

Population-adjusted methods such as matching-adjusted indirect comparison (MAIC) and simulated treatment comparison (STC) may help when individual patient data are available for one study and aggregate data for another. In MAIC, a reduced effective sample size indicates limited population overlap and lower precision. Neither method eliminates bias from unmeasured effect modifiers. A changed estimate after adjustment is a sensitivity finding, not proof that population differences caused the original result. [7]

Align EU JCA Evidence with German Requirements

European joint clinical assessment (JCA) can support evidence reuse but does not replace the German AMNOG assessment.

Under §4(2a) AM-NutzenV, when a European dossier has been submitted and the joint clinical assessment has not been discontinued under Article 10(6) of Regulation (EU) 2021/2282, the sponsor must identify, by reference, which evidence from that dossier should form the basis of the German benefit assessment. This requirement does not mean every European assessment automatically triggers the same obligation. [5, 8]

Map the referenced evidence to German patient groups, comparators, endpoints, and analyses. Document missing outcomes or subgroup results and identify additional analyses where necessary. Evidence reuse does not guarantee that the material answers every German comparator-specific question.

Apply a Practical Trial-Planning Sequence

  1. Confirm the assessment pathway and appropriate comparators.
  2. Define the additional-benefit claims and required comparisons.
  3. Map populations, settings, endpoints, estimands, and available evidence.
  4. Compare two-arm, multi-arm, separate-trial, and indirect approaches.
  5. Prespecify hypotheses, multiplicity control, and sensitivity analyses.
  6. Calculate per-comparison events, total trial requirements, and joint power.
  7. Assess indirect-comparison assumptions and map EU JCA evidence to German requirements.

How Statswork Can Help

Statswork’s Statistical and Biostatistical Services support comparator-specific estimand development, trial-design evaluation, sample-size and joint-power calculations, multiplicity planning, subgroup analyses, and indirect-comparison diagnostics. These services help sponsors identify evidence gaps before protocol decisions become difficult to change.

Conclusion

Multiple appropriate comparators create distinct evidence questions, not automatic requirements for separate trials. A suitable design links each benefit claim to the relevant comparator, evidence, and statistical analysis. Multiplicity control, adequate event counts, and joint-power assessment help determine whether a trial can support its claims. Indirect comparisons and EU evidence reuse may help, but neither guarantees sufficient evidence for German AMNOG assessment.

References:

  1. . Arzneimittel-Nutzenbewertungsverordnung [AM-NutzenV], § 6. (n.d.). Appropriate comparator therapy. https://www.gesetze-im-internet.de/am-nutzenv/__6.html 
  2. Arzneimittel-Nutzenbewertungsverordnung [AM-NutzenV], § 5. (n.d.). Additional benefit. https://www.gesetze-im-internet.de/am-nutzenv/__5.html
  3. Sozialgesetzbuch (SGB V), § 35a. (n.d.). Benefit assessment of medicinal products with new active ingredients. https://www.gesetze-im-internet.de/sgb_5/__35a.html
  4. Schoenfeld, D. A. (1983). Sample-size formula for the proportional-hazards regression model. Biometrics, 39(2), 499–503. https://doi.org/10.2307/2531021
  5. Arzneimittel-Nutzenbewertungsverordnung [AM-NutzenV], § 4. (n.d.). Dossier requirements. https://www.gesetze-im-internet.de/am-nutzenv/__4.html
  6. Bucher, H. C., Guyatt, G. H., Griffith, L. E., & Walter, S. D. (1997). The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. Journal of Clinical Epidemiology, 50(6), 683–691. https://doi.org/10.1016/S0895-4356(97)00049-8
  7. Phillippo, D. M., Ades, A. E., Dias, S., Palmer, S., Abrams, K. R., & Welton, N. J. (2018). Methods for population-adjusted indirect comparisons in health technology appraisal. Medical Decision Making, 38(2), 200–211. https://doi.org/10.1177/0272989X17725740
  8. Gemeinsamer Bundesausschuss. (n.d.). EU HTA and national benefit assessment. https://www.g-ba.de/themen/arzneimittel/arzneimittel-richtlinie-anlagen/nutzenbewertung-35a/eu-hta-verordnung/#english-version

Contact us