Table 3

Empirical proportion of trials that randomize in the wrong direction

ScenarioEfficacy of groupProbability (groupi is larger than groupj)
Group 2Group 3Group 4Group 2 > group3Group 2 > group4Group 3 > group4
1NeutralNeutralNeutral0.500.500.50
2InferiorNeutralNeutral0.060.060.50
3NeutralNeutralSuperior0.500.160.16
4InferiorNeutralSuperior0.070.000.16
5NeutralSuperiorSuperior0.180.180.49
6InferiorSuperiorSuperior0.020.020.48
7SuperiorSuperiorSuperior0.480.480.48
8NeutralNeutralSuperior0.500.330.33
9InferiorNeutralSuperior0.040.010.39
  • Note: Neutral—no treatment effect; superior—superior to control; inferior—inferior to control. This table summarizes the proportion of trials in which a worse arm was allocated more patients than a better arm. For example, in scenario 4, group 2 (inferior to control) is allocated more patients than group 3 (no treatment effect) in 7% of trials but never allocated more patients than group 4 (superior to control). Also group 3 is allocated more patients than group 4 in 16% of trials.