loud-hydrogen-50191
09/19/2023, 3:03 AMfresh-football-47124
loud-hydrogen-50191
09/19/2023, 3:14 AMfresh-football-47124
loud-hydrogen-50191
09/19/2023, 3:27 AM*Warning: Sample Ratio Mismatch (SRM) detected*. We expected a 50/50 split, but observed a 49.6/50.4 split (p-value = 0.0000353). There is likely a bug in the implementation.
with 49.6
on the error message, and 49.569
i was getting with one of my 200k isOn() .. i naively conclude that 49.56 is < 49.6, and thus should trigger SRM.fresh-football-47124
loud-hydrogen-50191
09/19/2023, 3:28 AMfresh-football-47124
loud-hydrogen-50191
09/19/2023, 3:34 AM<script src='<https://cdn.jsdelivr.net/npm/@growthbook/growthbook/dist/bundles/index.js>'></script>
fresh-football-47124
loud-hydrogen-50191
09/19/2023, 3:35 AMvar gb = new window.growthbook.GrowthBook({
enableDevMode: true
})
gb.setAttributes({ deviceId: v4() })
let { variationId } = gb.run({
key: "my-experiment",
variations: [false, true],
coverage: 1,
weights: [0.5, 0.5],
hashAttribute: "deviceId"
})
{
"defaultValue": false,
"rules": [
{
"variations": [
false,
true
],
"coverage": 1,
"weights": [
0.5,
0.5
],
"key": "my-experiment",
"hashAttribute": "deviceId"
}
]
}
there's no hashVersion: 2
in it, which means isOn('my-experiment')
will default to hashVersion 1 ?
I have checked the GB UI, and i do not see any options to specify hashVersion in both the feature page and the settings page.fresh-football-47124
loud-hydrogen-50191
09/19/2023, 3:41 AMisOn
will make use of v1 that might trigger SRM from the variation allocations ?fresh-football-47124
loud-hydrogen-50191
09/19/2023, 3:44 AMfresh-football-47124
loud-hydrogen-50191
09/19/2023, 7:30 AM