<@U07FJ89LFFB> How to run an a/a test?
# ask-ai
s
@brash-pillow-71627 How to run an a/a test?
o
A message from kapa.ai
Running an A/A test in GrowthBook is similar to running an A/B test. Here are the steps you need to follow: 1. Create an experiment as you would for an A/B test. Ensure that the "variations" are serving the same values. This is because in an A/A test, instead of serving two different variations, two identical versions of a product or design are tested against each other. The purpose is not to compare the performance of the two versions, but rather to check the consistency of the testing platform and methodology. 2. Start your experiment just as you would any other experiment. Wait until it has been live for a few hours or days, depending on how much traffic you get, then take a look at the results. 3. If you want to run a test with splitting/assigning users on a particular page on your site, you can customize the URL targeting with regex when you create the visual editor experiment. In the case of an A/A test, you just wouldn't make any changes to either variation. 4. If you're looking to run feature flag experiments, there is nothing special you have to do. Just evaluate the feature flag like you would normally do. If the user is put into an experiment as part of the feature flag, it will call the
trackingCallback
automatically in the background. The
trackingCallback
will contain the information about which variation the user was bucketed into. And unlike an A/B test, you can then not change the UI based on which variation they're bucketed into. 5. If you found some issues with your set up and want to re-run your A/A test, or if you had a Metrics imbalance that you are still uncertain about, you should usually restart the A/A test and run it again. The easiest way to do this while still guaranteeing you have a clean test is to use the "Make Changes" flow in the A/A experiment page. Use this flow to "Start a New Phase" and make sure you "re-randomize traffic" to ensure that users returning to your test will be re-randomized into variations. Sources: - [How do I run an A/A test in GrowthBook?](https://docs.growthbook.io/kb/experiments/aa-tests#how-do-i-run-an-aa-test-in-growthbook) - [Forum Conversation on running A/A test](https://linen.growthbook.io/t/16134915/hi-team-how-can-i-run-a-test-with-splitting-assigning-users-) - [Restarting an A/A test](https://docs.growthbook.io/kb/experiments/aa-tests#restarting-an-aa-test)