When Does Autotuning Take Action on a Variant?

Autotuning begins evaluating a variant once it reaches 1,000 sends. At that point, if the variant is statistically underperforming compared to others in the test, the system may recommend archiving it or automatically archive it depending on your settings.

In some cases, our system may take action before the 1,000-send threshold, especially if early performance signals are strong and the send volume is lower. This helps maintain test momentum when it’s clear that a variant isn’t performing well.

Best Practices

To keep your tests running smoothly, we recommend:

• Approving multiple variants in advance so autotuning has options
• Monitoring performance thresholds and adjusting them if needed (reach out to the JustAI team to do this)
• Reviewing archived variants and learnings regularly to inform future rounds of testing

Autotuning is designed to help you get the best results with minimal manual effort, but it works best when paired with thoughtful test setup and variant approval planning.