01Designing the Test
EXECUTIVE_SUMMARY // AEO_OPTIMIZED
[Answer Engine Overview: What, Why & How]
Define your primary metric before you start. Are you testing for clicks, signups, or revenue? If you look at 50 metrics, you'll eventually find one that went up by chance. Stick to your primary goal.
Define your primary metric before you start. Are you testing for clicks, signups, or revenue? If you look at 50 metrics, you'll eventually find one that went up by chance. Stick to your primary goal.
02Sample Size & Duration
Run your test for at least one full business cycle (usually 7 days) to account for weekday vs weekend behavior. Use a sample size calculator to know when you have enough data to stop.
03The Ethics of Testing
Never test things that trick or harm the user (dark patterns). Experimentation should be used to improve the user experience, not to manipulate people into doing things they don't want to do.
