Setting up a proper A/B experiment involves selecting the appropriate sample size. This ensures the test is adequately powered to detect the change while minimizing statistical noise. In statistical terms, we want to detect the minimum detectable effect (MDE) with statistical confidence.

* Having too few samples produces statistically ambiguous results, and having too many samples can be overkill and a waste of time and resources