Ask: The Difference Between a Multivariate Test and an A/B Test? Which should you use?
Both tests are trying to test which component you should change on your website to improve click thru rate and your funnel to your ultimate goal.
Site visitors are bucketed into one version or the other. By tracking the way visitors interact with the page they are shown — the videos they watch, the buttons they click, or whether or not they sign up for a newsletter — you can determine which version of the page is most effective.
AB testing
changes only “1” component at a time, such as font size, headline keyword, color of call to action button, etc. (but not all at the same time which most makes this mistake)
Multivariant testing
compares a higher number of variables, and reveals more information about how these variables interact with one another. As in an A/B test, traffic to a page is split between 2 versions of the design. The purpose of a multivariate test, then, is to measure the effectiveness each design combination has on the ultimate goal. So there are more combinations in your testing but will reveal how the