Vanity

Vanity is an A/B testing framework that offers a classic example of using A/B testing to compare two versions of a landing page. Through this, it helps to find out which alternatives lead to more registration. Vanity allows using A/B tests to gauge interests in a new feature, in response to a feature change, and improving the site's design and copy. Vanity offers components such as true or false, interpretation of results, multiple alternatives, A/B testing and code testing, and Let the Experiment Design. The true or false feature is typically a metric provided by Vanity that helps in monitoring, and the experiment will measure against it. The feature will work and give a true answer if the hypothesis hold and a false answer if the hypothesis does not hold. The interpretation of results feature provides two parts of the A/B tests. The first part is the one that decides which alternatives the system will show. The second part of the A/B test measures the effectiveness of each option. The second part of the A/B test happens as a result of measuring the metric that was being monitored. The dashboard used by Vanity enables users to track the results or run the command to follow the results. Vanity splits the audience randomly by using cookies and other mechanisms. Through this, the A/B testing framework provides the conversion rate. The multiple alternatives offer two caveats. The various options provided by Vanity are significantly different from each other. The second caveat only scores the two best-performing options.