Bayesian approximations in A/B tests

How close does an approximation get to numerical simulations?

A/B testing is common in businesses. This test puts two versions of the same experience in contest with other another. People (such as website users) see one experience through random assignment.

The research question is simple to state: which version is better? This article compares three different uncertainty intervals in R.

Uncertainty intervals