A/B Testing - The Closest You'll Ever Come to Being an Actuary

I was recently tasked with acquiring a certain number sense in regards to A/B testing. After Googling around a bit, I noticed that much of the information on A/B Testing were fairly rudimentary introductions that simply skimmed the concepts of said testing. There was a myriad of products and services that offered A/B Testing, but these got straight to the results of the sample tests. What I wanted was the nitty, gritty, gory, superfluous details of the math. Understanding the Wikipedia definition is one thing, actually being able to wield the math was another. What I thought would be a simple 30 minute Wikipedia read, quickly spiraled into a furious mad dash to derive the underlying principles of what is essentially, everything I forgot in AP Statistics back in high school. 15 hours and a bottle of 2 buck chuck later, I had an elementary grasp of the glorified math behind the aptly named, A/B Testing. 

Read More