Categories
ISDS

A/B Testing in Action: A Case Study of Company X

Research
companies and find an example where a company uses A/B testing.
2.         Write a short paper on that company – at least four pages but no more than five single-spaced
pages in total (not counting references), using Times New Roman font style and
12 point font size – and include the following information:
Components
to be graded (total
possible = 50 pts):
1.         Was student’s name included? Were
directions followed?
At least four pages but no more than five single-spaced pages in total (not counting
references), using Times New Roman font style, and 12 point font size (3 pts)
2.         Name
of the Company –
was the name of the company given, including the industry? (2 pts)
3.         Label
the paper using the following parts:
a.         Introduction
– does the report include a description of the business and purpose of the business
(example: does the company provide a product or service to customers, also
define the target customer) as a background and introduction to why the company
would be doing A/B testing. (10
pts)
b.         Purpose
– is the purpose of A/B testing clearly defined? In other words, is the
problem statement clearly defined? Is the objective of A/B testing defined? (10 pts)
c.          Description
of the A/B Testing – were details of the A/B testing adequately described so
that the reader was clear on how the A/B testing/study was conducted? How was
the study designed?  How many
groups?  Define the treatment group?  What was the controlled group?  What was the variable under investigation; in
other words, what was observed and recorded in the study and was that variable
numerical or categorical?  For example,
in a marketing study, you could measure sales (numerical variable) or number of
customers who purchase (counting the number of Yes’s in a categorical
variable).  Recall if we are looking at a
treatment group and a controlled group, we could look at a numerical variable
for each group by looking at bivariate histograms (covered on Test 1); when
looking at a categorical variable, we looked at bivariate pie charts (also
covered on Test 1).  Also after Test 3, we will cover the inferential
approach to each of these through a pool-variance t-test and a chi-
squared test of independence,
respectively. (10 pts)
d.         Results – were the results of the study and the subsequent
decision(s) or conclusions of the company concisely given? (10 pts)
e.         References
– were adequate references given so that the reader could find additional
information pertinent to the paper. (5 pts)