: Analytics

Adobe Partners With Brooks Bell to Develop ACE Certification for Adobe Target

If you’ve been in the testing industry for any length of time, you’ve probably completed an online certification of some sort. Now, the next time you take Adobe’s Target Certification, you can thank Brooks Bell...

What Should You Do When a Test is Flat?

A/B testing is a bit like the Olympics. You always go for gold. Ideally, you’re looking for Michael Phelps-style wins: long-term, consecutive, and (seemingly) effortless. And if you fail to make it to the top-level...

What Essential Skills Should You Look For When Hiring an Analyst?

The importance of a good analyst can’t be overstated. If your organization is data-driven (and it should be), an analyst provides unparalleled guidance and insight: He or she identifies where to allocate resources, influences company strategy,...

March Madness: Why an Algorithm Probably Won’t Give You a Winning Bracket

Although I have a master's degree in advanced analytics, I filled out my NCAA March Madness bracket in 5 minutes, just seconds before the tip-off of the first game. Maybe you’ve heard of the model...

Go Beyond the Online Calculator to Determine Sample Size

The premise of statistics is simple: “We have a population we want to understand, but we can’t measure everyone. Let’s collect a sample and use statistical inference to make the best decisions we can.” For...

Dealing with Outliers (Part 2): Avoid These Common Mistakes

Part two of a two-part series. In the first post of this series, I discussed the different types of outliers and why they’re important. If you haven’t already, take a couple of minutes to read...

Dealing with Outliers (Part 1): Ignore Them at Your Peril

Note: This is part one of a two-part series. One of the foundations of testing is repeatability. If you can’t repeat a test and get similar results, you can’t trust the data. And one of...