AnalyticsToolkit @AnalyticsToolki

We are passionate about Web Analytics, Statistics & Data-Driven Decisions in Online Marketing. analytics-toolkit.com Joined January 2014

Tweets

398
Followers

234
Following

89
Likes

666

AnalyticsToolkit @AnalyticsToolki

11 months ago

Is any of your colleagues skeptical of the value of A/B testing? The business case for experimentation (#abtesting) is explored and showcased through simulations, numbers, and graphs in this article: 👉 blog.analytics-toolkit.com/2024/the-busin… #experimentation

0 0 0 31 0

AnalyticsToolkit @AnalyticsToolki

11 months ago

What if the observed effect in an A/B test is smaller than the minimum detectable effect (MDE) used in planning it? Is it cause for concern? Does it make a test less trustworthy? The answers to the above and more in blog.analytics-toolkit.com/2024/what-if-t… #nhst #statistics #mde

0 0 0 13 0

AnalyticsToolkit @AnalyticsToolki

11 months ago

Observed power is a tempting concept, but is misused almost by definition. Are you curious about the true power of your statistical test? You're barking the wrong tree of post hoc power. Full article at blog.analytics-toolkit.com/2024/comprehen… #statistics #statisticalpower #nhst

0 0 0 13 0

AnalyticsToolkit @AnalyticsToolki

2 years ago

"Stop AbUsing the Mann-Whitney U Test (MWU)" #abtesting #statistics #DataAnalysis blog.analytics-toolkit.com/2024/stop-abus…

0 0 0 46 1

AnalyticsToolkit @AnalyticsToolki

2 years ago

Not sure whether you should adopt sequential A/B tests? Think it's all about testing velocity? Check out this article showcasing the primary value of sequential tests in an accessible manner: blog.analytics-toolkit.com/2023/sequentia…

0 0 0 44 0

AnalyticsToolkit @AnalyticsToolki

2 years ago

Worried about the false positive risk of your experimentation program, or a particular test? Can you estimate what proportion of your "winners" are in fact "losers", and does it even matter? This and more #abtesting #statistics in blog.analytics-toolkit.com/2023/false-pos…

0 0 0 25 0

AnalyticsToolkit @AnalyticsToolki

3 years ago

After more than a decade, we are dropping our Google Analytics API integration and thus all related functionalities. Learn more about why and what you can do to use GA4 A/B test data going forward: blog.analytics-toolkit.com/2023/analytics… #googleanalytics #GA4 #abtesting

0 0 1 78 0

AnalyticsToolkit @AnalyticsToolki

3 years ago

How to run shorter & more efficient A/B tests? This article covers the basics and can lead to 40%+ improvement in the expected test duration. #abtesting #statistics blog.analytics-toolkit.com/2022/how-to-ru…

0 0 0 0 0

AnalyticsToolkit @AnalyticsToolki

3 years ago

A deep discussion on statistical power, minimum detectable effect, and how to design statistical tests in #abtesting: blog.analytics-toolkit.com/2022/statistic…

0 0 0 0 0

AnalyticsToolkit @AnalyticsToolki

3 years ago

What is the best design for a statistical test with sequential evaluation of data at multiple points in time? Should you do group sequential or go full sequential? Is there a time & place for each? blog.analytics-toolkit.com/2022/fully-seq… #statistics #abtesting #conversionrateoptimization

0 0 1 0 0

AnalyticsToolkit @AnalyticsToolki

4 years ago

Session-based metrics see use in online #abtesting, but they can easily lead to erroneous test conclusions. While well-known by some, it seems this issue is underappreciated by others. This article presents the issue in detail: blog.analytics-toolkit.com/2022/when-sess…

0 0 0 0 0

AnalyticsToolkit @AnalyticsToolki

4 years ago

P-values and confidence intervals: an accessible explanation for practitioners of #cro and #abtesting. #statistics blog.analytics-toolkit.com/2022/p-values-…

0 0 0 0 0

AnalyticsToolkit @AnalyticsToolki

4 years ago

A new glossary entry on A/B testing: analytics-toolkit.com/glossary/a-b-t… is now up. Should be a useful resource when introducing someone to online testing and experimentation. #abtesting #conversionrateoptimization #cro

0 0 0 0 0

AnalyticsToolkit @AnalyticsToolki

4 years ago

A little update for those using Analytics Toolkit to analyze tests performed in Google Optimize. Now there is the option to import data from tests with a paused/disabled default Control group. Variant 1 has to be assigned the default user experience. #googleoptimize #abtesting

0 0 0 0 0

AnalyticsToolkit @AnalyticsToolki

4 years ago

"Statistically rigorous A/B tests are impractical". This and similar beliefs may be hindering your A/B testing program, even if you do not subscribe to them. This article takes on debunking the top misconceptions about scientific rigor in #abtesting : blog.analytics-toolkit.com/2022/top-misco…

0 0 0 0 0

AnalyticsToolkit @AnalyticsToolki

4 years ago

Our service should be restored shortly for everyone. We were finally able to switch our DNS away from eNom (who have still not solved their issue) and the site should start resolving shortly. Apologies for this quite unprecedented downtime!

0 0 0 0 0

AnalyticsToolkit @AnalyticsToolki

4 years ago

Analytics-Toolkit.com is affected by what appears to be a prolonged unexpected downtime of the eNom nameservers. As the registrar is down as well, this is currently impacting hundreds of thousands of domains with no solution. We expect to be back soon.

0 0 0 0 0

AnalyticsToolkit @AnalyticsToolki

4 years ago

What lessons can we in online A/B testing learn from the COVID vaccine trials? With billions at stake, not to mention lives and well-being, we can learn from how these were planned and analyzed. #abtesting #experimentation #testing #statistics #covid blog.analytics-toolkit.com/2022/improve-y…