We solemnly promise that each bit of content you read here
is thoughtfully curated or crafted by a human, for a human. We spend hundreds of hours every month speaking to experts with decades of experience. Our blogs are more a journalistic report on the state of experimentation than a single perspective article. Enjoy!
When you run A/B tests, you most likely have your tool firing its script in one place and Google Analytics firing in another. Very rarely do both tools agree on how many people saw your test. This disagreement usually reads as a small, annoying thing you learn to ignore. Until...
This is team Convert’s take on what the shift means. Disclaimer: Convert Experiences is an A/B testing and 1:1 personalization platform that’s been in the experimentation space for 16 years. 5th May 2026, the Official Release Drops Amplitude’s Spencer Skates broke the internet with the declaration. Amplitude is entering into...
If you’ve run experiments before, you’ve probably encountered situations where an A/B test isn’t the right technique. Not because the hypothesis is wrong, but because the change you want to test is too big to build inside an editor. In cases like this, split URL testing (or redirect testing) can...
What is test duration? Test duration is the amount of time you run an A/B test from start to finish, from the moment traffic starts splitting to when you call a winner (or stop the test). Test duration is important in experimentation because it's the acid test of whether a...
2.8 KB, 13 KB, 17 KB. The snippet size is lightweight. You base your A/B testing tool choice on that because it means the tool won’t affect page performance. Right? In live experiments, the snippet you install is often just a loader. The real payload arrives later. Sometimes running into...
In this article, we’re looking at where p-hacking creeps into experimentation (intentionally or accidentally). And show how to prevent it without slowing down your decision-making. What is P-Hacking in A/B Testing? P-hacking in A/B testing means manipulating your experiment data until statistical significance appears. This is a byproduct of Goodhart’s...
