Can a smaller, cheaper, and more power-efficient (and more open) language model beat Anthropic's Fable model? You know, the language model that's so good it's a danger to humanity. According to benchmarks widely used by AI labs, the answer is: of course not. Are you crazy? But what if I told you there was widespread…
Read the full article→
We solemnly promise that each bit of content you read here
is thoughtfully curated or crafted by a human, for a human. We spend hundreds of hours every month speaking to experts with decades of experience. Our blogs are more a journalistic report on the state of experimentation than a single perspective article. Enjoy!
Delphine Finders-Binje is the latest expert to open up their playbook for our Testing Mind Map series. These interviews look past the tidy version of experimentation and into the day-to-day: how evidence fares against conviction, which test wins survive contact with production, and where judgment sits now that AI has...
An autonomous experimentation loop automatically identifies active tests, reads their results, and acts within limits you set in advance. Maintain security by granting the loop least-privilege credentials, such as read-only access, to limit risk. Ensure statistical rigor using sequential testing and enforcing minimum runtimes to prevent acting on random noise....
Feature flags let you deploy code hidden behind a toggle, then turn it on for specific users without a redeploy. Rollouts use the same flag to expand access step by step. Developers use flags for internal testing, percentage-based rollouts, and A/B testing against a control group. Feature flag and rollout...
David Dias Rodríguez, Product Analyst at Sterling, is the latest expert to open up their playbook for our Testing Mind Map series. These interviews look past the tidy version of experimentation and into the day-to-day: how evidence fares against conviction, which test wins survive contact with production, and where judgment...
Are you one of those people using AI for analysis and statistical calculations? I know why you might be doing that. Convenience, right? Reducing friction. But let's consider the story of the data. That hard-earned data you spent time and effort ensuring robustness and accuracy. And then you throw it...
Forecasting the effect your experiments will have on future revenue is a bit of a controversial topic in the CRO world. The reason for this comes down to the fact that we don't really know for sure if a 10% lift from an experiment will translate into a 10% increase...
