Superiority vs Non-Inferiority Trials in AB Testing

Not every experiment needs to show improvement — sometimes proving you haven’t made things worse is enough. A practical guide to non-inferiority trial design.

December 11, 2025 · 5 min · Nikita Podlozhniy

Bayesian A/B Test is NOT immune to peeking

Practical guide: PyMC examples, hierarchical models, loss functions, HDI, and safe stopping rules

November 30, 2025 · 23 min · Nikita Podlozhniy

Sequential Testing Guide

How GST is often misinterpreted and why its genuine version is way better than AVI?

December 25, 2024 · 22 min · Nikita Podlozhniy

Mastering Homogeneity Hypothesis testing

Why Fisher’s Exact test is the relic of the past and Chi-squared is all the way

December 1, 2024 · 24 min · Nikita Podlozhniy

Linearization: Turning Ratio Metrics into Per-User Metrics

A simple algebraic transformation that converts ratio metrics into independent per-user values, making T-tests and sensitivity techniques directly applicable

October 1, 2024 · 6 min · Nikita Podlozhniy