Choose the type that matches your metric — this determines the correct statistical test.
Testing a ratio metric like AOV or CTR per session?Aggregate to one value per user first (total revenue ÷ total orders for each user), then enter the resulting per-user mean and SD below. This avoids correlation bias. See the theory: ratio metrics and the delta method.
Step 2
Your numbers
Step 3
Test parameters
How long will it take?
Enter your daily eligible traffic to estimate experiment duration.
Total100%
Shares must add up to 100%.
Reverse mode
What lift can I detect?
The opposite question: given the traffic and time you actually have, this finds the smallest relative lift the test could reliably detect — using the same baseline, α, power and variants set above.
Your result will appear here
Required sample size, estimated test duration, and a plain-English read of what it means.
Columns are recognised by name (date / дата, group / группа, revenue / value / converted / значение — or users, mean, sd, conversions). Separator: comma or semicolon. There must be exactly two groups; A or control is treated as the control — swap them with the button on the right. Conversion = the share of users with a value above zero.
The sample is synthetic: a true +6% lift in conversion plus a temporary novelty effect in the first week. Every day is computed on all data accumulated up to that day: Welch’s t-test for the mean, the Z-test for conversion — the same tests as in “Final totals”.
Recent results
Step 1
What are you measuring?
Choose the type that matches your metric — this determines the correct statistical test.
Step 2 · Variant data
A
B
Upload Excel / CSV fileOne row per user with group and converted (0/1) — or pre-aggregated group, exposed, converted. Columns are auto-detected.
Expected traffic split — used only for the split-health check
Enter the split you intended. The check flags a mismatch only if the data deviates from this.
Total100%
Shares must add up to 100%.
Step 3 · Parameters
Revenue projection (optional)
Step 2 · Variant data
Upload Excel / CSV fileOne row per user with group and value. Columns are auto-detected.
or paste values below
Each value = one user's metric (e.g. their total revenue that week).
A (control)
B
Step 3 · Parameters
Aggregate to one value per user before pasting.For AOV: each user's total revenue ÷ their number of orders. For CTR per session: each user's total clicks ÷ their total sessions. Running a t-test on raw transaction rows (not aggregated) inflates false positives by 2–10×.Why does this matter?
A heavy buyer with 10 orders contributes 10 rows if not aggregated — their data dominates, creating correlation between rows that breaks the independence assumption of t-tests.
The standard error becomes 2–10× too small, making results look far more significant than they are. False positive rate can exceed 30%.
Fix: compute one value per user (total revenue ÷ total orders), then paste those per-user values below.
Step 2 · Variant data (aggregated per user)
Upload Excel / CSV fileOne row per user with group and value (already aggregated per user). Columns are auto-detected.
or paste values below
Each value = one user's computed ratio (e.g. their AOV or their CTR).