Library · Traffic · How to run this
Lander A/B needs CRM settle sample
Tracker click convert is not CRM settle. Days to call ≈ n per arm ÷ visitors per arm per day, with n from settle % and your MDE. Type visitors / arm / day, CRM settle %, and MDE %.
Pair: Lander A/B sample on Traffic. Generic n: test sample size. Call write-up: test decision log.
What you type
Visitors / arm / day — lander unique visitors per arm per day (tracker export).
CRM settle % — settled orders ÷ visitors on that lander (CRM, not pixel).
MDE % — relative lift % you would ship for (typed — not a blog default).
Approximate n per arm at ~80% power from settle % and MDE. Days to call = n ÷ daily visitors. Wait or raise traffic when days blow past your test window — do not invent an MDE chip.
What not to do
Do not invent an MDE. Do not use click convert in place of CRM settle %. Do not mix arms with different daily traffic without retyping. Do not call the test on pixel wins before settles catch up.
Related: Traffic, test sample size, test decision log, bot-filter waste.
Procedure
- Type visitors per arm per day.
- Type CRM settle % and MDE %.
- Wait or raise traffic when days exceed the test window.
Failure modes
- Inventing an MDE.
- Using click convert instead of CRM settle %.
- Calling on pixel wins before settles catch up.
Worked example
None on this page yet. When one lands it will be a real case: what broke, the number, and what changed. Not a composite.
Glossary
- Lander A/B days to call
- Approximate n per arm from CRM settle % and MDE, divided by visitors per arm per day.
Work with us — We run this job on your accounts. Services
FAQ
- Is this test sample size?
- Related n. [Test sample size](/manuals/test-sample-size) is a generic two-arm n. This page is lander traffic paced to CRM settle % and days to call.
- Is this test decision log?
- Related call. [Test decision log](/manuals/test-decision-log) is the ship/kill write-up. This page is how many days until the settle sample can support the MDE you typed.
- What MDE should I invent?
- None. Type the relative lift % you would actually ship for.