The First A/B Test Every Small Business Should Run (Before Anything Fancier)
Small businesses tend to assume A/B testing belongs to companies with the traffic and tools to justify it โ expensive split-testing software, data scientists, thousands of visitors a day. That assumption keeps a lot of genuinely useful, free improvement off the table for businesses that could absolutely benefit from it. The truth is the simplest test โ swapping one headline or one button for a set period and comparing what happened โ needs nothing but your existing website and a spreadsheet. We ran our first version of this exact test with almost no traffic ๐, and while the numbers took longer to become trustworthy than they would for a bigger site, the process itself was identical, and it taught us more about what our own customers actually respond to than any amount of guessing had.
What most businesses get wrong
The two mistakes sit at opposite ends โ either people avoid testing entirely because they think it requires tools they don't have, or the small number who do try it change several things at once and end up with a result they can't actually explain.
- Testing too many things at once. Change the headline, the image, and the button colour together, and even a clear result tells you nothing about which change actually caused it.
- Assuming you need dedicated split-testing software. For a first test, a simple before-and-after comparison using your existing analytics is genuinely enough โ the fancy tools solve a problem (running two versions simultaneously to real-time traffic) most small businesses don't have yet.
- Calling a result too early. Three days and forty visitors is not a result, it's noise that happens to lean one direction โ and treating it as a real answer leads to confident decisions built on nothing.
- Never testing anything at all, out of a vague fear of 'breaking' the website. A headline swap for two weeks carries essentially zero risk and can always be reverted in under a minute.
1. Pick ONE page element. Your homepage headline or your main call-to-action button text are the two best starting points โ both are high-visibility and easy to change back.
2. Write two clear versions. Version A is what's live now. Version B changes exactly one thing โ the headline's angle, or the button's wording (e.g. 'Get a Quote' vs 'See Pricing').
3. Run Version A for 2 weeks, note the baseline. Record: total visitors to the page, and how many completed the action you care about (booked, enquired, bought).
4. Swap to Version B for the next 2 weeks, same tracking. Try to avoid running any other marketing changes during this window โ no new ad campaign, no big social push โ so you're comparing like with like.
5. Calculate the conversion rate for each period. Conversions รท visitors ร 100 for both A and B.
6. Read the result honestly using the reality-check below before declaring a winner.
How this plays out for different businesses
How to set this up and read it honestly
Set up tracking before you start, not after. If you're using Google Analytics, a simple goal or event on the action you care about (form submitted, button clicked, phone number tapped) is enough โ you don't need anything more sophisticated for a first test. No analytics at all is fine too, a manual tally in a spreadsheet works, it's just more effort to keep accurate.
Run each version for the same length of time and, where possible, matching days of the week โ comparing a Monday-to-Sunday period against a Wednesday-to-Tuesday period introduces a variable you didn't intend to test.
Here's the honest part most guides skip entirely: with under roughly 100 conversions total across both versions combined, treat any result as a lean, not a verdict. A 3% difference on forty total conversions could easily flip the other way next month purely by chance. That's not a reason to avoid testing โ it's a reason to keep the winning version running for longer before fully committing, and to treat a bigger gap (say, 20% or more) as more trustworthy on smaller numbers than a marginal one.
Mistakes to avoid
- Don't change the page mid-test for any other reason โ a new photo, a fixed typo, anything โ it contaminates the comparison even if it feels unrelated.
- Don't run Version B over a public holiday or major sale period if Version A ran during a normal stretch โ timing mismatches skew results more than people expect.
- Don't test on a page with barely any traffic โ pick your highest-traffic page for a first test so you reach a readable sample size sooner rather than later.
- Don't declare a permanent winner after one round if the gap was small โ run it again once more before locking it in for good.
Frequently asked questions
Do I need special software to run this?
No โ this specific setup (before-and-after over two time blocks) uses only your existing analytics or a manual count. Dedicated split-testing tools become genuinely useful later, once you have enough consistent traffic to run two versions simultaneously to real-time visitors rather than sequentially over time.
What's the honest downside of testing sequentially instead of simultaneously?
Sequential testing can't fully rule out that something else changed between the two periods โ a seasonal shift, a news event, anything external. It's a real limitation worth knowing about, not a flaw to ignore, which is exactly why matching the time periods and avoiding other changes during the test matters so much.
How much traffic do I actually need for a trustworthy result?
There's no single magic number, but as a rough guide, aim for at least 1,000 visitors and 30-50 conversions per version before treating the result with real confidence. Below that, use the result as a genuine lean worth acting on cautiously, not a locked-in decision.
What should I test after this first one?
Once you're comfortable reading a result honestly, move to testing one element on a second high-traffic page, or go slightly bigger โ an entire page layout, or your pricing structure. Keep the same one-variable-at-a-time discipline as you scale up.
Keep reading ๐ค
I help Gold Coast and Brisbane businesses grow with branding, websites and marketing that actually works.
Work with me ✦