← Back to blog

The First A/B Test Every Small Business Should Run (Before Anything Fancier)

03 September 2026·6 min read
Quick answer: The first A/B test worth running for most small businesses is a simple headline or call-to-action swap on your highest-traffic page, run in two blocks of time rather than with expensive split-testing software. You don't need special tools โ€” a spreadsheet, your existing analytics, and two versions of one page element is genuinely enough. The honest part most guides skip: if you don't have much traffic, your result might not be reliable, and knowing how to tell the difference matters more than running the test itself. ๐Ÿš€

Small businesses tend to assume A/B testing belongs to companies with the traffic and tools to justify it โ€” expensive split-testing software, data scientists, thousands of visitors a day. That assumption keeps a lot of genuinely useful, free improvement off the table for businesses that could absolutely benefit from it. The truth is the simplest test โ€” swapping one headline or one button for a set period and comparing what happened โ€” needs nothing but your existing website and a spreadsheet. We ran our first version of this exact test with almost no traffic ๐Ÿ’–, and while the numbers took longer to become trustworthy than they would for a bigger site, the process itself was identical, and it taught us more about what our own customers actually respond to than any amount of guessing had.

What most businesses get wrong

The two mistakes sit at opposite ends โ€” either people avoid testing entirely because they think it requires tools they don't have, or the small number who do try it change several things at once and end up with a result they can't actually explain.

  • Testing too many things at once. Change the headline, the image, and the button colour together, and even a clear result tells you nothing about which change actually caused it.
  • Assuming you need dedicated split-testing software. For a first test, a simple before-and-after comparison using your existing analytics is genuinely enough โ€” the fancy tools solve a problem (running two versions simultaneously to real-time traffic) most small businesses don't have yet.
  • Calling a result too early. Three days and forty visitors is not a result, it's noise that happens to lean one direction โ€” and treating it as a real answer leads to confident decisions built on nothing.
  • Never testing anything at all, out of a vague fear of 'breaking' the website. A headline swap for two weeks carries essentially zero risk and can always be reverted in under a minute.
The step-by-step mini test:

1. Pick ONE page element. Your homepage headline or your main call-to-action button text are the two best starting points โ€” both are high-visibility and easy to change back.

2. Write two clear versions. Version A is what's live now. Version B changes exactly one thing โ€” the headline's angle, or the button's wording (e.g. 'Get a Quote' vs 'See Pricing').

3. Run Version A for 2 weeks, note the baseline. Record: total visitors to the page, and how many completed the action you care about (booked, enquired, bought).

4. Swap to Version B for the next 2 weeks, same tracking. Try to avoid running any other marketing changes during this window โ€” no new ad campaign, no big social push โ€” so you're comparing like with like.

5. Calculate the conversion rate for each period. Conversions รท visitors ร— 100 for both A and B.

6. Read the result honestly using the reality-check below before declaring a winner.

How this plays out for different businesses

A business testing a new price point on its main offer: rather than guessing whether the new price scares people off, the test compares the enquiry rate on the pricing page for two weeks at the old price against two weeks at the new one. The result shows enquiries dip only slightly, while average order value rises enough to more than cover it โ€” a far steadier way to decide than reading a handful of anecdotal comments.
A booking-based business with a persistent no-show problem: the test swaps the confirmation page's call-to-action from 'You're booked!' to 'You're booked โ€” add this to your calendar now' with a one-click calendar link. Two weeks each way shows a genuine drop in no-shows for Version B, a small, nearly free change with a measurable real-world outcome.
A local service business coming out of its seasonal quiet stretch: the test times the two-week windows carefully to avoid the ramp-up in demand skewing the result, running both versions during the still-quiet weeks rather than letting Version B accidentally land in the busier period, which would make it look like the clear winner for the wrong reason entirely.

How to set this up and read it honestly

Set up tracking before you start, not after. If you're using Google Analytics, a simple goal or event on the action you care about (form submitted, button clicked, phone number tapped) is enough โ€” you don't need anything more sophisticated for a first test. No analytics at all is fine too, a manual tally in a spreadsheet works, it's just more effort to keep accurate.

Run each version for the same length of time and, where possible, matching days of the week โ€” comparing a Monday-to-Sunday period against a Wednesday-to-Tuesday period introduces a variable you didn't intend to test.

Here's the honest part most guides skip entirely: with under roughly 100 conversions total across both versions combined, treat any result as a lean, not a verdict. A 3% difference on forty total conversions could easily flip the other way next month purely by chance. That's not a reason to avoid testing โ€” it's a reason to keep the winning version running for longer before fully committing, and to treat a bigger gap (say, 20% or more) as more trustworthy on smaller numbers than a marginal one.

๐Ÿ’ก Write down your prediction before you see any results. Guess which version will win, and by roughly how much, before you look at the numbers. It costs nothing, and being wrong about your own instincts is often the single most useful thing the whole test teaches you.

Mistakes to avoid

  • Don't change the page mid-test for any other reason โ€” a new photo, a fixed typo, anything โ€” it contaminates the comparison even if it feels unrelated.
  • Don't run Version B over a public holiday or major sale period if Version A ran during a normal stretch โ€” timing mismatches skew results more than people expect.
  • Don't test on a page with barely any traffic โ€” pick your highest-traffic page for a first test so you reach a readable sample size sooner rather than later.
  • Don't declare a permanent winner after one round if the gap was small โ€” run it again once more before locking it in for good.

Frequently asked questions

Do I need special software to run this?

No โ€” this specific setup (before-and-after over two time blocks) uses only your existing analytics or a manual count. Dedicated split-testing tools become genuinely useful later, once you have enough consistent traffic to run two versions simultaneously to real-time visitors rather than sequentially over time.

What's the honest downside of testing sequentially instead of simultaneously?

Sequential testing can't fully rule out that something else changed between the two periods โ€” a seasonal shift, a news event, anything external. It's a real limitation worth knowing about, not a flaw to ignore, which is exactly why matching the time periods and avoiding other changes during the test matters so much.

How much traffic do I actually need for a trustworthy result?

There's no single magic number, but as a rough guide, aim for at least 1,000 visitors and 30-50 conversions per version before treating the result with real confidence. Below that, use the result as a genuine lean worth acting on cautiously, not a locked-in decision.

What should I test after this first one?

Once you're comfortable reading a result honestly, move to testing one element on a second high-traffic page, or go slightly bigger โ€” an entire page layout, or your pricing structure. Keep the same one-variable-at-a-time discipline as you scale up.


Keep reading ๐Ÿค

Share
Written by
Kate, founder of Chronically Online

I help Gold Coast and Brisbane businesses grow with branding, websites and marketing that actually works.

Work with me ✦