Skip to content

A/B Testing · St Davids

A/B Testing in St Davids

Running experiments on St Davids websites so decisions rest on evidence. The failures are rarely in the tooling and almost always in validity — traffic split unevenly, two experiments overlapping on the same page, or a result that reflects the novelty of a change rather than anything durable.

Why this comes up

The problem

Tests get run, winners get declared, and rolled-out changes never produce the improvement the test predicted.

What you get

What we deliver

  • Randomisation verified, since uneven splits invalidate a test silently
  • One change tested at a time, or a design that can separate the effects
  • Duration set in advance and honoured, covering whole weeks of trading
  • Overlapping experiments prevented, as they contaminate each other's results
  • Results judged on practical difference, not only on statistical significance
  • Outcomes recorded, including the losses, which most teams quietly discard

Want this scoped for your business in St Davids?

Thirty minutes, no charge, no sales script. You leave with a written summary of what a/b testing would actually involve — whether or not you use us.

Book a 30-minute call

Working in St Davids

Wales

St Davids is the smallest city in Britain, with a commercial base of a few dozen tourism and hospitality businesses serving coastal visitors, and we will say plainly that most services on this site are larger than the local market needs.

Simple booking and payment systems for very small hospitality and tourism operators on the Pembrokeshire coast.

Sectors we work with in St Davids

  • Tourism & Heritage
  • Hospitality
  • Agriculture
  • Marine
  • Retail

What we work with

Technologies and platforms

  • Google Analytics 4
  • Optimizely
  • PostHog
  • Next.js

Who we work with

Industries we serve

  • E-commerce
  • Technology and SaaS
  • Media and publishing
  • Financial services
  • Travel

Why us

Why St Davids businesses choose Asionis

  • Projects typically launched within 4–8 weeks
  • No long-term contracts required
  • All team members UK-based
  • Dedicated account manager and development team
  • Transparent reporting with monthly performance metrics
  • Scalable from startup to enterprise

How we work

  1. Step 1

    Free consultation

    A 30-minute call to understand the problem. You keep the written summary either way.

  2. Step 2

    Proposal

    Scope, timeline and a fixed price, in writing, before anything starts.

  3. Step 3

    Build

    Short cycles with regular check-ins, so you see progress rather than hear about it.

  4. Step 4

    Launch and support

    We handle the go-live and stay available afterwards.

A/B Testing in St Davids — common questions

Why do winning tests fail after rollout?
Several reasons compound. Tests stopped early on a favourable result capture noise; novelty makes regular visitors react to change itself; and running many tests guarantees some appear to win by chance. Validated results survive rollout, and a great many reported wins are not validated.
What is a sample ratio mismatch?
When the traffic split does not match what you configured — sixty-forty on a fifty-fifty test, say. It indicates something is wrong with assignment or measurement, and any result from that test is untrustworthy regardless of how significant it looks. It is worth checking every time.
Can we run several tests at once?
On separate pages and separate journeys, yes. On the same page they interfere, and attributing an effect to either becomes guesswork. Organisations with high traffic can design for this properly; most should run one experiment at a time on any given flow.
Should losses be recorded?
Yes, and they are the more useful half. A tested idea that failed prevents it being proposed again next year, and patterns in what does not work teach more about your customers than a list of small wins. Most teams keep only the successes.
Do you work with businesses across Pembrokeshire?
Yes. We are based in Leicester, United Kingdom and work with clients throughout Wales, including St Davids and the surrounding Pembrokeshire area. Most collaboration happens remotely, and we travel for kick-offs and key milestones.
What kind of St Davids businesses do you usually work with?
Simple booking and payment systems for very small hospitality and tourism operators on the Pembrokeshire coast. Beyond that we work across Tourism & Heritage, Hospitality, Agriculture, Marine and Retail.
Do you cover the areas around St Davids?
Yes — we work throughout Wales, including Swansea, Cardiff. St Davids is an urban area of roughly 1,600+, and we take on work across the wider Pembrokeshire region rather than the city boundary alone.

Talk to us about A/B Testing in St Davids

A 30-minute call with someone who would actually work on it. No sales script, no obligation.

  • Projects typically launched within 4–8 weeks
  • No long-term contracts required
  • All team members UK-based
  • Dedicated account manager and development team
  • Transparent reporting with monthly performance metrics
  • Scalable from startup to enterprise

Or reach us directly

07707 771599admin@asionis.com

Leicester, United Kingdom