Skip to content
home

Services

Experiments that tell you the truth about your site

We run research-led testing programmes on your site and funnels, designed to detect real effects and read out without wishful thinking.

The problem

Most A/B tests are too small to detect the effect they're looking for, and stop the moment a result looks good. Both lead to changes that don't actually help.

What you get

  • Research

    Analytics, user research and heuristic review.

  • Prioritised hypotheses

    Ranked by expected impact and evidence.

  • Test design

    Sample size and duration worked out before launch.

  • Build and QA

    Tests built and checked across devices.

  • Honest readouts

    The effect, its range and how sure we are.

  • Roll-out

    What to ship, and what to learn next.

How sure are we?

Every readout shows the range of likely effects and the chance the change really helps.

Incremental lift
  • Posterior
  • 90% credible interval
  • Prior
  • Region of practical equivalence
Illustrative: posterior distribution of one quantity (lift, ROI, a coefficient).-15.0%-10.0%-5.0%0.0%5.0%10.0%15.0%Lift in weekly opens (%)

A programme, not a string of tests

Research finds the problems worth solving. Every test is sized before launch, built and checked, then read out once at its planned end, with the likely range of the effect, not just a pass or fail.

  • Works in your testing platform
  • Sample size and duration agreed up front
  • Readouts in plain language, with ranges
A six-step testing cycle (research, hypotheses, test design and power, build and QA, readout, roll-out) and the platforms supported: VWO, Optimizely, Adobe Target and others.ResearchPrioritisedhypothesesTest design andpowerBuild and QAReadout with rangesRoll out and learnWorks in your testing platformVWOOptimizelyAdobe TargetOthers, including server-side andin-house frameworksEvery test is sized before launch and read out once, at its planned end.
Every test is sized before launch and read out once, at its planned end.

How an engagement runs

  1. Discovery call

    The decision and the constraints.

  2. Diagnostic

    A fixed-scope look at where you are.

  3. Delivery

    Agreed scope, regular check-ins.

  4. Handover

    Documentation and training.

FAQ

Questions

We work in three-month blocks, with a review at the end of each.

Let's talk about the decision you need to make

Thirty minutes, no slides.