Don't miss
  • 12
  • 6468
  • 6097
  • 20

Is this the Winner?

By on August 30, 2011
Print Friendly

I’ve been running a simple A/B test for the title of my next book over the Bank Holiday weekend.

I uploaded four ad groups to Google. All had identical text but the titles were different:

  • Game Changers
  • 52 Game Idea Rockets
  • 52 Game Design Secrets
  • 52 Game Design Powerups

The image below shows the initial results. Based on the click-through rate, Secrets and Powerups beat Game Changers and Rockets. (I’m not an expert statistician, but the 0.02 percentage point difference between the two winners seems unlikely to be statistically significant).


I’m planning on trying a couple more variations, but if you have any advice, I’d welcome it.

About Nicholas Lovell

Nicholas is the founder of Gamesbrief, a blog dedicated to the business of games. It aims to be informative, authoritative and above all helpful to developers grappling with business strategy. He is the author of a growing list of books about making money in the games industry and other digital media, including How to Publish a Game and Design Rules for Free-to-Play Games, and Penguin-published title The Curve:
  • Rob_ste

    They all seem very similar and to get a real A/B test perhaps have a control which is a different heading –
    One Money making idea a week… For a year!

  • Have you considered trying some Facebook ads as well?
    Profiling on FB is interesting to compare with google, especially with an industry audience as your target?

  • It’s possible that it’s “game design” that’s the magic phrase, and the difference between rockets / power ups / secrets is irrelevant.

    Game Ideas are cheap and easy. Game Design on the other hand…