Don't misinterpret your results

A big part of AB testing and CRO is coming to grips with the reporting. In this course will illustrate common patterns, big mistakes and invalid results.

Yes results are good, test is positive, Yeahhh!
I remember my first few experiments, it was an ABC test, the reports showed Variation B winning by 10%, success? I was so wrong... You see I was an amateur 15 years ago. I didn't interpret the data right and I had missed signals that were telling me there was an error in my test configuration.
Most marketers jump to conclusions when looking at test results, they make assumptions. There is so much more to just the numbers.

In important CRO course:
So, this course I want to bring to life patterns and situations your test result curves and number aren't telling you unless you know what to look for. Did you know that over 50% of tests | experiments are Nil test, in other words, they have no effect and are worthless. But you have so many other things to look for, environmental effects, curve trends, cross overs... So these CRO test analysis courses are essential to avoid the mistake so many CRO teams and marketers make. Don't jump to conclusions...

Just a few things you will learn:
  • Anatomy of test results
  • Analysis of test curves
  • Convergence of test curves
  • Environmental effects
  • Technical errors
  • Nil tests
  • Novelty effect
  • Early test variation shutdown
  • Test segmentation
  • Claw back effect
  • Part of the CRO course bundle

    About the course

    Quick facts about the course, whom its for, how long it is

    • Complexity level: Practical course for All!!!

    • For whom? Marketers, CRO teams, analyst

    • Length: Simple course ~40 minutes

    Course curriculum

    • 1

      AB test results, not always clear to understand

      • 1a- Test result analysis - Introduction
      • 1b- Test result analysis - Anatomy of a test results report
      • 2- Test result analysis - Weird test stats at start
      • 3- Test result analysis - Finding clear test variation winners
      • 4- Test result analysis - The novelty effect
      • 5- Test result analysis - Claw back effect
      • 6- Test result analysis - Convergence of perf curves
      • 7- Test result analysis - Net nil test results
      • 8- Test result analysis - Environmental effects
      • 9- Test result analysis - Hidden technical errors
      • 10- Test result analysis - Early test variation shutdown
      • 11- Test result analysis - Chart segmentation


    • What is the CRO bundle?

      The courses are not meant to be sold separately since most of the knowledge is built from previous courses...
      So getting the CRO Course Bundle gives you all the courses, existing and upcoming, with full freedom to watch individual courses in any order you want.

    • What makes your courses unique?

      I get this a lot, no surprise there...
      The courses are based on rules and principles we developed and taught in our CRO agency.
      Unlike a lot of courses that are very good, but very theoretical, and most people find it difficult to apply to a website or AB testing. These rules and principles I use all the time to build my experiments and guide my conversion optimization decisions

    • Is this a long course?

      No not really. each course is between 20 to 40 minutes on average, designed to establish fundamental principles you will need to evaluate your own pages and site journey.
      The multi-lesson courses are longer in the 40 to 90-minute range.

      All courses are made up of individual "lessons" and each lesson is from 2 to 15 minutes long.

    • Why are the courses numbered?

      The initial CRO training program was designed as a series of sequential courses,starting from #1 and then #2 etc.. But, some companies and people don't want to go through all of them in sequence, so you are free to jump around. I recommend that you start from the beginning as the courses build up knowledge in layers and references learnings from previous courses

    • Is this just for beginners?

      Oh no no no... You would be surprised how even the pros don't know these principles.
      You may think some of these are simplistic, but they are not.

    Social proof: testimonials

    eCommerce & CRM Director, Tsakiris Mallas / f. Chairman of the Greek Ecommerce Association

    Fotis Antonopoulos

    eCommerce & CRM Director, Tsakiris Mallas / f. Chairman of the Greek Ecommerce Association

    Those of us that are passionate about eCommerce, know very well that our industry's Holy Grail is called 'Conversion Rate Optimization'. Yet, the problem is that only a few professionals know how to implement a good methodology in order to gain maximum CRO results. The rest of us rely on some past experience, a couple of white papers and/or some youtube videos. All that, until I recently discovered the Optimization Academy. I have downloaded/subscribed to numerous courses, so I said 'why not?'. I have to admit, without being too excessive, that it was one of the best personal investments, the past few years. Very practical, spot-on, fast, entertaining and above all very qualitative. To the point, I restarted the course, once I finished it, to discover more and more data.  Thus, at the end of the day, it comes to the big question... "Would I recommend it?". To my good friends and colleagues, definitely yes. To my competitors, I guess not. :-)
    E-Business Manager, BSB Fashion

    Dimitris Travlos

    E-Business Manager, BSB Fashion

    Frankly, Mr. Imhoff is one of the very few who manages to impress me every single time I meet him. If you’re really into actionable insights, practice over theory, efficiency over extravagance, precision over vagueness – and all these expressed with a wonderful non-political correct attitude.
    Watch Intro Video


    Get to know the Optimization Academy

    CRO course bundle

    Get 1 year unlimited access to all 30+ courses, 240+ lessons in over 50 hours of videos training.