Context

Triptease is experimenting with a new Price Matching feature that can automatically adjust hotel prices to match OTA pricing. By doing this we hope to beat the OTAs at their own game and pull more guests back into booking direct.

A mock up of how Price Matching could work. We’ve adjusted down the direct price to beat the price from Expedia.com

A mock up of how Price Matching could work. We’ve adjusted down the direct price to beat the price from Expedia.com

You now have ~20mins to review the following sets of data.

AB Test Result

The data below shows the results of a fictional experiment that the squad have AB tested.

In this time, please:

  1. Build a funnel and analyse the test results - in a spreadsheet or tool of your choice.
  2. Calculate (if necessary) and note any numbers you consider to be important
  3. Be prepared to:

The funnel is for an experiment and control cohort. In the experiment cohort, we reduced the price of hotel rooms by 10% in order to beat the Expedia price whenever it was cheaper than the direct price. In the control cohort, we made no changes to the prices.

Our hypothesis is that we’ll see more conversions from the experimental cohort - but we’re not sure about if reducing the prices represents good value for the hotel.

Experiment Data