Scope
Define the Chargebee Retention Testing methodology.
What is the Chargebee Retention Testing Methodology?
How Chargebee Retention differs from other services?
Summary
To optimize Chargebee Retention's performance, we'll run a series of randomized tests designed to ensure your Chargebee Retention Offers to save the most customers from canceling. During testing, we look at and test performance in three ways:
- Offer Calibration
- Audience Discovery
- Page Optimization
Solution
A core component of Chargebee Retention is the ability to set up different tests across your entire canceled audience, or within a targeted Audience. The Chargebee Retention lets you take a statistical approach to establish what works best in your cancel experience by leveraging randomization to establish.
Offer Calibration
In this phase, we aim to discover winning offer combinations by randomly presenting users with a set of offers to determine which offers have the highest lift over the baseline. In the event that there is no clear winning offer combination, we'll shuffle the Offers and repeat.
Once we have a winner, we'll run additional experiments with micro-targeting to compare the winning Offer paired with Reasons.
Audience Discovery
Pulling information about your customers in via the Chargebee Retention JS snippet, we'll identify trends in customer groups by things like lifetime value, how long they've been a customer, activity, lead source, or even custom attributes. As trends emerge, we'll define them into customer groups, and test and target Offer against different audiences to maximize customers saved.
To continue testing, we'll pair audiences and Reasons with Offers to identify opportunities to further generate lift. In this phase, we are looking to identify the combo of which Audiences work with the best Offer.
Page Optimization
We'll also test the Offer location. We'll perform tests by presenting offers as pop-up modals when they land on the Chargebee Retention page, presenting offers, once reasons are selected, showcasing offers at the top of the page, and presenting offers to your customers after the final cancel button is selected.
We're happy to run tests with you to help optimize your Offers at any time! Contact Us and we'll devise a series of tests to save the most customers we can.
Here we will focus on the different types of tests you can set up in Chargebee Retention, and link to the relevant articles on how to configure each. We typically suggest that you start by thinking through our Testing Methodology first, and then dive into the actual testing setup in-app.
There are many use cases testing in Chargebee Retention, but the three most popular that we see are:
- Random Offer Tests across Entire Audience
- Targeted Offer Tests within Audiences
- A/B Testing in Chargebee Retention
If you have any questions or would like help getting started with a test in Chargebee Retention, please contact your dedicated Customer Success Manager (if available) or retention-support@chargebee.com and we will be happy to assist.
Related Articles
How to Integrate Chargebee Retention and Chargebee Billing?
How to configure Enrichment in Chargebee Retention?
After integration how to test the Chargebee retention cancellation process?