Skip to content
Last Dictionary

uplift modeling

nounAlso: uplift modelling, uplift model, incremental response modeling, true lift modeling, net lift modeling, differential response modeling

In plain wordsPredicting not who will buy, recover or respond, but whose behavior will actually change because of an action such as a discount or a treatment, so that it is offered only where it makes a difference.

  1. A predictive method that targets the difference an intervention makes rather than the outcome itself: for each person, it estimates how much an action such as a drug, a discount or a call to a wavering customer would shift their expected outcome compared with doing nothing. In causal inferencecausal inference, n.: Working out whether one thing actually causes another, rather than merely occurring alongside it — for example, whether a new feature made users stay longer or just happened at the same time. terms this is the conditional average treatment effect given the person's features. Because no one is observed both treated and untreated, models are trained on data in which treatment was assigned at random, as in an A/B testA/B testing, n.: Comparing two versions of something — two models, two prompts, two designs — by randomly showing each to different groups of real users and measuring which works better., or with careful adjustment for confounding. Approaches include separate outcome models for treated and control groups (the two-model or T-learner), a single model with treatment as a feature (S-learner), X-learners, class-transformation tricks, uplift decision treesdecision tree, n.: A model that makes a prediction by asking a series of yes-or-no questions about the input, like a flowchart, with each answer leading to the next question until it reaches a final answer. whose splits maximize the treatment–control difference, and causal forests. Evaluation uses Qini and uplift curves on held-out randomized data. Marketers classically divide customers into persuadables, sure things, lost causes and 'sleeping dogs', whom an offer would put off.

    The uplift model told us to stop calling loyal customers, since the retention call made no difference to them.

τ(x)=E[ Y∣X=x,T=1 ]−E[ Y∣X=x,T=0 ]\tau(\mathbf{x}) = \mathbb{E}[\,Y \mid \mathbf{X} = \mathbf{x}, T = 1\,] - \mathbb{E}[\,Y \mid \mathbf{X} = \mathbf{x}, T = 0\,]

Origin

Developed in direct marketing in the late 1990s and early 2000s, notably by Nicholas Radcliffe and Patrick Surry ('differential response analysis', 1999), Victor Lo ('true lift model', 2002) and Behram Hansotia and Brad Rukstales ('incremental value modeling', 2002). Uplift trees by Piotr Rzepakowski and Szymon Jaroszewicz (2012) and the meta-learner framework of Sören Künzel and colleagues (2019) tied it to machine learning and causal inference.

Usage note

Ordinary response models target people likely to buy anyway, wasting offers on sure things and provoking sleeping dogs; uplift models target the change itself. Unrelated to the safety sense of uplift, which measures how much an AI model increases a person's ability to cause harm (see uplift studyuplift study, n.: An experiment that measures how much an AI really helps people do a task — often a dangerous one, like planning a biological attack — compared with people using only ordinary resources such as the internet.).

Related

See also
  • causal inferencecausal inference, n.: Working out whether one thing actually causes another, rather than merely occurring alongside it — for example, whether a new feature made users stay longer or just happened at the same time.
  • A/B testingA/B testing, n.: Comparing two versions of something — two models, two prompts, two designs — by randomly showing each to different groups of real users and measuring which works better.
  • counterfactualcounterfactual, n.: A statement about what would have happened if something had been different — 'had I left earlier, I would have caught the train'. AI uses counterfactuals to explain decisions and to measure causes.
  • structural causal modelstructural causal model, n.: A precise description of what causes what in a system — a diagram of arrows plus equations — that predicts what would happen if you intervened, not just what tends to occur together.
  • random forestrandom forest, n.: A prediction method that builds hundreds of decision trees, each from a random sample of the data and features, and lets them vote. The crowd is far more reliable than any single tree.
  • click-through rate predictionclick-through rate prediction, n.: Estimating how likely a particular person is to click on a particular ad, search result or recommended item: a prediction made billions of times a day to decide what each user is shown.
Contrast with
  • uplift studyuplift study, n.: An experiment that measures how much an AI really helps people do a task — often a dangerous one, like planning a biological attack — compared with people using only ordinary resources such as the internet.

Sources

  1. Radcliffe, N. J. & Surry, P. D. (1999). Differential Response Analysis: Modeling True Response by Isolating the Effect of a Single Action. Proc. Credit Scoring and Credit Control VI, Edinburgh.
  2. Künzel, S. R., Sekhon, J. S., Bickel, P. J. & Yu, B. (2019). Metalearners for Estimating Heterogeneous Treatment Effects Using Machine Learning. PNAS 116(10), 4156–4165.

Mentioned in

click-through rate predictionclick-through rate prediction, n.: Estimating how likely a particular person is to click on a particular ad, search result or recommended item: a prediction made billions of times a day to decide what each user is shown.