MODELING CUSTOMER RELATIONSHIPS
AS MARKOV CHAINS
Phillip E. Pfeifer
Robert L. Carraway
The lifetime value of a customer is an important and useful
concept in interactive marketing. Courtheaux (1986) illustrates its usefulness for a number of managerial problems—the most obvious if not the most important being the budgeting of marketing expenditures for customer acquisition. It can also be used to help allocate spending across media (mail vs. telephone vs. television), vehicles (list A vs. list B), and programs (free gift vs. special price), as well as to inform decisions with respect to retaining existing customers (see, e.g., Hughes, 1997). Jackson (1996) even argues that its use helps ﬁrms to achieve a strategic competitive advantage.
Dwyer (1989) helped to popularize the lifetime value (LTV)
concept by illustrating the calculation of LTV for both a customer retention and a customer migration situation. Customer retention refers to situations in which customers who are not retained are considered lost for good. In a customer retention situation, nonresponse signals the end of the ﬁrm’s relationship with the customer. In contrast, customer migration situations are those in which nonresponse does not necessarily signal the end of the relationship. Besides articulating this distinction between customer retention and migration, Dwyer listed several impediments to the use of LTV.
More recently, Berger and Nasr (1998) argue for the impor© 2000 John Wiley & Sons, Inc. and Direct Marketing Educational Foundation, Inc.
JOURNAL OF INTERACTIVE MARKETING
VOLUME 14 / NUMBER 2 / SPRING 2000
PHILLIP E. PFEIFER AND
ROBERT L. CARRAWAY are with
the Darden School of Business,
JOURNAL OF INTERACTIVE MARKETING
between an individual customer and a marketing ﬁrm.
In addition to its ﬂexibility, the MCM offers
other advantages. Because it is a probabilistic
model, it explicitly accounts for the uncertainty
surrounding customer relationships. It uses the
language of probability and expected value—
language that allows one to talk about the ﬁrm’s
future relationship with an individual customer.
As direct marketers move toward true one-toone marketing, we suggest that their language will also change. Rather than talking about
groups or cohorts of customers, direct marketers will talk about Jane Doe. Rather than talking about retention rates, they will talk about the
probability Jane Doe will be retained. Rather
than talking about average proﬁts from a segment
of customers, they will talk about the expected
proﬁt from their relationship with Jane Doe.
Because the MCM incorporates this language of
probability and expected value, it is ideally
suited for facilitating true one-to-one marketing.
Another advantage of the MCM is that it is
supported by a well-developed theory about
how these models can be used for decision making (see, e.g., Puterman, 1994). We will introduce the theory surrounding Markov decision processes, and illustrate how this theory can
help direct marketers manage and optimize
their relationships with individual customers.
The MCM also works quite nicely with the
popular Recency, Frequency, Monetary value
(RFM) framework (see, e.g., David Shepard Associates, Inc., 1995), which direct marketers use to categorize customers and manage customer
relationships. We will illustrate the relationship
between the MCM and the RFM framework.
This paper is organized as follows. After this
introduction, we present the fundamentals of
the MCM. The section following that will illustrate the use of the MCM for a variety of customer relationship assumptions. For these illustrations, we will choose customer situations similar to those addressed previously in the literature. A ﬁnal section will illustrate the use of MCM and Markov decision processes to help a
ﬁrm optimize a customer relationship. For this
illustration, we look at a catalog company...
References: Berger, P.D., & Nasr, N.I. (1998). Customer Lifetime
Value: Marketing Models and Applications
Blattberg, R.C. (1998). Managing the Firm Using
Blattberg, R.C. (1987). Research Opportunities in
Blattberg, R., & Deighton, J. (1996). Manage Marketing
by the Customer Equity Test
Bronnenberg, B.J. (1998). Advertising Frequency Decisions in a Discrete Markov Process Under a Budget
Courtheaux, R.J. (1986). Database Marketing: Developing a Proﬁtable Mailing Plan. Catalog Age, June–
Hillier, F.S., & Lieberman, G.J. (1986). Introduction
to Operations Research (4th ed.)
Hughes, A.M. (1997). Customer Retention: Integrating
Lifetime Value into Marketing Strategies
Jackson, B. (1985). Winning and Keeping Industrial
Jackson, D.R. (1996). Achieving Strategic Competitive
Advantage Through the Application of the LongTerm Customer Value Concept
Puterman, M.J. (1994). Markov Decision Processes: Discrete Stochastic Dynamic Programming. New York:
John Wiley & Sons.
White, D.J. (1993). A Survey of Applications of
Markov Decision Processes
the Operational Research Society, 44 (11), 1073–
Please join StudyMode to read the full document