Stochastic Modeling for Inventory and Production Planning in the Paper Industry

Topics: Markov chain, Inventory, Markov decision process Pages: 71 (10858 words) Published: March 17, 2013
Stochastic Modeling for Inventory and Production
Planning in the Paper Industry
K. Karen Yin
Dept. of Bio-based Products, University of Minnesota, St. Paul, MN 55108

G. George Yin
Dept. of Mathematics, Wayne State University, Detroit, MI 48202

Hu Liu
3M Commerce Services, 3M Center, St. Paul, MN 55144
DOI 10.1002/aic.10251
Published online in Wiley InterScience (

Problem formulations and solution procedures of production planning and inventory management for manufacturing systems under uncertainties is discussed. Markov decision processes and controlled Markovian dynamic systems are used in the models. Considering an inventory problem in discrete time and formulating it by a finite-state Markov chain lead to a Markov decision process model. Using the policy-improvement algorithm yields the optimal inventory policy. In controlled dynamic system modeling, the random demand and capacity processes involved in planning are described by two finite-state continuoustime Markov chains. Such an approach enables us to embed the randomness in the differential equations of the system. The optimal production rates that minimize an expected cost are obtained by numerically solving the corresponding Hamilton–Jacobi– Bellman (HJB) equations. To overcome the so-called curse of dimensionality, frequently encountered in computation, we resort to a hierarchical approach. Illustrative examples using data collected from a large paper manufacturer are provided. © 2004 American Institute of Chemical Engineers AIChE J, 50: 2877–2890, 2004

Keywords: inventory management; production planning; Markov chain; optimal policy; hierarchical approach

In the pulp and paper industry, the search for good inventory control policies and production plans started several decades ago. Many models have been developed and used (see
Leiviska, 1999 and references therein). Nevertheless, similar to ¨
the situation in many other industries, inventory management and production planning remain to be challenging problems to paper manufacturers.
Correspondence concerning this article should be addressed to K. K. Yin at

© 2004 American Institute of Chemical Engineers

AIChE Journal

November 2004

Production planning and inventory management are crucial
components of any supply chain. Efficient planning and inventory policies are necessary for the successful operation of any modern-day enterprise. It is well known that manufacturing
systems are subject to random events such as raw material
variation, demand fluctuation, and equipment failures. The
dynamic and random nature of the demands makes their forecasting very difficult or sometimes impossible. Despite the existence of the various models, very often managers cannot
find a single one that is suitable to their needs. As a result, decisions on inventory have to be based on a combination of
experience, mathematical models, and even on the gut feeling of a few individuals, whereas production is planned following Vol. 50, No. 11


an everyday practice without concerning the optimality. It is desirable to shift such experience-based decision making to an information-based decision making model. This will require a systematic use of historical data and a theoretically sound

mathematical model that is applicable to the real situation. This work is intended to contribute in this direction.
A large manufacturer/corporation usually has a certain number of plants/mills at different geographical locations. Having a collection of machines/equipment, each plant has its own inventory with a fixed carrying cost. Characterized by its production rates for a given product type, each machine can produce multiple products. At any given time, the enterprise has a set of orders in hand. Each order specifies a customer, a product, an order quantity, and a due date. Orders are fulfilled on one or more machines of specified plant(s). To minimize the...

Cited: Applequist, G., O. Samikoglu, J. Pekny, and G. Reklaitis, “Issues in the
Use, Design and Evolution of Process Scheduling and Planning Systems,” ISA Trans., 36(2), 81 (1997).
Bertsekas, D., Dynamic Programming and Stochastic Control, Academic
Press, New York (1976).
Bertsekas, D., Dynamic Programming: Deterministic and Stochastic Models, Prentice-Hall, Upper Saddle River, NJ (1987).
Buffa, E. S., Modern Production/Operations Management, 6th Edition,
Wiley, New York (1980).
Davis, M. H. A., Markov Models and Optimization, Chapman & Hall, New
York (1993).
Fleming, W. H., and R. W. Rishel, Deterministic and Stochastic Optimal
Control, Springer-Verlag, New York (1975).
and Inventory Management,” Comput. Chem. Eng., 24(12), 2613 (2000).
Hillier, F. S., and G. J. Lieberman, Introduction to Operations Research,
5th Edition, Holden-Day, Oakland, CA (1990).
Leiviska, K., Process Control, Fapet Oy, Helsinki, Finland (1999).
Ross, S., Introduction to Stochastic Dynamic Programming, Academic
Press, New York (1983).
Ross, S., Introduction to Probability Models, Academic Press, New York
Sethi, S. P., and Q. Zhang, Hierarchical Decision Making in Stochastic
Manufacturing Systems, Birkhauser, Boston (1994).
Rev., 13(1), 116 (1934).
Systems,” J. Optim. Theory Appl., 83, 511 (1994).
Yin, G., and Q. Zhang, Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Springer-Verlag, New
York (1998).
RI (1997).
Systems,” Proc. IFAC Conf. of Youth Automation YAC ’95, pp. 450 –
454 (1995).
Zipkin, P. H., Foundations of Inventory Management, McGraw Hill, Boston (2000).
Manuscript received Jan. 31, 2003, and revision received Feb. 11, 2004.
Continue Reading

Please join StudyMode to read the full document

You May Also Find These Documents Helpful

  • Production Planning Essay
  • Benchmark for Improving Project Planning in Production (Farming) Industry Essay
  • Essay about Inventory and Master Production Schedule
  • Army Planning and Orders Production Essay
  • Aggregate Production Planning Essay
  • Production Planning Research Paper
  • How to Make It in the Modeling Industry Essay
  • Inventory Planning in a Small Business Essay

Become a StudyMode Member

Sign Up - It's Free