The general aim of this study is to provide a guide to the future marketing decisions of a firm, using a model to predict customer lifetime values. The proposed framework aims to eliminate the limitations and drawbacks of the majority of models encountered in the literature through a simple and industry-specific model with easily measurable and objective indicators. In addition, this model predicts the potential value of the current customers rather than measuring the current value, which has generally been used in the majority of previous studies. This study contributes to the literature by helping to make future marketing decisions via Markov decision processes for a company that offers several types of products. Another contribution is that the states for Markov decision processes are also generated using the predicted customer lifetime values where the prediction is realized by a regression-based model. Finally, a real world application of the proposed model is provided in the banking sector to show the empirical validity of the model. Therefore, we believe that the proposed framework and the developed model can guide both practitioners and researchers. (C) 2014 Elsevier B.V. All rights reserved.