Dynamic Pricing

Bjorn  Rupp Jorn Altmann and Pravin Varaiya. Internet demand under different pricing schemes. In Proceedings of ACM Conference on Electronic Commerce (EC-99, number 1, pages 9-14, 1999. W.L. Baker, E. Lin, M.V. Marn, and C.C. Zawada. Getting prices right on the web. The McKinsey Quarterly, 10(2):1-20, 2001. D. P. Bertsekas and J. Tsitsiklis. Neuro-dynamic Programming. Athena Scientific, Boston, MA, USA, 1996. M. Bichler. The Future of eMarkets: Multi-Dimensional Market Mechanisms. Cambridge University Press, Cambridge, UK, 2001. M. Bichler, R.D. Lawrence, J. Kalagnanam, H.S. Lee, K. Kartircioglu, G.Y. Lin, A.J. King, and Y. Lu. Applications of flexible pricing in business-to-business electronic commerce. IBM Systems Journal, 41(2):287-302, 2002. V. S. Borkar. Reinforcement learning in markovian evolutionary games. Advances in Complex Systems, 5:55-72, 2002. C.H. Brooks, R. Fay, R. Das, J. K. MacKie-Mason, J.O. Kephart, and E.H. Durfee. Automated strategy searches in an electronic goods market: Learning and complex price schedules. In Proceedings of the First ACM Conference on Electronic Commerce (EC-99), pages 31-40, 1999. C.H. Brooks, E.H. Durfee, and R. Das. Price wars and niche discovery in an information economy. In Proceedings of the Second ACM Conference on Electronic Commerce (EC-00), pages 95-104, 2000. A.X. Carvalho and M.L. Puttman. Dynamic pricing and reinforcement learning, 2003. L.M.A. Chan, Z. J. M. Shen, D. Simchi-Levi, and J. Swann. Review of dynamic and online pricing research to improve supply chain performance. In Handbook on Supply Chain Analysis in the eBusiness Era. Kluwer Academic Publishers, 2001. L.M.A. Chan, D. Simchi-Levi, and J. Swann. Dynamic pricing strategies for manufacturing with stochastic demand and discretionary sales. Technical report, Industrial Engineering and Operations Research, Northwestern University, USA, 2002. J. Abounadi, D. Bertsekas, and V.S. Borkar. Learning algorithms for markov decision processes with average cost. Technical report, Lab. for Info. and Decision Systems, M.I.T., USA, 1996. A. Chavez and P. Maes. Kasbah: An agent marketplace for buying and selling goods. In First International Conference on the Practical Application of Intelligent Agents and Multi-Agent Technology (PAAM'96), pages 75-90, London, UK, 1996. Practical Application Company. K. Clay, R. Krishnan, and E. Wolff. Price strategies on the web: Evidence from the online book industry. In Proceedings of the Second ACM Conference on Electronic Commerce (EC-00), pages 44-55, 2000. Prithviraj Dasgupta and Rajarshi Das. Dynamic pricing with limited competitor information in a multi-agent economy. In Conference on Cooperative Information Systems, pages 299-310, 2000. A. Davenport and J. Kalagnanam. Price negotiations for direct procurement. Research Report RC 22078, IBM Research, Yorktown Heights, NJ, USA, 2001. C.A. Deck and B.J. wilson. Interactions of automated pricing algorithms: An experimental investigation. In Proceedings of the Second ACM Conference on Electronic Commerce (EC-00), Minneapolis, MN, pages 77-85, 2000. Joan Morris DiMicco, Amy Greenwald, and Pattie Maes. Learning curve: A simulation-based approach to dynamic pricing, 2002. J.M. DiMicco, A. Greenwald, and P. Maes. Dynamic pricing strategies under a finite time horizon. In Proceedings of the Third ACM Conference on Electronic Commerce (EC-01), pages 51-60, 2001. Parijat Dube, Vivek S. Borkar, and D. Manjunath. Differential join prices for parallel queues: Social optimality, dynamic pricing algorithms and application to internet pricing, 2002. W. Elmaghraby and P. Keskinocak. Dynamic pricing: Research overview, current practices and future directions, 2002. N. I. Farag and M. W. Alstyne. Information technology - a source of friction? an analytical model of how firms combat price competition online. In Proceedings of the Second ACM Conference on Electronic Commerce (EC-00), 2000. A. Federgruen. On n-person stochastic games with denumerable state space. Advances in Applied Probability, 10:452-471, 1978. A. Federgruen and A. Heching. Combined pricing and inventory control under uncertainty. Operations Research, 47:454-475, 1999. G. Gallego and G. van Ryzin. Optimal dynamic pricing of inventories with stochastic demand over finite horizons. Management Science, 40(8):999-1020, 1994. Greenwald A, J. O.Kephart, and G. J. Tesauro. Strategic pricebot dynamics. In Proceedings of the First ACM Conference on Electronic Commerce (EC-99), 1999. P. Hong, R. P. McAfee, and A. Nayyar. Equilibrium price dispersion with consumer inventories. Journal of Economic Theory, 22:1-15, 2001. J. Hu and M. P. Wellman. Multiagent reinforcement learning: theoretical framework and an algorithm. In Proc. 15th International Conf. on Machine Learning, pages 242-250. Morgan Kaufmann, San Francisco, CA, 1998. Junling Hu and Yilian Zhang. Online reinformcenet learning in multiagent systems, 2002. S. Karlin and C.R. Carr. Prices and optimal inventory policies. Studies in Applied Probability and Management Science, 1962. P.K. Kannan and P.K. Kopalle. Dynamic pricing on the internet: Importance and implications for consumer behavior. International Journal of Electronic Commerce, 5(3):63-83, 2001. J. O. Kephart and A. R. Greenwald. Shopbot economics. In Proceedings of the Fifth European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty, pages 208-220, 1999. Jeffrey O. Kephart, James E. Hanson, and Amy R. Greenwald. Dynamic pricing by software agents. Computer Networks (Amsterdam, Netherlands: 1999), 32(6):731-752, 2000. J.O.Kephart and S.A. Fay. Competitive bundling of categorized information goods. In Proceedings of the Second ACM Conference on Electronic Commerce (EC-00), Minneapolis, MN, 2000. J. O. Kephart and G. J. Tesauro. Pseudo-convergent Q-learning by competitive pricebots. In Proc. 17th International Conf. on Machine Learning, pages 463-470. Morgan Kaufmann, San Francisco, CA, 2000. J. O. Kephart, C. H. Brook, and R. Das. Pricing information bundles in a dynamic environment. In Proceedings of the Third ACM Conference on Electronic Commerce (EC-01), pages 180-190, 2001. P. Keskinocak and S. Tayur. Quantitative analysis for internet enabled supply chains. Interfaces, 31(2). V. R. Konda and V. S. Borkar. Actor-critic type learning algorithms for markov decision processes. SIAM Journal on Control and Optimization, 38:94-123, 1999. A. Lau and H.S. Lau. The newsboy problem with price-dependent demand distribution. IIE Transactions, 20:168-175, 1988. R.D. Lawrence. A machine-learning approach to optimal bid pricing. Research report, IBM, July 2002. M. L. Littman. Markov games as a framework for multi-agent reinforcement learning. In Proceedings of the Eleventh International Conference on Machine Learning, pages 157-163, 1994. M. L. Littman. Friend-or-foe q-learning in general-sum games. In Proceedings of the Eighteenth International Conference on Machine Learning, pages 322-328, 2001. B. Leloup and L. Deveaux. Dynamic pricing on the internet: Theory and simulations. Journal of Electronic Commerce Research, 1(3):265-276, 2001. P. M. Markopoulos and Lyle H. Ungar. Pricing price information in e-commerce. In Proceedings of the Third ACM Conference on Electronic Commerce (EC-01), pages 260-263, 2001. S. Matsubara. Adaptive pricing that can withstand buyer collusion of false-type-declaration. In Proceedings of the Third ACM Conference on Electronic Commerce (EC-01), pages 249-252, 2001. J.I. Mcgill and G.J. van Ryzin. Revenue management: Research overview and prospects. Transportation Science, 33(2):233-256, 1999. J. Morris, P. Ree, and P. Maes. Sardine: Dynamic seller strategies in an auction marketplace. In Proceedings of the Second ACM Conference on Electronic Commerce (EC-00), pages 128-134, 2000. Y. Narahari, C.V.L. Raju, and Sourabh Shah. Dynamic pricing models for electronic business. Technical report, Electronic Enterprises Laboratory, Department of Computer Science an d Automation, Indian Institute of Science, July 2003. J. Kalagnanam and D. Parkes. Auctions, bidding and exchange design. In Supply Chain Analysis in the eBusiness Arena, pages 1-84. Kluwer Academic Publishers, 2003. A.C. Pigou. The Economics of Welfare. London: MacMillan, 1920. Puterman. Markov Decision Processes. Wiley Inter-science, 1994. C.V.L. Raju, Y. Narahari, and K. Ravi Kumar. Applications of reinforcement learning to dynamic pricing of retail markets. In Proceedings of the IEEE Conference on Electronic Commerce, CEC-03, 2003. M. Gupta, K. Ravikumar, and M. Kumar. Adaptive strategies for price markdown in a multi-unit descending price auction: A comparative study. In Proceedings of the IEEE Conference on Systems, Man, and Cybernetics, pages 373-378, 2002. K. Ravikumar, G. Batra, and R. Saluja. Multi-agent learning for dynamic pricing games of service markets. Communicated, 2002. W.J. Reinartz. Customising prices in online markets. EBF, 6:35-41, 2001. S.M. Ross. Introduction to Stochastic Dynamic Programming. Academic Press, 1983. S. Salop and J.E. Stiglitz. The theory of sales: A simple model of equilibrium price dispersion with identical agents. The American Economic Review, 72(5):1121-1130, 1982. C. Shapiro and H.L. Varian. Information Rules. HBR Press, Cambridge, MA, USA, 1998. S. Singh. Learning to solve markovian decision processes. Ph.d dissertation, University of Michigan, Ann Arbor, 1994. M. Smith, J. Bailey, and E. Brynjolfsson. Understanding Digital Markets: Review and Assessment. MIT Press, Cambridge, MA, 2000. B.C. Smith, D.P. Gunther, B.V. Rao, and R.M. Ratliff. E-commerce and operations research in airline planning, marketing, and distribution. Interfaces, 31(2), 2001. J.C. Spall. Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE Trans. Autom. Contr., 37(3), 1992. M. Sridharan and G. J. Tesauro. Multi-agent q-learning and regression trees for automated pricing decisions. In In Proc. 17th International Conf. on Machine Learning. Morgan Kaufmann, San Francisco, CA, 2000. Anita Srivastava. Dynamic pricing models: Opportunity for action. Technical report, Cap Gemini Ernst & Young Center for Business Innovation, 2001. G. Stigler. The economics of information. Journal of Political Economics, 69:213-225, 1961. J. Stiglitz. Equilibrium in product markets with imperfect information. American Economic Review Proceedings, 69:339-345, 1979. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998. J. Swann. Flexible pricing policies: Introduction and a survey of implementation in various industries. Technical Report Contract Report # CR-99/04/ESL, General Motors Corporation, October 1999. J. Swann. Dynamic pricing models to improve supply chain performance. Technical report, Doctoral Dissertation, Northwestern University, 2001. J. Swann. The right-price consultants (a dynamic pricing case study). Continnuum Publishing, October 2002. G. Tesauro and J. O. Kephart. Pricing in agent economies using multi-agent q-learning. In Proceedings of Workshop on Decision Theoretic and Game Theoretic Agents, London, England, 1999. G. Tesauro and J. O. Kephart. Pricing in agent economies using neural networks and multi-agent q-learning. In In Proceedings of Workshop ABS-3: Learning About, From and With other Agents (held in conjunction with IJCAI'99), Stockholm, Sweden, 1999. G. Tewari and P. Maes. Design and implementation of an agent-based intermediary infrastructure for electronic markets. In Proceedings of the Second ACM Conference on Electronic Commerce (EC-00), pages 86-94, 2000. G.T. Thowsen. A dynamic nonstationary inventory problem for a price/quantity setting firm. Navel Research Logistics Quarterly, 22:461-476, 1975. H. R. Varian. A model of sales. The American Economic Review, pages 651-659, 1980. H. R. Varian. Price discrimination. In R. Schmalensee and R. Willig, editors, Handbook of Industrial Organization. 1989. H. R. Varian. Differential pricing and efficiency. First Monday, 1, 1996. C. J. C. H. Watkins and P. Dayan. Q-learning. Machine Learning, 8:279-292, 1992. M. P. Wellman and J. Hu. Conjectural equilibrium in multiagent learning. Machine Learning, 33(2-3):179-200, 1998. R.M. Weiss and A.K. Mehrotra. Online dynamic pricing: Efficiency, equity, and the future of e-commerce. Virginia Journal of Law and Technology, 11:1-10, 2001. E. Zabel. Monopoly and uncertainty. The Review of Economic Studies, 37:205-219, 1970.

Intel Laboratory for Internet Technologies and E-Commerce Department of Computer Science and Automation Indian Institute of Science