Discrete-time zero-sum games for Markov chains with risk-sensitive average cost criterion
Informal Systems Seminar (ISS), Centre for Intelligent Machines (CIM) and Groupe d'Etudes et de Recherche en Analyse des Decisions (GERAD)
Speaker: Subrata Golui
**Ìý±·´Ç³Ù±ðÌý³Ù³ó²¹³ÙÌý³Ù³ó¾±²õÌý¾±²õÌý²¹Ìý³ó²â²ú°ù¾±»åÌý±ð±¹±ð²Ô³Ù.
**Ìý°Õ³ó¾±²õÌý²õ±ð³¾¾±²Ô²¹°ùÌý·É¾±±ô±ôÌý²ú±ðÌý±è°ù´ÇÂá±ð³¦³Ù±ð»åÌý²¹³ÙÌý²Ñ³¦°ä´Ç²Ô²Ô±ð±ô±ôÌý437Ìý²¹³ÙÌý²Ñ³¦³Ò¾±±ô±ôÌý±«²Ô¾±±¹±ð°ù²õ¾±³Ù²â.
²Ñ±ð±ð³Ù¾±²Ô²µÌý±õ¶Ù:Ìý845Ìý1388Ìý1004ÌýÌýÌýÌýÌýÌýÌý
±Ê²¹²õ²õ³¦´Ç»å±ð:Ìý³Õ±õ³§³§
Abstract:
We study zero-sum stochastic games for controlled discrete time Markov chains with risk-sensitive average cost criterion with countable/compact state space and Borel action spaces. The payoff function is nonnegative and possibly unbounded for a countable state space case and for a compact state space case, it is a real-valued and bounded function. For the countable state space case, under a certain Lyapunov-type stability assumption on the dynamics we establish the existence of the value and a saddle point equilibrium. For the compact state space case, we establish these results without any Lyapunov-type stability assumptions. Using the stochastic representation of the principal eigenfunction of the associated optimality equation, we completely characterize all possible saddle point strategies in the class of stationary Markov strategies.
Bio:
My name is Subrata Golui and I am a postdoctoral fellow in the Department of Mathematics, Indian Institute of Technology, Bombay. I obtained PhD degree at Indian Institute of Technology Guwahati under the supervision of Dr. Chandan Pal on 5th July 2023. My thesis title is Risk-sensitive stochastic control and games. My research interests can be broadly classified into three areas: stochastic control theory, stochastic game theory, and queueing theory. Currently, I am working on the stochastic control theory. More specifically, I am studying the metastable behaviour exhibited by the Markov processes. I have 8 published articles and one more self-authored research work has been submitted for publication.