On Value Iteration Convergence in Connected MDPs
<|reference_start|>On Value Iteration Convergence in Connected MDPs: This paper establishes that an MDP with a unique optimal policy and ergodic associated transition matrix ensures the convergence of various versions of the Value Iteration algorithm at a geometric rate that exceeds the discount factor {\gamma} for both discounted and average-reward criteria.<|reference_end|>
@article{mustafin2024on,
    title={On Value Iteration Convergence in Connected MDPs},
    author={Arsenii Mustafin, Alex Olshevsky, Ioannis Ch. Paschalidis},
    journal={arXiv preprint arXiv:2406.09592},
    year={2024},
    archivePrefix={arXiv},
    eprint={2406.09592},
    primaryClass={cs.LG}
}