24
edits
Wavelength (talk  contribs) (inserting 1 hyphen: —> "2dimensional"—wikt:2dimensional—wikt:3dimensional—wikt:4dimensional) 
(updated links to Meyn books) 

The discrete Poisson's equation arises in the theory of
[[Markov chain]]s. It appears as the relative value function for the dynamic programming equation in a [[Markov decision process]], and as the ''[[control variate]]'' for application in simulation variance reduction.<ref name=MCSS> S. P. Meyn and R.L. Tweedie, 2005. [http://
Second edition to appear, Cambridge University Press, 2009.</ref><ref name=CTCN> S. P. Meyn, 2007. [http://
==Footnotes==

edits