1. ABSTRACT
2. 1 INTRODUCTION
3. 2 ALGORITHMS FOR LOOKUP TABLES
4. 3 DIRECT ALGORITHMS
5. 4 RESIDUAL GRADIENT ALGORITHMS
6. 5 RESIDUAL ALGORITHMS
7. 6 STOCHASTIC MDPS AND MODELS
8. 7 MDPS WITH MULTIPLE ACTIONS
9. 8 RESIDUAL ALGORITHM SUMMARY
10. 9 SIMULATION RESULTS
11. 10 CONCLUSIONS
12. Acknowledgments
13. References