April, 2004: My recent paper When Do Differences Matter? On-Line Feature Extraction Through Cognitive Economy describes how cognitive economy may be worked out in a reinforcement learning system, and presents experimental studies based on the puck-on-a-hill task. Contributions of this paper include a description of how the idea of cognitive economy addresses the open problem of knowing how accurately we need to learn the action values, and a new methodology for testing and camparing representations by means of learning curves.

May 26, 2002: Until I rewrite this page, my dissertation gives the best summary of my recent work. The abstract page summarizes the dissertation and gives links to downloadable versions in PDF and compressed PostScript formats.

Some Reinforcement Learning Resources

My publications

Short subjects:

Simulation code for several control problems:

Other RL resources:


David J. Finton March 15, 2005