1. Project Ideas
Apply and/or extend ideas from class to a non-trivial application/problem.
Sometimes this may involve doing a project that focuses on evaluation using a simulation of the application domain.

2. Leverage your own research area
Related an aspect of your own research to ideas from the course
I support leveraging your own research
I do not support turning in already finished aspects of your research as a project.
The project must be something you implement and complete this quarter beyond what you have already done.

3. Example Applications/Problems
Pick a challenging sequential decision making problem
Apply/extend one or more of our planning/learning approaches to it and evaluate
Problems from past projects:
Games
Tetris
Pokemon
Blockus
Chess
Backgammon
Othello
Clue
Space Wars (Galcon Fusion)
Starcraft
Pac Man
Hearthstone

4. Solve a Particular Problem
Problems from past projects:
Compiler scheduling
Adaptive Java program optimization
Forest Fire Management
Crop Management
Optimizing Policies for Network Protocols
Optimizing file sharing policies
Optimizing multi-robot navigation/search
Optimizing policies for Option Pricing
Reinforcement learning and Monte-Carlo were the most commonly applied solution approaches
But some problems can be formulated so that they could be solved exactly via value iteration