Exploration exploitation trade off
- Finding good solutions vs. finding them quickly is a trade off for
all creatures.
- That is you can spend a lot of time looking for a good solution, or
you can just satisfice.
- How long do you spend picking the right lunch?
- How long do you spend picking the right car?
- Once you've found a good path, do you ever try different paths?
(People do.)
- These are all questions about exploring the space, and exploiting
the knowledge you have gained.
- What happens if the environment changes?
- (Note this could also be said about the evaluation function.)
