A collection of some wisdom for working with models.

Some lessons may also apply to humans. 😉

Strategy

1. Build systems that leverage models; don’t build models.
2. Expect models to get smarter and cheaper.
3. Create systems that perform better when scaled.
4. The human brain is a beautiful starting point for agent design, but also build simple systems that scale with more compute.

Thinking Well

1. Novelty requires some randomness.
2. Models discern great ideas quicker than they create them.
3. Big problems require lots of thought.
4. The quality distribution of thought/experience is Gaussian.
5. The quality of a thought depends on other highly-rated, semantically similar thoughts.
6. Comparing ideas is easiest when head-to-head.
7. Asking why a thought is true may uncover useful ideas for evaluating the thought’s quality.
8. Asking a model to avoid existing thoughts more efficiently produces new ideas than sampling the same model in a vacuum.
9. Nature loves recursion.