17 Based on the number of unique ideas in the respective populations, we estimate the average size of the opportunity space for our base prompt is around 3700 ideas with 13.8% of ideas Based on the number of unique ideas in the respective populations, we estimate the average size of the opportunity space for our base prompt is around 3700 ideas with 13.8% of ideas being repetitive. For Chain of Thought it is around 4700 with around 11.7% of ideas considered the same. Overlap of Initial Ideas Given the observed but shrinking variance within pools over time, the question emerges whether ideas in pools differ or whether similar ideas are being generated each time. If the ideas between pools are different, an attractive option might involve combining multiple strategies and picking the most diverse ideas. Figure 4 below suggests that the overlap between ideas from multiple strategies is small. Only the first 50 ideas in each of the strategies’ pools were considered to allow for initial lower entropy effects to be more visible. Figure 4: Cosine similarity between ideas from different strategies (between-pools)