Jeffrey Hicks

Jeffrey Hicks

Platform Eng @R360

Why Greatness Cannot Be Planned: The Myth of the Objective

Kenneth O. Stanley and Joel Lehman challenge the belief that clear objectives are key to achieving greatness, advocating for novelty search and open-ended exploration instead

By Kenneth O. Stanley & Joel Lehman • Jan 1, 2015

The Myth of the Objective

Kenneth O. Stanley and Joel Lehman present a provocative challenge to the widespread belief that clear objectives are the key to achieving greatness. Their research suggests that many of the greatest discoveries and achievements in history—from penicillin to computers—arose not from rigid, objective-driven processes, but from open-ended exploration and serendipitous events.

Objectives Can Limit Innovation

The authors argue that rigid goals can act like a “broken compass,” potentially leading to dead ends or mediocrity instead of breakthroughs. When we focus too narrowly on predetermined objectives, we may miss the unexpected paths that lead to true innovation.

The Stepping Stone Principle

Using the metaphor of crossing a foggy river by stepping stones, Stanley and Lehman illustrate how big achievements require navigating uncertainty. You can’t see the other bank or which stones will get you there. If you only step toward visible, predetermined objectives, you might never find the best path—or any path at all.

Real progress often requires:

  • Side-steps and back-steps
  • Moving in unexpected directions
  • Following paths that only make sense in hindsight

Novelty Search: A New Paradigm

Instead of optimizing for specific, measurable goals, the authors introduce novelty search—seeking new, interesting, or different behaviors and approaches rather than rewarding progress toward fixed objectives. This approach, developed originally in AI research, often leads to more surprising, creative, and ultimately useful results.

The Objective Paradox for Ambitious Projects

For ambitious or open-ended projects, objectives can be harmful. The greatest achievements are less likely to occur when made explicit objectives. Sometimes, the best way to achieve something great is to stop trying to do that specific “great thing”—just explore interesting directions and let greatness emerge.

Broader Implications Beyond AI

While rooted in evolutionary algorithms and AI research, Stanley and Lehman’s critique extends to:

Education

  • Overreliance on standardized testing stifles creativity
  • Metrics and KPIs can limit organic learning
  • Open-ended exploration should be valued over rigid curricula

Business and Innovation

  • Fixed objectives can prevent breakthrough discoveries
  • Encouraging experimentation and “treasure hunting” in ideas
  • Embracing failure as part of the discovery process

Personal Development

  • Following curiosity rather than predetermined career paths
  • Allowing serendipity to guide growth and learning

Practical Guidance

The authors suggest that while objectives are useful for modest, well-defined problems, they become counterproductive for innovation, creativity, and audacious pursuits. Instead of mapping out the entire route to success, focus on:

  • Finding interesting stepping stones
  • “Treasure hunting” in the landscape of ideas or skills
  • Trusting that each interesting discovery leads to more opportunities
  • Following what genuinely sparks curiosity

Key Examples and Case Studies

The book illustrates how the biggest successes are often unplanned through examples from:

  • AI and machine learning - How breakthrough algorithms emerged from unexpected approaches
  • Biological evolution - How complexity arose without predetermined goals
  • Scientific discoveries - How major breakthroughs came from following interesting anomalies
  • Career paths - How remarkable careers developed through unexpected opportunities

The Path to Greatness

Greatness, especially in complex or innovative pursuits, cannot be reliably engineered through rigid objectives, checklists, or metrics. The path is unpredictable, littered with unexpected stepping stones. To achieve remarkable outcomes:

  1. Embrace curiosity over predetermined paths
  2. Follow what’s interesting rather than what’s planned
  3. Let go of obsession with objectives in creative endeavors
  4. Trust the process of open-ended exploration
  5. Value novelty and diversity of approaches

The core message: Sometimes the best way to achieve something great is to stop trying to achieve it directly, and instead follow the stepping stones of genuine interest and curiosity.

Related

#design