Every few years a new book is published extolling a new way of thinking about business management. Some of these books find their way into the canon of management thought, if perhaps only for a specific industry. Most management theories, however, are based primarily on anecdotal evidence from the author’s experience. Other success stories are sometimes cited from outside sources, but as any statistician would tell you, this is a case of choosing data which fits the model. As a result, we’ve built up a body of management knowledge which may or may not be empirically true, and is therefore susceptible to being swept away by the next fad.

In the world of Startups, I would say that Clayton Christensen’s The Innovator’s Dilemma, Geoffrey Moore’s Crossing the Chasm, and Steve Blank’s The Four Steps to Epiphany have all made it into the canon of management thought (even if most entrepreneurs refuse to call themselves managers). More recently, Eric Ries of The Lean Startup Movement, which itself is an offshoot of Steve Blank’s theories on Customer Development, published The Lean Startup, codifying the central tenets of the movement and highlighting specific examples where they have been applied (especially IMVU, where Ries and company first developed their theory). Time will tell if The Lean Startup will last as a management theory, but all signs so far seem to indicate that it will.

But is The Lean Startup empirically true, or only anecdotally so?

The answer lies in Jim Collins’ Great By Choice, also released in 2011, which examines the question “Why do some companies thrive in uncertainty, even chaos, while others do not?”. If you’re not familiar with Jim Collins’ previous works, they all follow a similar formula: comb through historical business data in search of companies which meet certain criteria (in this case, achieving 10X performance over a 22 year period of relatively tumultuous conditions) and compare them to their peers, teasing out what characteristics differentiates them in an attempt to explain what caused their relative success. While this method certainly has its shortcomings, it is heavily data-driven, in contrast to most other works on management theory.

The question answered by Great By Choice is eerily similar to the stated goal of The Lean Startup, which is to increase entrepreneurs’ odds of building a successful startup, defined by Ries as “a human institution designed to create a new product or service under conditions of extreme uncertainty.” (pg 27) Jim Collins has inadvertently created the perfect empirical dataset by which to test the principles of The Lean Startup by finding the differentiating traits of those human institutions which thrive in conditions of uncertainty.

So let’s examine what Ries sets out as the five principles of the Lean Startup (pgs 8-9) in light of the evidence presented by Collins:

1. Entrepreneurs are Everywhere

If a startup is any human institution that meets Ries’ definition, this principle validates this comparison of Ries’ theory to Collins’ findings.

2. Entrepreneurship is Management

Again, this principle simply validates the comparison; entrepreneurs are not just creating a product, they are building an institution that thrives in uncertainty.

3. Validated Learning

Ries explains that startups exist to learn, and they way to do that is through validated learning: small scale experiments to test different aspects of the product vision. This process is exhibited in Jim Collins’ “Shoot Bullets” approach in which a low-risk, low-reource method is used to calibrate a new product or service.

4. Build-Measure-Learn

This is the process that embodies Validated Learning above. The cycle for a startup is to build a product and measure it’s success, constantly iterating to improve it. This concept is validated in Collins’ “Shoot bullets, then cannonballs” approach in which successful institutions were able to experiment with new products and continually tweak them until they got them to a point of dead-on accuracy, which Ries might call Product-Market Fit. Collins’ firms, however, were shown to “Shoot cannonballs” after achieving Product-Market Fit, putting all of their resources behind the successful concept. The difference between the two works is likely due to the resources available to each typical firm, in Ries’ case, a resource-starved startup.

5. Innovation Accounting

Innovation Accounting is how startups can measure their progress. Ries describes most startups as needing to measure their performance against metrics which make up the startups engine of growth. Taken at a more abstract level, this focus on consistent, measurable performance is echoed by Collins’ 20 Mile March concept, in which firms adhered to certain rigorous standards of performance, which may or may not be financial, year in and year out. Stryker’s was 20% sales growth. Progressive’s a combined ratio of 96%. Likewise, Ries advises startups to determine the critical metrics in their businesses and focus on them.

Beyond the Lean Startup

Great By Choice contains a few other topics that are not addressed in The Lean Startup, or at least not in the same way, the most notable of which is Collins’ concept of leading above the Death Line, stockpiling resources for times of distress that are almost certainly around the corner in order to survive bad outcomes. This is perhaps what differentiates a startup from another institution in uncertain times: the inability to mitigate Death Line risk by stockpiling resources. This is probably also the source of a common piece of advice given to entrepreneurs: raise money before you need it. 

Collins’ book also extends beyond simply bringing a new product to market and describes how these firms continue to succeed in uncertain times by applying the same recipe over and over.

Outcome

From an empirical perspective, it seems that the principles that Ries advises startups to employ while bringing a product to market in conditions of uncertainty are spot-on. This isn’t exactly a hard-hitting analysis, but I think it’s clear that Ries’ principles can result in success in uncertain times, at least according to Jim Collins’ analysis.

These two books in tandem form an essential guidebook to any entrepreneur and they validate each other’s findings even while looking through totally different lenses. Empirical validation of management theory is rare, and the existence of it here should be a call to action to implement these principles in your startup.

Have you read these works? Have you found contradictory evidence? Let’s discuss in the comments.