what are the failure modes of investigations which fail to incorporate the deep smarts and rely exclusively on methodology
Investigations that ignore “deep smarts”—the experiential knowledge of knowing what to ignore—and rely exclusively on rigid methodology often suffer from systemic pathologies that lead to “evolutionary dead ends”[1][2]. In complex systems, the “craft skill” of the practitioner is often what prevents the methodology from distorting reality to fit the model[3][4].
The following are the primary failure modes identified in the sources when investigations default to “handle-turning” over experiential wisdom:
1. The Error of the Third Kind (E3)
Exclusive reliance on methodology frequently leads to solving the wrong problem precisely[5]. This occurs when an investigator narrows the boundaries of a “mess” to fit their preferred technical or mathematical tools, effectively treating a wicked problem as a simple textbook exercise[6].
2. Functionalist “Handle-Turning”
The group known as The Other Group (TOG) critiques this as applying a framework (like VSM or Cynefin) mechanically without understanding the specific context or the “quality” of the outcome[10]. If a tool is applied correctly but yields no tangible value, it fails the “constitutive rule” of systems practice—it becomes a performative exercise in compliance rather than a discovery of truth[13][14].
3. The Green Lumber Fallacy
Popularized by Nassim Taleb, this failure mode involves mistaking “narrative knowledge” (theories and definitions) for “practical knowledge” (know-how)[15]. An investigator relying purely on methodology may be able to explain the “textbook” version of a system while remaining completely incapable of navigating its real-world risks, much like a trader who knows the biology of wood but cannot read the lumber market[16][17].
4. Ignoring the “Water” (Hard Constraints)
Methodologists often treat systems as fluid and informational, ignoring the hard physical and environmental constraints that practitioners (the “fish”) live in every day[18][19]. For example, applying “adaptive” management theories to a railway project while ignoring the fixed physical limits of Victorian-era infrastructure is a classic methodological failure[20].
5. Fragility and the “Agency Problem”
Methodology-heavy investigations often lack “Skin in the Game”[23]. When an “expert” provides a model-based forecast without facing any personal downside for being wrong, the resulting advice is “cheap talk”[25]. This leads to a transfer of fragility, where the investigator gains the “upside” of consulting fees while the organization bears the “downside” risk of the model failing[23][26].
6. Cognitive “Entrained Thinking”
Methodology acts as a filter that can cause inattentional blindness[27]. By following a standard procedure, investigators often miss “weak signals” or outliers—the 17% of data that doesn’t fit the expected pattern but indicates a coming crisis[28][29]. Deep smarts allow a veteran to spot the “dog that didn’t bark,” whereas a methodology only records the dogs it was programmed to hear[30][31].
7. Administrative Stasis
Many methodologies are “stasis-seeking,” aiming to return a system to a state of “Business As Usual”[14][32]. In a complex environment that is in constant flux, the desire for stability is a flaw; deep smarts recognize that the goal is viability and “muddling through” rather than a return to a non-existent equilibrium[32].
--------------------------------------------------------------------------------
In your current investigation, do you feel the pressure to produce a “precise” report is forcing you to ignore the “gut feel” or “tribal knowledge” of the veterans on the ground?
References
[1] 💬Gists.md [2] 💬Questions.md [3] 💬Gists.md [4] 💬Keywords + Jargon.md [5] 💬Environment.md [6] 💬Gists.md [10] 💬Gists.md [13] 💬Gists.md [14] 💬Keywords + Jargon.md [15] 💬Gists.md [16] 💬How To Guides.md [17] 💬Keywords + Jargon.md [18] 💬Questions.md [19] 💬What is Complexity.md [20] 💬Environment.md [23] 💬Gists.md [25] 💬Perspectives.md [26] 💬Nutshell (Process).md [27] 💬People Dynamics.md [28] 💬People Dynamics.md [29] 💬Perspectives.md [30] 💬Questions.md [31] 💬Questions.md [32] 💬Questions.md