Why Chaos Tempts Us, and When We Should Listen

The flight to Cincinnati was smooth, the drinks were flowing, and my boss was becoming increasingly ‘relaxed.’ By the time we landed, he wanted me to make a series of edits to the pitch deck for the next day despite it effectively being 2 pm UK time. The next morning, my instructions were crisp: Do not speak. I was to be a ghost, present but silent. As the meeting unfolded, however, a little voice in my head began to stir. The data being presented was poor. It would never survive peer review at the New England Journal of Medicine. The rational part of me, the part that feared unemployment and confrontation, cautioned my continued silence. But another voice, the one that relishes a little chaos, continued to whisper. I wish I could say it was fuelled by exhaustion, but I knew what I was doing. Despite every better instinct, I spoke up.

The result was not immediate. But I could tell that my boss was furious, the client was confused, and the lead investigator combative – who the hell did I think I was. My career at that agency was, for all intents and purposes, over. The ‘little devil’ had won. Yet, paradoxically, that impulsive chaos was the best decision I ever made. I resigned the next week and founded Niche Science & Technology.

I still think about the incident. This universal experience, hearing two competing internal voices, one urging caution, the other whispering temptation, lies at the heart of the human condition. It is not a moral failing but a fascinating consequence of our evolutionary and neurological architecture [1].

The Inevitable Shadow

We all carry an internal voice that quietly encourages behaviour we know we probably shouldn't pursue. It is the uninvited thought, the intrusive impulse, the darkly humorous suggestion that flits across our minds for a microsecond. Research indicates that intrusive thoughts and impulses are remarkably common in the general population [2]. In one landmark study, over 90% of participants reported unwanted, intrusive thoughts [3]. Sometimes it whispers harmless temptations; other times, it justifies selfishness or encourages us to ignore that persistent feeling that something isn't right. This ‘little devil’ is not supernatural, nor does it make us immoral. Such thoughts do not define character; morality lies primarily in behaviour [4].

The psychoanalyst Carl Jung termed this the Shadow, “the thing we have no wish to be" [5], the repository of repressed desires, disowned traits, and unconscious motivations [6]. Jung argued that ignored aspects of personality become stronger, not weaker, and that wisdom comes not from their suppression, but from integration [7]. As Jung noted, "Everyone carries a shadow, and the less it is embodied in the individual's conscious life, the blacker and denser it is" [5]. The Shadow is not inherently evil; it is disowned potential. "We cannot be whole without this negative side" (phew!) [8]. Modern neuroscience supports this view, revealing that our sense of self is not a singular entity but an amalgamation of competing neural networks and self-states [9]. From the perspective of network neuroscience, individual brain regions like the amygdala (emotional labelling), prefrontal cortex (self-reflection), and insula (body awareness) coordinate in patterns that sometimes conflict [10]. Jung would argue that healing involves learning to communicate and negotiate with these conflicting parts rather than silencing them [7].

The Neuroscience of Temptation

This internal conflict is deeply rooted in our neurobiology. While Freud's structural model of the psyche (Id, Ego, Superego) is no longer taken literally, it remains a useful metaphor for competing motivational systems [11]. Our caveman brains, shaped by evolutionary pressures, are still operating within modern boardrooms. Impulses related to dominance, aggression, status-seeking, and risk-taking once carried survival advantages [12]. Evolutionary psychologists have demonstrated that many of our darker impulses, including revenge, status-seeking, and tribal loyalty, reflect adaptations that enhanced reproductive fitness in ancestral environments [13]. Robert Sapolsky has powerfully illustrated how our neurobiology, shaped by millions of years of evolution, often operates at odds with our modern social contexts [14].

The modern ‘devil’ is driven by the promise of dopamine, the neurotransmitter of reward prediction [15]. Temptation feels intensely rewarding before action, often leading us towards a prediction error, where the anticipated satisfaction exceeds the actual outcome [16]. Neuroimaging studies have shown that anticipating a reward activates the striatum and ventromedial prefrontal cortex, regions heavily innervated by dopamine projections [17]. This anticipatory activity often outweighs the actual experience of reward, explaining why we pursue pleasure so vigorously even when it disappoints [18].

Simultaneously, another system is operating: our gut instinct. Far from magic, intuition is the brain's sophisticated pattern recognition machinery operating beneath conscious awareness [19]. Antonio Damasio's somatic marker hypothesis demonstrates that emotions, physically experienced as ‘gut feelings’, are essential for rational decision-making [1]. Patients with damage to the ventromedial prefrontal cortex (VMPFC), a region linking emotion to reasoning, lose the ability to make even simple decisions, not because they can't reason, but because they lack the somatic guidance system [20]. In the famous Iowa Gambling Task, control participants developed anticipatory skin conductance responses that guided them away from risky decks before they could articulate why [21]. In contrast, patients with overt damage to their VMPFC didn’t generate warning signals, leading them to make disastrous choices despite intact intellectual capacity [21]. The researchers concluded, a "[r]eduction in emotion may constitute an equally important source of irrational behaviour" [1]. It’s reasoned this is why experienced professionals often know something is wrong, even if they cannot articulate why [22].

Work on naturalistic decision-making has demonstrated that experts in fields ranging from firefighting to intensive care routinely make intuitive decisions that are both rapid and accurate [23]. Similarly, researchers have shown that simple heuristics, ‘gut feelings’ often outperform complex algorithms in uncertain environments [24]. While emphasising the fallibility of intuition, research acknowledges that intuitive expertise is remarkably reliable when developed within environments containing regular patterns and rapid feedback [25].

Why We Ignore Better Judgement

Despite the power of intuition, we frequently override it. This occurs through several well-documented psychological mechanisms. Confirmation bias leads us to seek information that confirms our existing beliefs while ignoring contradictory evidence [26]. Motivated reasoning allows us to arrive at conclusions we find desirable rather than those that are accurate [27]. Social pressure and authority bias compels us to act against our better judgement [28]. Work on moral disengagement shows how individuals rationalise unethical behaviour through mechanisms including euphemistic labelling, displacement of responsibility, and dehumanisation [29]. Cognitive dissonance theory explains how we reduce psychological discomfort by changing our beliefs to align with our actions [30].

The ‘little devil’ often speaks in rationalisations rather than commands. It whispers: "It'll be fine." "Just this once." "What the hell." These are not demonic possessions but predictable products of our cognitive architecture [31].

The Devil in Organisations

Extending the discussion beyond individuals reveals how cultures amplify or suppress inner impulses. Organisational scholars have shown that corporate scandals frequently emerge from cultures that silence dissent and discourage psychological safety [32]. Research on psychological safety demonstrates that teams where members feel safe to speak up perform better and make fewer errors [33]. Conversely, cultures characterised by authoritarian leadership and fear create environments where the ‘little devil’ thrives unchecked [34]. Edgar Schein has written extensively on how organisational culture shapes behaviour, often in ways invisible to those within the system [35]. When dissent disappears, organisations fail [36].

But What If the Devil Is Also Innovation?

Not all disruption is destructive. Many breakthroughs required people who ignored accepted wisdom. Scientific revolutions, as Thomas Kuhn famously argued, occur when anomalies accumulate and a new paradigm emerges—often championed by those willing to challenge orthodoxy [37]. Entrepreneurship inherently involves embracing uncertainty and defying convention [38]. Creative breakthroughs frequently arise from individuals who are comfortable with ambiguity and willing to explore uncharted territory [39].

The question becomes: how do we distinguish productive rebellion from reckless destruction? Research on calculated risk-taking suggests that successful innovators distinguish themselves through psychological resilience, ethical leadership, and systems thinking [40]. Work on sensemaking in organisations illustrates how adaptive experimentation and managed chaos can produce innovation while avoiding catastrophic failure [41]. It has been argued that systems require a degree of ‘anti-fragility,’ where stress and uncertainty can actually strengthen them [42]. Margaret Wheatley, drawing on complexity science, suggests that living systems thrive when they maintain flexibility and responsiveness to environmental feedback [43].

Conclusion

Concluding with practical wisdom, evidence-based approaches include metacognition, thinking about one's own thinking [44], mindfulness, cultivating non-judgmental awareness of present experience [45], and self-awareness, developing insight into one's own emotional states and motivations [46]. Research on gratitude has demonstrated its role in regulating impulsive behaviour and enhancing psychological well-being [47]. Humility research shows that intellectual humility, recognising the limits of one's own knowledge, is associated with better decision-making and reduced bias [48]. The ‘broaden-and-build’ theory of positive emotions suggests that cultivating positive emotional states expands cognitive flexibility and builds psychological resources [49].

Our goal should not be to eliminate darker impulses. The goal is recognising them before they become behaviour. As Jung noted, "One does not become enlightened by imagining figures of light, but by making the darkness conscious" [8]. The ‘little devil’ should have a seat at the table, its energy for disruption can challenge stagnation and fuel creativity, but it must never be allowed to speak in meetings. However, as a last note, the paper never appeared in the New England Journal.

References

1. Damasio AR. Descartes' Error: Emotion, Reason, and the Human Brain. New York: Putnam; 1994.
2. Salkovskis PM, Harrison J. Abnormal and normal obsessions: a replication. Behav Res Ther. 1984;22(5):549-552.
3. Rachman S, de Silva P. Abnormal and normal obsessions. Behav Res Ther. 1978;16(4):233-248.
4. Haidt J. The Righteous Mind: Why Good People Are Divided by Politics and Religion. New York: Pantheon Books; 2012.
5. Jung CG. Psychology and Religion: West and East. CW 11. Princeton: Princeton University Press; 1958.
6. Jung CG. Aion: Researches into the Phenomenology of the Self. CW 9ii. Princeton: Princeton University Press; 1959.
7. Jung CG. The Archetypes and the Collective Unconscious. CW 9i. Princeton: Princeton University Press; 1959.
8. Jung CG. The Practice of Psychotherapy. CW 16. Princeton: Princeton University Press; 1954.
9. Gazzaniga MS. The Mind's Past. Berkeley: University of California Press; 1998.
10. LeDoux JE. The Emotional Brain: The Mysterious Underpinnings of Emotional Life. New York: Simon & Schuster; 1996.
11. Freud S. The Ego and the Id. London: Hogarth Press; 1923.
12. Buss DM. Evolutionary psychology: a new paradigm for psychological science. Psychol Inq. 1995;6(1):1-30.
13. Buss DM. The Evolution of Desire: Strategies of Human Mating. New York: Basic Books; 1994.
14. Sapolsky RM. Behave: The Biology of Humans at Our Best and Worst. New York: Penguin Press; 2017.
15. Schultz W. Dopamine reward prediction-error signalling: a two-component response. Nat Rev Neurosci. 2016;17(3):183-195.
16. Schultz W, Dayan P, Montague PR. A neural substrate of prediction and reward. Science. 1997;275(5306):1593-1599. doi:10.1126/science.275.5306.1593
17. Knutson B, Adams CM, Fong GW, Hommer D. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci. 2001;21(16):RC159.
18. Gilbert DT, Ebert JEJ. Decisions and revisions: the affective forecasting of changeable outcomes. J Pers Soc Psychol. 2002;82(4):503-514.
19. Kahneman D, Klein G. Conditions for intuitive expertise: a failure to disagree. Am Psychol. 2009;64(6):515-526.
20. Bechara A, Damasio H, Damasio AR. Emotion, decision making and the orbitofrontal cortex. Cereb Cortex. 2000;10(3):295-307.
21. Bechara A, Damasio AR, Damasio H, Anderson SW. Insensitivity to future consequences following damage to human prefrontal cortex. Cognition. 1994;50(1-3):7-15.
22. Klein G. Sources of Power: How People Make Decisions. Cambridge, MA: MIT Press; 1998.
23. Klein G. The Power of Intuition: How to Use Your Gut Feelings to Make Better Decisions at Work. New York: Currency; 2003.
24. Gigerenzer G. Gut Feelings: The Intelligence of the Unconscious. New York: Viking; 2007.
25. Kahneman D. Thinking, Fast and Slow. New York: Farrar, Straus and Giroux; 2011.
26. Nickerson RS. Confirmation bias: a ubiquitous phenomenon in many guises. Rev Gen Psychol. 1998;2(2):175-220.
27. Kunda Z. The case for motivated reasoning. Psychol Bull. 1990;108(3):480-498.
28. Milgram S. Obedience to Authority: An Experimental View. New York: Harper & Row; 1974.
29. Bandura A. Moral disengagement in the perpetration of inhumanities. Pers Soc Psychol Rev. 1999;3(3):193-209.
30. Festinger L. A Theory of Cognitive Dissonance. Evanston, IL: Row, Peterson; 1957.
31. Baumeister RF, Vohs KD, DeWall CN, Zhang L. How emotion shapes behavior: feedback, anticipation, and reflection, rather than direct causation. Pers Soc Psychol Rev. 2007;11(2):167-203.
32. Bazerman MH, Tenbrunsel AE. Blind Spots: Why We Fail to Do What's Right and What to Do about It. Princeton: Princeton University Press; 2011.
33. Edmondson A. Psychological safety and learning behavior in work teams. Adm Sci Q. 1999;44(2):350-383.
34. Edmondson AC, Lei Z. Psychological safety: the history, renaissance, and future of an interpersonal construct. Annu Rev Organ Psychol Organ Behav. 2014;1(1):23-43.
35. Schein EH. Organizational Culture and Leadership. San Francisco: Jossey-Bass; 1985.
36. Janis IL. Groupthink: Psychological Studies of Policy Decisions and Fiascoes. Boston: Houghton Mifflin; 1982.
37. Kuhn TS. The Structure of Scientific Revolutions. Chicago: University of Chicago Press; 1962.
38. Sarasvathy SD. Causation and effectuation: toward a theoretical shift from economic inevitability to entrepreneurial contingency. Acad Manage Rev. 2001;26(2):243-263.
39. Amabile TM. Creativity in Context. Boulder, CO: Westview Press; 1996.
40. Vogus TJ, Sutcliffe KM. The impact of safety organizing, trusted leadership, and care pathways on reported medication errors in hospital nursing units. Med Care. 2007;45(10):997-1002.
41. Weick KE, Sutcliffe KM. Managing the Unexpected: Resilient Performance in an Age of Uncertainty. San Francisco: Jossey-Bass; 2007.
42. Taleb NN. Antifragile: Things That Gain from Disorder. New York: Random House; 2012.
43. Wheatley MJ. Leadership and the New Science: Discovering Order in a Chaotic World. San Francisco: Berrett-Koehler; 1992.
44. Flavell JH. Metacognition and cognitive monitoring: a new area of cognitive-developmental inquiry. Am Psychol. 1979;34(10):906-911.
45. Kabat-Zinn J. Full Catastrophe Living: Using the Wisdom of Your Body and Mind to Face Stress, Pain, and Illness. New York: Delacorte Press; 1990.
46. Goleman D. Emotional Intelligence: Why It Can Matter More Than IQ. New York: Bantam Books; 1995.
47. Emmons RA, McCullough ME. Counting blessings versus burdens: an experimental investigation of gratitude and subjective well-being in daily life. J Pers Soc Psychol. 2003;84(2):377-389.
48. Tangney JP. Humility: theoretical perspectives, empirical findings and directions for future research. J Soc Clin Psychol. 2000;19(1):70-82.
49. Fredrickson BL. The role of positive emotions in positive psychology: the broaden-and-build theory of positive emotions. Am Psychol. 2001;56(3):218-226.