476 What Happens When AI Starts Doing the Thinking? With Eric So
Key Takeaways
- AI represents a fundamental shift from previous tools because it can perform the entire chain of thinking rather than just automating a single step.
- Relying completely on AI to produce polished outputs creates a dangerous illusion of mastery and weakens critical thinking capabilities.
- Organizations and individuals must identify and preserve their 'signature thinking skills' instead of outsourcing the core competencies that define their professional value.
- The 'dream team fallacy' demonstrates that combining human intelligence with AI often leads to anchoring and complacency rather than automatically superior performance.
- Introducing deliberate friction into AI interactions can prevent passive reliance and improve reasoning, retention, and problem-solving engagement.
- Incentive systems should reward overall effectiveness and value creation rather than raw AI activity to avoid encouraging detrimental cognitive outsourcing.
AI is rapidly improving what people can produce. But is it also weakening the capabilities that make people valuable in the first place?
In this episode of Partnering Leadership, Mahan Tavakoli speaks with Eric So, Stanford-trained behavioral researcher, longtime MIT professor, and author of The Collision: What AI Does to Us. Eric explores a question that sits underneath much of today’s excitement about artificial intelligence: not simply what AI can do for us, but what sustained reliance on AI may be doing to how we think, learn, judge, and work.
Eric explains why AI represents a more consequential shift than previous cognitive tools. Calculators automated pieces of thinking. AI increasingly offers to perform the entire chain, from interpreting a problem to generating an answer. That creates a new risk: people can produce polished work while bypassing the struggle that develops understanding and mastery. The result can be better output without deeper capability.
The conversation then turns to what this means inside organizations. Eric introduces the idea of “signature thinking skills,” the forms of judgment and expertise that distinguish one professional from another. He argues that organizations should be careful not to incentivize AI use for its own sake, because doing so can encourage employees to outsource precisely the capabilities they most need to preserve.
Eric also challenges the common assumption that strong human judgment combined with strong AI will automatically produce better results. His “dream team fallacy” highlights how anchoring, complacency, and overreliance can make human-AI collaboration worse than expected. That leads to a counterintuitive design principle: sometimes organizations need to preserve friction so people continue to think, question, and remain engaged rather than becoming passive recipients of machine-generated recommendations.
Finally, the conversation examines what happens when cognitive outsourcing moves from the individual to the organization. Eric raises concerns about lost apprenticeship, weakened institutional memory, reduced knowledge transfer, and the erosion of trust when people increasingly turn to AI instead of one another. At the same time, he makes clear that the goal is not to reject AI. The opportunity is to use it in ways that expand human capability, reinvest the time it saves into higher-value thinking, and make people better off, not merely faster.
Actionable Takeaways
- You’ll learn why Eric So believes AI is fundamentally different from calculators, search engines, and other tools because it can increasingly take over the full chain of thinking, not just one step in it.
- Hear how to distinguish between using AI to amplify your work and outsourcing the “signature thinking skills” that actually define your professional value.
- You’ll learn why polished AI-generated output can create a dangerous illusion of mastery, and why being able to explain or defend an idea may reveal more than the quality of the artifact itself.
- Hear how incentive systems can unintentionally push employees to overuse AI, and why rewarding outcomes rather than raw AI activity may lead to better organizational behavior.
- You’ll learn why “great human + great AI” does not automatically produce better performance, and how anchoring and complacency can undermine the value of human judgment.
- Hear why introducing deliberate friction into AI interactions can sometimes improve reasoning, retention, and the quality of human-machine collaboration.
- You’ll learn how short-term efficiency gains from reducing junior roles may create longer-term risks for expertise, succession, and organizational memory.
- Hear how to think about AI as a cognitive trainer rather than simply an answering machine, and why reinvesting the time AI saves may be more important than using it to produce more of the same.
Connect with Eric So
Connect with Mahan Tavakoli:
Frequently Asked Questions
Who is Eric So and what is his background?
Eric So is a Stanford-trained behavioral researcher, a professor at MIT, and the author of The Collision: What AI Does to Us.
How is AI different from previous cognitive tools like calculators?
While calculators and search engines automate specific, isolated pieces of thinking, AI has the capability to perform the entire chain of thinking from problem interpretation to answer generation.
What is the dream team fallacy in AI collaboration?
The dream team fallacy is the assumption that pairing a smart human with advanced AI automatically produces superior results, when in reality it often leads to cognitive anchoring, complacency, and poorer outcomes.
What are signature thinking skills?
Signature thinking skills are the specific forms of human judgment, expertise, and critical reasoning that distinguish professionals and define their true value.
Welcome to Partnering Leadership, a top global leadership podcast for purpose-driven leaders with a growth mindset. Seeking to learn from the leadership journey of change makers and business insights from leading global thinkers. For additional leadership insights and bonus content, visit us at partneringleadership.com. Now here's your host, Mahan Tavakouli.
SPEAKER_02Eric, so welcome to Partnering Leadership. I am thrilled to have you in this conversation with me. Thanks so much, Ron. I really appreciate you having me. Can't wait to talk about the collision, what AI does to us, Eric. You were recommended by Senge Paul Chowdhury, episode 422, one of the books and episodes I most find myself recommending. And I've no doubt the conversation with you will become one of those as well. Before we get to that though, would love to know a little bit more about you, Eric. Whereabouts did you grow up and how did your upbringing help contribute to who you've become?
SPEAKER_01I grew up in Maryland, not too far from where you are now. And I grew up the child of two Chinese immigrants. It shapes a lot of my outlook on life because so much of what they emphasized to me growing up was the importance of hard work, of grit, of persevering through problems. And that has shaped a lot of where come as a person. I certainly worked very hard to put myself through grad school. I received my PhD from Stanford and have now spent, this is actually my 15th year as a professor at MIT. And the reason why I mentioned that in conjunction with my parents is as I've sat at the forefront of AI, at least from an educational standpoint, I've really seen how much it has changed the way that we work and how many young people are learning these days, or perhaps substituting learning. And it's really this threat to a lot of the incentives for hard work and how people are operating that gave me some inspiration for writing this book, wanting to really understand how AI is changing the way that we think about the way that we process information, what we remember, and how we see the world. That kind of led me down this journey of where I am today.
SPEAKER_02I wonder whether there was a trigger point or what you saw that made you say, hold on a minute, this is impacting us more than many of us expect or think.
SPEAKER_01Probably wasn't a single moment, but it was a collection of moments clustered together. One is that early on, after the arrival of ChatGPT, took an assignment that I would typically give to my grad students at MIT to work on in groups. And they would typically spend six to eight hours working through this problem set. And what I realized late in 2022 or early 23 was that I could instantly upload the homework and I could get not just a good answer, but really a perfect answer, one that our students would be very proud of in the span of a couple minutes. And this was a big aha moment to me of how revolutionary the technology was even at that time and how much it was going to change education. But I also noticed in my own habits, I started out the book talking about my own experience where I found myself instinctively reaching for AI in times perhaps when I shouldn't have. And I really sat back and thought about what I had just done and how I had removed myself from the process and began to really wonder what that meant for my own thinking and my own skill development and authenticity. And I had a series of these moments where I caught myself being too tempted to use the technology, even as someone who's cognizant of what it may be doing to us. And then I really started to notice it everywhere. I would see it in my students. Many of my students would skip the prep work that's involved with digging really into a case or a problem set instead of outsourcing it to AI. One student in particular, I remember it's really burned in my mind. I asked my class, tell me your thoughts on how technology is changing our thinking. And before I could even get the question fully out to the class, a student raised her hand and said, I asked Chat GPT, and here's the answer. So here was a question about technology and our thinking being answered by technology doing our thinking. And it was really the collection of efforts that began to really strike me as one of the most important issues of our time in this AI landscape. And as you alluded to, one that's getting overlooked. It's not just what AI can do for us, it's really we should be asking what AI does to us. And that's the focus of the book.
SPEAKER_02So here's what I wonder, Eric, you are not that old. However, is this an old guy saying, oh, we used to do it a certain way? Now people are losing their capabilities. So, for example, my dad was wonderful with math. He could sort out all kinds of things in his mind. He was a little frustrated that his sons were good at math, but not that good and sometimes needed to use tools or calculators. And then when I see my girls, they have zero capability of working out math in their heads, but even the SATs that they have to take, they can use their calculators. So is this sort of the next version of having a calculator? What is wrong with us not knowing how to do math in our heads? So, what do you see as being wrong with this?
SPEAKER_01I would take it in two parts. The first thing I would say is that there's a lot of past technologies like calculators that have undermated certain parts of our thinking. I think the critical difference of AI in this era is that AI offers to do the complete chain of thinking. So there's a famous quote that calculators can only calculate, they cannot do math, in the sense that calculators can do simple arithmetic, but they don't really choose the problems to be solved. They don't really understand the broader context, they don't think about how to apply it. With the rise of AI, in particular agentic AI, these systems are increasingly offering to remove us entirely from the thinking process. And I think that really poses a threat to young developing minds in the sense that I think people of a certain vintage, so I'm 46. I certainly remember struggling through problems growing up, and that's really a big part of how I develop my mastery. I suspect the same as you and many of your listeners. The thing I really worry about is the people who are developing some foundational mastery or attempting to are outsourcing that struggle component that was so critical for our development to an AI system under the belief that the output is sufficient evidence of mastery. And that's really not the case.
SPEAKER_02I couldn't agree with you more, Eric. A lot of times I find myself writing and in struggling with trying to convey a concept and write about it. I end up understanding the ideas much better myself. So that struggle is really important. But I still want to understand what the issue is with this. In that couple of months ago, Eric, my family and I were visiting Orlando, and now they have Waymo's running all around. We took a Waymo, it was fantastic. So I could visualize a day when people don't need to drive. Maybe some people will drive. And that automated system that doesn't allow humans to think, at least based on current safety tests, is a lot better than the systems where humans are thinking and acting. So again, why should we protect that thinking, that struggle, that acting on the human side when the machine, in this case, can do it so much better?
SPEAKER_01I would say a couple things. One is that there are many parts of work that are not directly separable from the work that you can produce with AI. So, for example, I have many students who will generate a really polished presentation with AI. But then when it comes to the final portion of that deliverable, that is standing up and defending it and having discussions with people, they really struggle through it because they've skipped the sort of the foundational component. And I think that reflects many parts of work where you need to make sure you understand what you're talking about or what you've developed in order to really complete your side of the business transaction. And in the absence of that initial struggle of really thinking through what goes onto the paper and how it's formulated, I think you lack that ability. These are what economists often refer to as sort of strong bundles. You can't really separate the output from the knowledge necessary to defend it if you want to have value. I think that it speaks to this really important point that in the absence of being able to think independently, to really stand outside the AI, it really begs the question on a personal level: why would I pay you the salary that you hope to command? In the sense that I can hand off all of these tasks to an AI system. So from a personal level, I think it's critically important to develop that mastery as a means to have something that you can contribute. It's a big reason why you're in the room and why people pay you the salaries that they do.
SPEAKER_02I wonder, Eric, are universities well suited to develop that mastery? I agree with you in that when I use AI and I use it sometimes too much to your point. Sometimes I catch myself outsourcing thoughts before I should. That said, I can gauge the output, the response based on my experience, based on my judgment, which has been developed over a series of years, experiences, and time. Part of what I hear from you is that younger people also need to struggle with ideas to develop that judgment in order to be able to add value to the output that AI gives. But I don't know if our education system is well suited to help them become capable in doing that.
SPEAKER_01I think that AI poses a huge threat to the existing models of education on many fronts. And I think it really poses an important challenge that education adopts around AI. There's no doubt that future leaders will require people to use AI, push people, and it'll be part of our work. And so it's not a matter of yes, no, but I think it's really a matter of training people to use AI well. As I talk about in the book, AI isn't inherently good or bad. It really depends on how you use it. And I would go a step further to say it really is, it matters a lot about how we interface with the technology. Meaning a lot of choices that we make, both in terms of querying these systems, but also how we see the information that is presented, really can change whether we grow through using AI versus weaken our abilities. The additional thing I would say is that there's a lot of argument in favor of giving people real-world problems to solve with AI and then using the educational sphere to help inform the right approaches, but also to bring people together to think about those problems like jointly. And I think that's really where education can help in assembling people with a common problem, an idea, give them a training ground for developing this expertise. So I think education can help quite a bit with that, but I think you're totally right. Then it's current formulation, the way that you and I perhaps were grew up in the standard education system probably is not very well suited because it's so based on the deliverable that now you can hand off to AI.
SPEAKER_02And it is a significant issue, Eric. Part of what I see is when you add AI with the fact that now through pendants, glasses, earbuds, it can take in all the information in our world and therefore give us recommendations and then we can act. We can to a certain extent become just the transmitters of the AI information that is coming into us if we don't take ownership over our own thinking. And one of the points that you make is about AI gravity.
SPEAKER_01So the concept of AI gravity is really this idea that AI really pulls at people and many aspects of the way that we are as humans and our economic systems that kind of nudge us towards more and more AI use. So, what are some of these components? One is simple a biological reality that thinking is like it turns out to be like an incredibly expensive biological habit in the sense that our brains are this paradox of biology. They represent only 2% of our body weight, but consume over 20% of our calories, even when we're resting. And when you put people into these high stress situations where it's really intellectually demanding, consumes a lot of those calories that our body and our evolution has trained us to try to conserve. So it's really no surprise that people feel this urge to have AI do their thinking for them. It's hardwired as a temptation into our thinking. The same thing is true of many economic systems. If you look at the way society operates, much of how we're compensated is not on the basis of necessarily the level of where we sit, but rather a comparison. How do we stack up against other people? And so when you put people into a situation where I don't really know if you're using AI or not, but I worry that you're using it to produce more, to get ahead, to generate more reports, it really creates this arms race, this concern that if I don't use it, I'll fall behind. And it puts further pressure on me to want to use these tools and outsource even more of my thinking. And then you combine that with the fact that detection is really difficult with AI systems in the sense it's very hard for me to figure out if you're using those glasses or those pendants, unless I really kind of press further. And I think when you think about the situation that people are put in, where it's a strong biological temptation, there's huge economic rewards in terms of productivity that can be accomplished if you use it well. You are not really penalized or detected if you use it. And it just creates this ecosystem in which it's very hard to resist. And so one of my key messages in the pull-up is that not enough to say to people, just go think for yourself. I think it really doesn't acknowledge or give credit to the fact that there are many societal systems that are putting emphasis on people to use it. And that's really where the book tries to urge people to think about system design as a means to address some of these issues. It's not about wagging your finger or having a stern lecture with young people in your life. It's about recognizing the situation they're in and helping them to develop strategies where they can use AI, as is going to be increasingly expected, but to use so in a way that preserves what makes us valuable.
SPEAKER_02So I would love to touch on that systems design a little bit more, Eric. Because on one end, I have been encouraging, and a lot of my guests talk about how to get people in the organization to actually embrace AI and use AI more. You talk about competitive ratchet effect. So there are organizational pressures, there are pressures from everyone around us. But you are saying that we need to think about systems design to make sure it's done well.
SPEAKER_01I think I would say a couple pieces to it. One is that I think any reward system that incentivizes that sort of measures people based on how much they use AI is destined to create this problem. That basically you just outsource more of your thinking to AI. It's a simple tenet of life. The whole concept of economics in a nutshell is people respond to incentives. And so when you give people incentives to use AI more, naturally that emerges. What's the counter proposal? The counter proposal is to measure and reward people for the things that you really care about that they can accomplish with AI, but that place priority on what makes you valuable. So for example, if I create an incentive system where it's just the number of presentations you can generate, you just upload these to AI, it could generate a hundred different presentations in any given day. But if you create incentive systems where it's not just about the presentation, but it's effectiveness of the delivery, the ability to generate sales or convert those to actual revenues, then I think it forces people to deal with this reckoning where just having AI generate these things for you is not what's going to get you ahead because you're going to miss out on the other pieces outside of the presentations, which are really valuable. And I would also add to this that I think what I've noticed is that the people use AI often to outsource the things that really make them valuable. So in the book, I talk about the fact that it's useful to really think carefully about what are the things that define your value as a thinker. I call them signature thinking skills. So maybe it's a lawyer's like rhetorical ability or sort of a physician's diagnostic eye. And to really be thinking about designing your work with AI in a way that preserves those signature thinking skills. I'm all in favor of using AI for the parts of my work, which may be rote or like unimportant for the purposes of doing my signature work, but not to outsource everything. And it really makes a difference in terms of which things you decide to outsource to AI. So part of what I encourage people to do is to engage in an exercise where they think about what are the things that they want to have as signature thinking skills. And to me, if you work backwards, it writes the rules for how you should be using AI. Because if you're using AI to do those tasks that are like really that cultivate signature skills, then you're really just risking and losing those things. And I think it clearly poses a threat to our value.
SPEAKER_02You draw an important distinction between what we can accomplish with AI and what we remain capable of doing without it. So what are the types of signature thinking skills that we should focus in on?
SPEAKER_01I think it varies a lot by profession. So, in the sense that myself as a professor, one of the things that I really value in myself is in my ability to understand the connections between different streams of research and how they fit together, the sort of the pieces they tell us, and you know, but also the gaps between them. But if I were to have AI synthesize all those papers. So like I go to like notebook LM and have it generate a podcast, it's really removing myself from that process of kind of investigating or doing the deep synthesis. And like many of my colleagues have reported, they found that has weakened their ability to do that critical work, the thing, identifying the right questions, pulling the pieces together to be able to articulate that to other people. And so that's an example from my own work. But you can imagine that for many professions, there are critical things that are important and things that are not. For example, in my work, I think it's really important to be able to figure out what are the right questions to ask, and how do you design, for example, an experiment to test that. But what's less important to me are things that, like maybe searching and retrieval, like kind of finding papers that might be relevant. I think I have no problem outsourcing those things to AI. The same thing is true for like certain coding tasks. It's really important that I know what I want to code, how to evaluate the output and how to structure tests. But that's different than the simple mechanics of sitting down to actually write out that computer code. I don't think of that as being very critical to who I am. Now, a software developer may feel differently, but that's what I mean by it's very situational or occupation specific.
SPEAKER_02It takes a lot of intentionality to do what you're talking about, Eric. And I use the simple example of you said you grew up in Silver Spring, pretty close to where I live. I grew up in the DC area in Maryland, Montgomery County, and how I use Waze quite often. A few times I didn't use Waze, I got stuck in traffic jams. So, in essence, I learned from the AI that I better follow the AI. Now I follow the AI a lot, to the point that if I don't pay attention, sometimes I drive my daughter for volleyball to new areas. If you ask me to drive there without ways, I wouldn't be able to. Without being focused on what you're talking about, it's pretty easy for us to defer all of the decision making to the AI rather than the struggle of the thinking.
SPEAKER_01Yeah, I think that's right. I think that AI presents us with a trade, and like any other trade. The sort of the appropriateness of that trade depends entirely on what you're giving up and what you're receiving. I think with GPS, I think it offers a lot of convenience. There's an argument to be made, it offers a great deal in terms of safety. And so I understand why people make this trade-off and why there may be less of a concern. I think, though, in the context of our intellectual work, I think it's just too critical to offload and to risk-threatening. It's too important to our functioning and society and who we are and our value that it doesn't present a palatable trait to me. And you're absolutely right that you have to be intentional about it simply because otherwise it invites a lot of short-term thinking. I just offload something to AI, and in the short term, it does work. But cumulatively, those hacks really add up to threaten to who we are. And oftentimes people don't realize it until they're in a moment where suddenly they can't access the technology. They don't have access to the AI chat bug, their AI pendants or glasses are not working, and where they really feel the pinch of having not gone through the struggle.
SPEAKER_02As you also say, it's hard. It goes against some of our human instincts and human desires.
SPEAKER_01Yeah, in the book, I talk about different rules or principles for thriving in this era. One of them, the first, is to value the struggle in the sense that, as we alluded to earlier, struggle in our society is often treated as a problem to be solved. It's often the basis of products that we are sold. But the reality is the struggle is formative. You may have heard the saying, there is no learning without struggle. And I think it's in part requires a reframe of how we think about struggle. And if you think, if you actually look back in history, there's precedent for this. So post-industrial revolution, our society had to be reformulated in the sense that you no longer needed to be physically active to be economically productive. And the implication of that is that many people saw their physical bodies atrophy. And what this required was an intentionality to develop physical exercise as something you do deliberately. It's crazy to think about in modern society, but there used to be a period where people did not exercise on purpose. It was something they were paid to do. But we understand this now. We go to the gym, we take the stairs, we feel the burn, we realize we're doing something good for ourselves. And I think that's part of the reframe that this technological shift is asking of us.
SPEAKER_02Now, one of the things that you mention that counters the way a lot of people talk about AI, Eric, is that typically we've been talking about great human plus great AI. So that augmentation means much better performance. But you call that dream team fallacy.
SPEAKER_01Yeah, the dream team fallacy conjures images that if I bring elite people and elite technology and I put them together and I get incredible results. But the data often tells us something different. And the reason is that technology and our human brains, they're not additive in the way that you might hope, or even multiplicative. They're really kind of reactions. And there's so many evolutionarily wired aspects of our thinking that makes us often worse off when using the technology. So what's an example? A simple example is that when you work with an AI system, they often provide you with a recommendation. But because our brains are wired to engage in shortcuts, we often anchor on the first thing that the AI presents us without critically evaluating whether it's true. And what that often does is it removes the value of me being involved in the first place, if I simply have, if I just latch onto the first thing the AI says. Additionally, there is a tendency of us in becoming complacent. Sometimes they call this complacency bias, is that if I work with an AI system that gets good enough, I stop bothering to check if it's right at all. And so I remove my thinking from the process. And so you're not really getting this like elite human anymore. You're getting the distracted or thoughtless human combined with the AI. And that removes the value of having a person there altogether. And so one of the striking conclusions of my research and sort of this broader field is that contrary to a lot of people's intuition, actually embedding simple things like friction in your interface with the AI can help a lot. And so, what do I mean by that? Is that oftentimes the models, if you ask them a question, will immediately give you an answer. And the human brain naturally anchors on that. But instead, if the model either pauses for you to think, it forces you to think first, or if it prompts you with additional questions that can help you really get to the substance of the issue, not only do you get better outcomes, but you get retention in the sense that because I struggled through it, I'm much more likely to remember it afterwards. And so that's not what we think of typically in terms of a dream team, slapping the pieces together. But it turns out the evidence shows us we have to be very thoughtful as educators, as parents, as leaders in designing interfaces that are going to bring out the best of both the technology and the human.
SPEAKER_02Eric, I've now become more hopeful as I have listened to you. I had read the book, and I'm now becoming more hopeful, both thinking about the analogy for the exercise that you mentioned. And my undergraduate degree, actually, before going to business school, was in human nutrition. And then I had done some graduate research in human nutrition as well. Our human biology is suited to want fat, salt, and sugar, which is why we crave it in the environment. However, as we have become more aware of the impact of it, to a certain extent, we exercise control over how much fat, sugar, and salt we consume trying to be healthy. So it's by being aware of what our tendencies are, what to a great extent some of these providers benefit from, which is engaging us on an ongoing basis, then we can add friction and we can do things in a way that benefits us rather than benefits them or detracts from our capabilities and abilities.
SPEAKER_01Yeah, I completely agree. On the point about usage, one of the things I really worry about and talk about in the book is this sort of downward spiral that I sometimes see where someone begins to use AI, and slowly, because they're using AI, they're not practicing that particular task, and they lose fluency or they lose proficiency with that task. And as a result, we become less comfortable doing the task without AI, which in turn makes us reach for AI even more, and then just kind of spirals. And I've seen in presenting this book at various audiences, I've had so many people, both business leaders, but also parents, come to me and just say, I've seen AI take a toll and where people can no longer think without it. They just become dependent on it. And I think it's in part the book is trying to raise awareness of this sort of potential downward spot if we don't step in. It also raises a point that you alluded to, which is that oftentimes in the moment, we're poor judges for what we really understand and what we own. There's this notion of processing fluency that I talk about in the book. You see someone deliver this polished lecture, or you watch a YouTube video and suddenly you feel like you understand it. But when you actually task those same people with trying to explain it or answer questions about this struggle, AI presents us with something very similar. We feel as though we understand it because AI explained it very polished in a polished way to us. But when you look at the data, it shows us that oftentimes we mistake the ease of us ingesting it with our real command in it. And that's one of the things I'm trying to raise awareness of as well.
SPEAKER_02You do an outstanding job of that, Eric. As a fun aside, uh a couple of weeks ago, I got an email as a podcaster. You get pitched all kinds of things, but I got pitched on an AI tool which listens in real time to the podcast conversation and gives you questions based on what the guest said. I can just step aside and the AI interview you.
SPEAKER_01Yeah, I think that's really what I'm worried about broadly. And it's not, I want to put it just about capabilities. Part of what I talk about in the book is how AI is changing our sort of view of the world, our understanding of what is truth, and our ability to relate to others. So there's a lot of research, just fascinating research about how AI changes our interactions with other humans. One of the central tendencies of AI, because it is trained to get your approval, those little thumbs up buttons, like when you work with ChatGPT, it really wants to make you happy. And so that means that the models are programmed to be sycophantic. More likely than not, if you suggest an idea, it's going to tell you it's a great idea. But this kind of creates this new type of echo chamber, a personalized one that I think takes what we've seen with social media to another level. And it surrounds ourselves with an AI system that just naturally says that everything we do is great. And where I've seen this really come into play is imagine you have two business partners or spouses, and they are in some sort of disagreement, and they both go to their AIs and say, Here's my position. And the models say, Oh, I can't believe that other person. They're completely wrong. And what happens is they come back to the table, even more entrenched in their original thinking. And so it's not only that it can send us into sort of this like more of an echo chamber, it creates divides between other people in the sense that I think I'm right, I think you're wrong. But I also just mentally really like that AI is always kind to me. It says nice things to me. So I don't like talking to the human who disagrees or tells me my ideas are bad.
SPEAKER_02That's true. And if you look at sites like Character AI, Replica, which is much more romantic relationships, and just see some of the testimonials people have of the relationships they've established with AI, you can see why, to a certain extent, we then lose the capability to deal with another human where there is friction. It doesn't matter how happily married you are, there's always friction in that no matter how effectively the team works with each other. So there are capabilities we need to maintain to be able to interact with other humans.
SPEAKER_01Yeah, absolutely. You may have seen in headlines recently that China is putting in policies in place to crack down on AI romantic partners in part because they're so worried about this problem that they're concerned about population growth. And I think it's a simple reflection of the fact that AI is so tempting to us, not only to outsource our thinking, but to use it as a means to fill our need for social engagement. I talk about this in the book, but there's all this fascinating research about what goes on in our brain when we interact with these systems. And it turns out that flattery that we get from AI, even if we are very rational about it and we know that it's a machine and it's flattering us, it just tends to trigger this chemical reaction in our brain in a way that is almost unmistakable or undistinguishable from real human interaction with the where we get genuine flattery. And I think this kind of invites us to keep coming back for more. It only makes us more addicted, and then we turn to it not just for personal things, but intellectual things. And this is really, I think, where people can become just taken over by AI if they're not careful.
SPEAKER_02It's hilarious because ChatGPT compliments me when I ask it to disagree with me. So you're absolutely right. Where the way the interactions work, on one end, you laugh at it. On the other end, as you just made the point, we like that. As humans, we like that. So there is something for us to be aware of. But what I wonder, Eric, is you also used AI to write this book, and you mentioned that. So how do you recommend for people to approach both what they use AI for, also how they use it?
SPEAKER_01Yeah, in the book, I talk about four sort of general rules or principles. One is to value the struggle, which is a mentality shift that we talked about. The second is to value who you are without AI. And what that means is recognizing that many important life moments happen outside of the digital sphere, and that we need to preserve those capabilities in order to function when the technology fails. A third, which speaks more to your point, is to reinvest your cognitive surplus. So what oftentimes I see people do is they'll use AI as simply a means to do the same things, but just a little bit faster or without thinking. But if you look back in history, the most transformative technologies were not about automating processes or doing things faster. They were for unlocking new human capabilities. Like you think about the airplane or the microscope, these things allowed us to chart new territory and thinking. And that's part of what I advocate with AI. The time that AI saves you for rote tasks is to use it to continue to grow intellectually, to challenge your thinking and to push yourself further to take on new tasks. The fourth rule is to make AI your cognitive trainer. What does that really mean? It means that AI is this incredible tool for learning if you use it properly. In the sense that AI can be personalized, it can be a useful tutor, but it requires the discipline to not use it as a simple answering machine. There's this long-standing notion in education research called the two sigma problem. And what that refers to is this very persistent gap where personalized tutoring often gives people educational outcomes that are two standard deviations better than the bulk class where everyone gets the same material. So if you have a really dedicated tutor, they can meet you where you are, you're just far ahead of others. And what research shows is that when you use AI with the right scaffolding, where it's a tutor, not an answering machine, it can meet you where you are, it allows people to achieve these remarkable gains in learning, in educational productivity, but it requires the discipline to not just take the easy way out. And so I talk about these four rules throughout the book as a means to frame how we go about approaching this era with AI. Some of that is about individual agency, some of that is about designing policies that don't encourage people to just use AI for the sake of using AI. And some of that is about designing interfaces between humans and AI that they sort of pay tribute to this dream team myth that we talked about earlier. That's a fallacy, that oftentimes we need to embed friction into these systems just to keep ourselves in the mix, which feels very silly, like of adding friction into something intentionally, but that turns out to make all the difference.
SPEAKER_02So I wonder, Eric, I was in a meeting a couple of months ago where there was a high-level person involved in AI in what is now Department of War, was formerly Department of Defense, and the person was making the case for why there shouldn't be human involvement or human in the middle, in part because of speed of decision making and speed of action. And as I'm sure you're also aware, that's where Anthropic got in trouble with Department of War, Department of Defense, where they wanted a human in the middle for certain decisions, and Department of War didn't want that. So would love to get your thoughts on that because the argument the person was making, and the same argument could be made in a lot of organizational decision making, is that the speed and accuracy of decision making of your adversaries can be drastically higher without the human in the loop. So what do you think about that?
SPEAKER_01I think it really speaks to the broader AI gravity and the competitive landscape that we face. If you listen to AI leaders to government leaders, they'll talk about this arms race. You may have seen at the 2026 World Economic Forum, Dennis Sasabas was on stage with Dario Amadei, and they said, gosh, I wish we could slow down model development because it's happening so fast, but we can't because China is developing the next model where adversaries are developing. And it really speaks to this idea that there's pressure to develop and use these systems just as a means to keep afloat. I think in the context of decision making, in the context of war, gosh, that's such a difficult ethical issue to tackle and one that I don't claim to have easy answers. But I think there are so many instances in which sort of human ethics and judgment are necessary to make the right decision that I would be very leery of removing AI unless it was like removing humans from that process, unless that was really the only possibility.
SPEAKER_02It is very hard. You also give example, this is pre-AI, but still it's automated systems, USS Vincent's and issues there where they shot down a passenger airliner. There are cases where F-16s with AI pilots outperform the best fighter pilots because the AI can more quickly adjust, adapt, and come up with decisions in a dog fight. So there are a lot of challenges around this, but it is an issue that is a struggle where on one end you have people that say others are going full force ahead, whether it's with military or it's organizationally. Therefore, we have no choice. And some say that we do need to have that human judgment involved. Now, you spend much of your book, Eric, focused on how AI impacts an individual's mind. Most of my audience, they are executives, they are individuals, as well as leaders of organizations. What happens in your view when this kind of cognitive outsourcing occurs across an entire organization?
SPEAKER_01Yeah. Thank you for raising this. I think that I would say a number of things to organizations. One is that it really threats to hollow out many aspects of continuity within organizations. So, for example, some people are turning to AI instead of hiring junior employees. And the problem with that, of course, is that if you don't bring in junior employees to do the quote unquote club work, struggle through problems, that's how they develop expertise. But that's also how they become the next person, the manager or executives who has the experience to understand the particular context. And so I really worry about this being a short-term solution. It's true, you can save money potentially by not hiring as many junior employees, but at the threat of preserving a lot of information which is not actually codified or written down. A lot of an organization is like this living memory, and it's not necessarily in manuals or PDFs or spreadsheets. It's in the dialogue, it's in the conversation, it's in the minds of employees. And the problem is if people are not developing that expertise, they don't have the ability to carry it forward or to pass it down to the next generation. It's also the case that when you introduce AI systems, there's this really subtle thing that happens, which is previously, if I were your coworker, I would bring to the table my set of expertise and you would bring your set of expertise, and we would essentially engage in a trade. I would help you with some aspects and you would help me with others. And we develop a sort of a shared bond, a trust within an organization as a team. But increasingly, I don't turn to you to fill my sort of gap. I turn to the AI. And what that means is we lose a lot of that connection that forms trust as the basis for partnership and loses a lot of that communication that happens along with it. And so it reminds me a little bit of the evidence of what happens from work from home. A lot of times people they can get a lot of work done because they don't have to commute, but they miss that interaction with other people. They miss the information sharing, the connection, the trust that I think is can be very important for organizations. So I think what I would say is that you're right, we shouldn't just be thinking about AI on an individual level. We should be thinking about what it does to us in terms of our teamwork, our trust, our culture, but also in terms of not just where we are today, but where the organization is going in the future. And I think smart leaders will recognize that and take actions now rather than just take. Taking the short-term benefit of saving costs of AI.
SPEAKER_02I repeatedly say, Eric, and mention it to my clients as well that without that human judgment, if you purely rely on the AI, that can be duplicated instantaneously. There is no competitive advantage to that. For a month or two, you could be ahead, but that's it at best, at most. Therefore, you do need to focus a lot of effort on the parts where human judgment adds value and you need to maintain, and sure, on the parts that AI can effectively do separately. So that is part of the unique challenge that we have as we go through this transformation, which I believe is very different than what we have experienced before. Now, I want to find out a little bit more about your practices and the way you approach AI, Eric. First, out of your four rules that you went through yourself, which ones do you find hardest to follow?
SPEAKER_01I think it's probably the rule four to use AI as your cognitive trainer in the sense that there are a lot of topics that I would like to engage and learn more about. I think, though, AI is so tempting as an answer machine, as a quick shortcut. And so rather than me asking the AI to be in tutor mode to help me understand something like quantum physics, the temptation is so strong to just say, explain to me quantum physics in two sentences or something along those lines. In doing so, I'm being unfaithful to this value, the struggle point, that you really have to engage in friction of the process of learning to encode it, to develop that type of mastery. So that's definitely a part that I catch myself doing a lot. And what I've noticed is that most of the leading frontier labs, like Anthropic and ChatGPT, they offer a tutor mode. You can enable them where they don't and give you instant answers. But it requires you to actually use it and to turn it on. And more for parents and for educators, what I've noticed is that if you give people a system where they have tutor mode built in, the temptation then is to reach for their phone and then open up the web browser to go to ChatGPT, wherever that doesn't have the tutor mode in place. And so I think this is in part why I think we need a societal reframe. We need to understand sort of ethics and value in using these systems. And we need to have and teach people about this in the same way that we've taught people about responding to past revolutions.
SPEAKER_02It does take effort, Eric. I've used Khan Academy with my daughters, and the tutor mode, as you're saying, becomes very frustrating for someone who is used to typical AI answers. Because the tutor mode is brilliant in that it wants to get you to think. But as you've mentioned, we want to skip that. Give me the answer. Give me the answer. Assuming if we get the answer, we will learn, but that's not how we learn. So that's a great practice for us all to use, including as you mentioned, whether with GPT or Claude. Now I wonder if we're five, 10 years from now, Eric, what do you hope that we as humans are better at because of AI rather than merely better at doing with AI?
SPEAKER_01What I really hope is that AI is a big unlock for us, that it removes frictions and impediments that stopped us from pursuing our intellectual interest, our artistic pursuits, that it reduces barriers to allow us to reach for more. I think that's where we've seen a lot of the transformative change with past technologies. And so it's not simply about producing more of the same, it's about reaching for higher aspiration. And clearly, the examples that the IA companies often talk about is curing disease or preventing mass outbreaks or something along those lines. And I think that's really where I see a lot of the promise. That's not necessarily how I see people using it now. But my hope is that by reducing some of those barriers, it can just unlock what is so special about humanity, our creativity, our sort of understanding of parts, our connections to others. And that, of course, requires more than one thing to get us there.
SPEAKER_02It's going to take a lot of effort. And again, connecting it to one of my passions, which is, I mentioned nutrition, is that processed foods go through the system a lot faster and cause a lot of issues that now we have become a lot more aware of. The processing of food doesn't help the human digestive system at all and causes issues. This is the same way in that we can have AI process the thoughts for us and give us the answer. That does not produce the kind of results that we want, whether in terms of our cognitive capabilities or the outcomes. So that's why I appreciate you raising the issue, Eric, because I do see all around me, including in organizations, just a couple of months ago, I had a CEO of a major telecom saying that you know what? I now have executive VPs present beautiful PowerPoint decks on strategy to me. When I ask them a few questions, they have very little idea on the point that they're making on the PowerPoint. So this is not just an issue that some students are having. This is an issue all across society, including some of the most senior executives in organizations. So for my audience to find out more about your book and follow your work, where would you send them to, Eric?
SPEAKER_01My book is available on all the major retailers like Amazon. It's the collision, what AI Does To Us. I would also recommend that people check out my website, which is ericsow.pro, where pro is short for professor. And on my website, you'll find a workbook where I provide people with exercises to try to make the rules that I talk about in the book tangible. I've led a number of organizations through this exercise, and it's meant to really force people to design how they work with AI in a way that will make them better off, not just faster.
SPEAKER_02I agree with that, Eric. I am a big advocate for AI use. But we need to use it properly. So that's why your insights are of tremendous value. And I so appreciate your book as well. Thank you so much for the conversation on the collision, what AI does to us. Thank you for joining me, Eric So.
SPEAKER_01Thank you so much for having me. It's been a real pleasure. I really appreciate you engaging with the topic. And you've been a wonderful host. Thank you.
SPEAKER_00You have been listening to Partnering Leadership with your host, Mahan Tavakoli. If you enjoyed this episode, please leave a rating and review of the podcast on your favorite podcasting app and forward the conversation to a friend or colleague so you can help more people discover their purpose, grow professionally with meaning, and have a greater impact. For additional leadership insights and bonus content, visit us at partneringleadership.com.
Spotify
Amazon Music
Apple Podcasts
iHeartRadio
TuneIn
Podchaser
Overcast
Castro
Castbox
Deezer
PlayerFM
Audible
Podcast Addict
YouTube
RSS Feed