AI May Be Making You Worse at Debugging Code

For thousands of years, humans have built tools to make hard things easier. A hammer does not make you worse at building, but is AI different? Because AI helps your brain, not your hands. And that raises an uncomfortable question. What happens to the skills we outsource? Is AI brain rot real? What should we do? Well, I see a big difference in the media headlines and actual real-world studies. So, let's see an actual experiment with a group of 52 junior software engineers split into two groups. One that used AI for coding and one that didn't. I have two questions here and the results on both kind of surprised me. One, did AI make them faster? Well, the AI group finished their tasks a good 2 minutes, or about

8% faster. So, they had time to watch a 2-minute Papers episode, which is never 2 minutes. But then, wait a second, the result is not statistically significant. I'll downgrade this a bit. So, did AI make people code faster? Maybe. Now, second question, did the AI make them dumber? Now, hold on to your papers, fellow scholars, because the answer is kind of yes. After having them take a quiz, we get 50% for the AI people and 67% for the no AI people. Woof, that is almost a two-grade difference. Huge difference. And this is statistically significant. So, this one would be much harder to dismiss as noise. I got to

say, this is a fairly large effect for such a smaller study. So, where is the largest gap? The AI group really underperforms when exactly? Well, in debugging. Yes, you get an AI to write a piece of code and at some point there will be a problem. And if you rely on the AI too much, sooner or later, you will lose the capability to fix something that goes wrong. I would be careful with that. And I find this study informative because it tells you how much worse it is and in what areas. So, what should you do going forward? Well, in my opinion, three things. Dear fellow scholars, this is Two Minute Papers with Dr. Karoly Zsolnai-Feher. One, if you use AI, use it mainly for automating and

speeding up things you already understand. It is excellent for that. Two, for things you don't know yet, ask questions. Keep your mind sharp. That is the way of the scholar. Three, when something breaks, don't just ask the AI to fix it. No, first try it yourself. Then, have it explained to you what you missed. You will learn so much more. We are scholars here, so let's be measured. This is not an ultimate study. No, this is not the final word on this question. This is 52 mostly junior developers, one Python library, one short task, and one quiz. Oh, and it has a chat-style assistant, not a full agentic coding

system, which would probably make this kind of difference even larger. So, plenty of limitations apply, but as a pointer, I feel it is quite valuable. TLDR, if you use AI as a tutor, it will sharpen your mind. I use Lambda to reproduce AI research papers often in minutes. It's also great to train your own models or fine-tune an existing one. Run inference or text-to-image or video, easy-peasy. Running a deep seek chatbot or agent, super fast, super reliable. Lambda gives you powerful Nvidia GPUs to run your own experiments. I test ideas from the papers I cover, and moments

later, results. Love it. Seriously, try it out now at lambda.ai/papers.