Sutton critiques the prevalent approach in LLM development, arguing that they are heavily influenced by human biases and lack the "bitter lesson pilled" quality that would allow them to learn independently from experience. He contrasts LLMs with animal learning, emphasizing the importance of intrinsic motivation and continuous learning, while suggesting that current AI systems may be more akin to engineered "ghosts" rather than true intelligent entities. The discussion highlights the need for inspiration from animal intelligence to innovate beyond current methods.