Llion Jones, the co-author of the transformer architecture, expressed his frustration with the current state of AI research, claiming it has become too narrow and focused on a single approach due to investor pressure. He announced his intention to move away from transformers and explore new, innovative AI technologies, highlighting the need for greater creative freedom in research.
ai ✓
transformers ✓
innovation ✓