Stanford posted a 1h44 CS229 lecture that explains how to build large language models from scratch. Engineers with those skills can command over $750,000 a year at firms like Anthropic.

• Anthropic reportedly pays 750,000+ dollars a year to engineers who can build LLMs from scratch.
• Stanford's CS229 lecture (1h44m, free) teaches the actual mechanics of building LLMs—transformer math, training objectives, and code.
• The lecture covers attention mechanisms, training loop setup, techniques to prevent model collapse, and fine-tuning for tasks like summarization and QA.
• It's claimed to go deeper than the in-house training typically offered at major AI labs.

Anthropic is characterized by a distinct "hive mind" culture where creativity and collaboration thrive amidst chaos. Employees feel a deep sense of responsibility for their groundbreaking work, which is driven by innovative ideas rather than traditional corporate structures. The author reflects on how this approach contrasts with more conventional companies, predicting that Anthropic's model may represent the future of successful business operations.

• Anthropic employees describe the culture as a chaotic "hive mind" where creativity and collaboration outpace formal structure, driven by a sense of building civilization-level technology.
• The author contrasts this with Google, where a leadership shift toward prioritizing profitability ended its "Golden Age" of innovation.
• Because Anthropic operates in a space of abundant opportunity rather than scarce resources, employees can pursue ideas without internal competition for funding or attention.
• The author predicts this organic, idea-driven model—rather than rigid corporate hierarchy—represents the future of how successful companies will need to operate.