More on the topic…
The book argues that ML pipelines get more mileage from high-quality data than from sophisticated models, yet most practitioners obsess over model architecture. The author traces how this shift already happened—Netflix's collaborative filtering work, ImageNet's crowdsourced labeling, Word2Vec—all demonstrated that data quality matters more than people assumed. The internet amplified this trend by letting companies like Netflix and Google generate massive datasets at planetary scale. Early academic ML relied on small hand-labeled datasets from grad students. Modern practice evolved to handle bigger data needs through weak supervision, transfer learning, active learning, and synthetic labels. Now LLMs have complicated things further: they generate labels themselves but carry the same biases and inconsistencies as human experts, making the book's guidance on working with subject matter experts suddenly relevant to everyone managing AI systems.
Part 2 of the book covers handling SMEs effectively, which matters because most organizations don't teach ML engineers this skill—but now everyone needs it to manage LLM outputs. Part 3 digs into the practical grind: cleaning messy data, imputing missing values, extracting features, removing bias, and implementing the "data flywheel" where you start with noisy data, build a model, then use active learning with human feedback to iteratively improve both. It covers transfer learning, adversarial learning, and semi-supervised approaches you can actually use.
The practical takeaway is that LLMs are powerful enough to solve many problems through prompting alone, but you unlock more value by treating them as components in a traditional ML pipeline—using them to generate labels or weak supervision signals for building scalable models. Part 4 offers organizational guidance for senior roles trying to shift their company's culture toward data-centric thinking, including implementation checklists.
Questions about this article
No questions yet.