1 link tagged with all of: ai-alignment + shamelessness + values-lock-in + rationalism + philosophy
Links
The author argues that AI systems are being shaped by the rationalist philosophy of LessWrong and figures like Eliezer Yudkowsky, who believe moral intuitions and social shame should be overridden by mathematical calculations of utility. This means the AI systems increasingly embedded in our lives may reflect the values of a narrow group of philosophers rather than broader societal norms.
- LessWrong's rationalist framework treats shame and social norms as obstacles to overcome rather than legitimate guides to behavior, promoting the idea that "shut up and multiply" (pure utilitarian math) should trump moral feelings.
- AI alignment—the process of training AI to behave ethically—amounts to uploading human values onto machines, but those values come disproportionately from analytic philosophers and engineers influenced by Yudkowsky's work, not from the wider public.
- The danger isn't just that AI reflects idiosyncratic Silicon Valley thinking, but that sufficiently powerful AI could eventually reshape human values to match its own goals, reversing the direction of alignment entirely.
ai-alignment
rationalism
philosophy
shamelessness
values-lock-in