Package managers are criticized for creating dependency hell, where projects become overwhelmed with numerous dependencies that aren't properly vetted, leading to significant maintenance challenges and security risks. The author argues for manual dependency management as a better alternative, emphasizing the importance of understanding and controlling the packages used in programming projects.