Miloš Švaňa discusses the difficulties of setting up a PyTorch project that functions across various operating systems and hardware accelerators. He explores solutions using PEP 508 for dependency management and ultimately decides to switch from PyTorch to ONNX Runtime for easier installation and better compatibility with PyPI.