1 link tagged with all of: machine-learning + infrastructure + model-serving + nvidia-triton
Click any tag below to further narrow down your results
Links
Grab has modernized its machine learning model serving platform, Catwalk, by adopting NVIDIA Triton Inference Server to enhance performance and reduce costs. The transition involved creating a "Triton manager" for seamless integration and backward compatibility, resulting in significant improvements in latency and infrastructure spending for deployed models.