1 link tagged with all of: machine-learning + performance + inference-engine
Click any tag below to further narrow down your results
Links
uzu is a high-performance inference engine designed for AI models on Apple Silicon, featuring a simple API and a hybrid architecture that supports GPU kernels and MPSGraph. It allows for easy model configuration and includes tools for model exporting and a CLI mode for running models. Performance metrics show superior results compared to similar engines, particularly on Apple M2 hardware.