uzu is a high-performance inference engine designed for AI models on Apple Silicon, featuring a simple API and a hybrid architecture that supports GPU kernels and MPSGraph. It allows for easy model configuration and includes tools for model exporting and a CLI mode for running models. Performance metrics show superior results compared to similar engines, particularly on Apple M2 hardware.
ai ✓
inference-engine ✓
apple-silicon ✓
+ performance
machine-learning ✓