1 link tagged with all of: quantization + huggingface + model-inference + multi-backend
Click any tag below to further narrow down your results
Links
ZeroModels is a library that ports 100+ model families to pure Keras 3, letting you run the same code on JAX, PyTorch, or TensorFlow without needing transformers or torch at runtime. Models load from preconverted weights, upstream checkpoints converted on-the-fly, or any Hugging Face repo, with a consistent two-call interface (build model, run prediction).
- 100+ model families (detectors, depth estimators, LLMs) work with identical code across three backends—switch backends by setting one environment variable before importing Keras
- Large models load with aggressive quantization built-in: GPT-OSS 120B stays at 66GB using bfloat16 + packed MXFP4 experts instead of 130GB fp32, with int8/int4/fp8 quantization available as arguments
- All outputs on model pages are measured from actually running the code snippets, not hand-written examples, so results are reproducible