Click any tag below to further narrow down your results
Links
Airbnb benchmarked a fine-tuned 2B-parameter classifier (E2B) against frontier and open-weight APIs on a real policy-screening task. The small model matched the best proprietary models on F1 while returning in about 35ms median, at roughly a hundredth of the cost at scale.
- Fine-tuning Gemma4-E2B on hundreds of thousands of in-domain examples raised F1 from 0.563 to 0.902, on par with frontier models, with median latency around 35ms versus about 900ms for frontier APIs.
- A 2,700-word detailed prompt only gained one to three F1 points for proprietary models and did not close the gap for models fast enough to deploy, so prompt tuning alone was not the answer.
- Self-hosting one GPU beats frontier APIs on cost above roughly 15 to 30 requests per minute; at Airbnb's volume, frontier APIs cost about two orders of magnitude more.
Musubi Labs released PolicyLM-1.7B, a small open-source language model designed to make moderation decisions on live messages in under 100ms by reading your platform's actual policies instead of relying on fixed taxonomies. It runs on a single GPU or laptop and lets teams update policies instantly without retraining.
- Processes messages in under 100ms (median 35ms on short chat) while scoring against custom policies, making it viable for live chat where fixed classifiers are blind to policy changes and large LLMs are too slow.
- Reads your policy with every message, so policy edits take effect immediately without retraining or annotation work—useful for teams with frequent rule changes or policies that don't fit standard taxonomies.
- Open weights (Apache 2.0) and already proven in production on a platform handling over a million messages daily; includes two threshold presets (precision-focused for rare violations, balanced for higher detection).