Click any tag below to further narrow down your results
Links
Musubi Labs released PolicyLM-1.7B, a small open-source language model designed to make moderation decisions on live messages in under 100ms by reading your platform's actual policies instead of relying on fixed taxonomies. It runs on a single GPU or laptop and lets teams update policies instantly without retraining.
- Processes messages in under 100ms (median 35ms on short chat) while scoring against custom policies, making it viable for live chat where fixed classifiers are blind to policy changes and large LLMs are too slow.
- Reads your policy with every message, so policy edits take effect immediately without retraining or annotation work—useful for teams with frequent rule changes or policies that don't fit standard taxonomies.
- Open weights (Apache 2.0) and already proven in production on a platform handling over a million messages daily; includes two threshold presets (precision-focused for rare violations, balanced for higher detection).
Researchers tested an AI system called Jev on 2,029 real phone calls stripped down to pure call structure—no audio or transcripts—and it learned to predict which calls would result in bookings with 94% accuracy by the end, all for $3 in compute costs.
- Jev made 38,012 turn-level forecasts across the calls at 118ms median latency, processing thousands of calls in seconds without any fine-tuning or examples from the company's data.
- The system achieved 0.78 AUC by the halfway point and reached 94% ranking accuracy near the end, learning to separate bookable from non-bookable calls based solely on call structure, timing, and workflow patterns.
- The experiment revealed the AI could extract predictive signal from call metadata alone—turns, tool calls, workflow stages—demonstrating that meaningful patterns exist independent of what's actually said.