1 link tagged with all of: cli + hardware-detection + local-llm + huggingface
Click any tag below to further narrow down your results
Links
Whichllm is a single-command CLI that detects your GPU/CPU/RAM, pulls live benchmarks from HuggingFace, and ranks the best fitting local LLMs by real performance metrics. It also lets you simulate different GPUs, generate Python snippets, run chats, output JSON, and plan hardware upgrades.
- One command (`uvx whichllm@latest`) detects your GPU/CPU/RAM and ranks local LLMs by live, aggregated benchmarks (LiveBench, Artificial Analysis, Aider, Chatbot Arena, Open LLM Leaderboard) instead of just parameter count.
- Scores are confidence-weighted by data freshness/source (direct vs. self-reported vs. interpolated) and adjusted for runtime fit—VRAM overhead, quantization discounts, and MoE active-vs-total parameter splits.
- It can simulate hypothetical GPUs, reverse-plan what hardware you'd need for a specific model, and output JSON for scripting or piping into jq.
- Example rankings: RTX 4090/3090 tops out with Qwen3.6-27B Q5_K_M (score 92.8, ~27 t/s), 8GB VRAM cards get Qwen3-14B Q3_K_M (score 71.0, ~22 t/s), and CPU-only setups land a 20B MoE model at ~6 t/s (score 45.2).