Click any tag below to further narrow down your results
Links
PixelRAG converts web pages, PDFs, and images into screenshot tiles, embeds them using a fine-tuned Qwen3-VL model, and builds vector indexes for retrieval-augmented generation. It provides a CLI (pixelshot), pipeline commands for chunking, embedding, indexing, and serving (FAISS or Qdrant), plus a live API and a Claude plugin for visual search.
- PixelRAG ditches HTML parsing entirely, indexing screenshot tiles of pages/PDFs via a fine-tuned Qwen3-VL embedding model to preserve tables, charts, and layout
- Ships a pre-built index of 8.28 million Wikipedia articles, usable via a free live API or a ~217GB local download
- Includes a Claude Code plugin ("pixelbrowse") that lets Claude screenshot live pages and read diagrams/tables visually on request
- Supports both FAISS (simple/local) and Qdrant (disk-backed, quantized, multi-server) as swappable backends for scaling
The article shows how packing specialized, retrieved knowledge into smaller AI agents can match or beat huge frontier models. It explains a structure—raw source extractions, concept entries, theses and a startup primer—plus embedding‐powered retrieval to feed just the right context at query time.
- Structured retrieval (10,000 pages → 381 concept docs + 54 theses via hybrid BM25/semantic search) let smaller models match or beat frontier models on specialized tasks.
- The same pipeline replicated across a dozen domains, from finance to rare medical research to corporate policy.
- A locally-run Qwen model with this "knowledge agent" harness performed comparably to Claude Opus, at zero cloud cost.
- Embedding costs were trivial (under a dollar for thousands of documents using BGE-M3 or OpenAI's text-embedding-3-small) before moving entirely to local hardware.