GitHub built Qubot, an internal Copilot-powered analytics agent that lets employees query their data warehouse in plain English via Slack, VS Code, or the CLI. It pulls federated context from raw, conformed, and curated data layers, then runs queries on Kusto or Trino to deliver SQL-backed insights within seconds. A continuous evaluation framework and community contributions to the context layer keep responses accurate and fast.

• Qubot lets any employee query GitHub's data warehouse in plain English via Slack, VS Code, or CLI, cutting analytics team question load and freeing analysts for harder work
• It uses a three-tier federated context layer (bronze/silver/gold) maintained collaboratively by product, analytics, and business teams, turning scattered knowledge into a single source of truth
• Investing in well-structured context both improved accuracy and cut answer time by two-thirds
• A continuous offline evaluation framework tests every context or agent update against known SQL answers to catch regressions before release