Instacart developed Maple, a service designed to streamline large-scale processing of LLMs across the company, addressing challenges such as rate limitations and duplicated efforts in AI workflows. Maple automates batching, encoding, file management, and retries, allowing teams to efficiently process millions of prompts while significantly reducing costs and enhancing productivity. By abstracting complexities, Maple facilitates reliable and scalable AI operations within Instacart's infrastructure.

Sidekick is an open-source CLI-based AI tool designed as an alternative to existing AI coding assistants, allowing users to choose from various LLM providers without vendor lock-in. It features a flexible system for managing AI models, project-specific guidance, and a user-friendly command line interface, currently in beta and actively developed. Users can easily install it and configure their preferences for enhanced productivity.