The author expresses frustration with DSPy and GEPA, two AI tools designed for modular programming in LLM workflows. Despite initial optimism, the author finds that the modular approach doesn't suit complex tasks like multi-turn search, leading to ineffective results.

Instacart developed Maple, a service designed to streamline large-scale processing of LLMs across the company, addressing challenges such as rate limitations and duplicated efforts in AI workflows. Maple automates batching, encoding, file management, and retries, allowing teams to efficiently process millions of prompts while significantly reducing costs and enhancing productivity. By abstracting complexities, Maple facilitates reliable and scalable AI operations within Instacart's infrastructure.

Sidekick is an open-source CLI-based AI tool designed as an alternative to existing AI coding assistants, allowing users to choose from various LLM providers without vendor lock-in. It features a flexible system for managing AI models, project-specific guidance, and a user-friendly command line interface, currently in beta and actively developed. Users can easily install it and configure their preferences for enhanced productivity.