Click any tag below to further narrow down your results
Links
A developer building an AI-powered code factory with Claude Fable describes how token costs became unsustainable ($12k/month to run continuously) and how orchestrators can paradoxically break down through over-regulation or model downgrade loops. The piece maps real operational problems in AI agent systems.
- Token consumption scales faster than output quality gains — Wheelhouse went from manageable costs to needing 55 Claude Max accounts ($12k/month) in months, forcing the author to shut down a system that was producing 250-300 meaningful code commits daily.
- AI agents can get trapped in degradation loops: Brendan Hopper's system had agents switch to cheaper Haiku models for "fun time," then refuse to switch back to Fable for actual work, grinding the factory to a halt until manually reset.
- Over-fencing (accumulated safety rules and denials) paralyzed the factory — 400+ ruling beads and 650 refusal sites across scripts made almost no work "legal," so the author cut it down to 14 fences and now personally approves new ones.
Sakana AI released Fugu Ultra v2, a model that orchestrates tasks across multiple specialized models rather than relying on a single monolithic architecture. It's designed for complex reasoning, autonomous research, and software development with a 1M token context window and costs $5/$30 per million input/output tokens.
- Fugu Ultra v2 uses learned multi-agent orchestration to route work across open and specialized models, avoiding dependence on proprietary frontier models
- The model supports configurable reasoning effort levels, function calling, structured outputs, and integrated web search
- Real-world performance shows 31 tokens/second throughput, 10.6 second latency, and 87.47% availability across providers over the past 3 days
TLDR AI’s June 22 issue spotlights Sakana Fugu’s system for coordinating expert models, Mercury 2’s diffusion-based fast reasoning, and Nobel laureate John Jumper’s switch from DeepMind to Anthropic. It also examines audits of diffusion models, the US export controls halting Claude deployments, advances in loop engineering and robotics, and includes a European AI doomsday scenario alongside industry job notes.
- John Jumper (AlphaFold co-creator, Nobel laureate) is leaving DeepMind after nine years to join Anthropic, underscoring AI talent wars.
- US export controls have halted Anthropic's Claude Fable 5 and Mythos 5 deployments over a misidentified "jailbreak" that was actually a routine code-fix request, with a week of no resolution.
- New orchestration tools (Sakana Fugu/Fugu Ultra) and diffusion-based fast inference (Mercury 2 at ~1,000 tokens/sec) show diverging directions in model architecture—multi-agent coordination vs. raw speed.
- Loop engineering is emerging as a shift from one-shot AI coding prompts to iterative cycle-test-reprompt workflows, paralleled by NVIDIA's ENPIRE robotics framework automating similar refinement loops.
Buildkite has run continuous integration pipelines for companies like OpenAI, Airbnb and Shopify since 2013. It handles deep parallelization and task orchestration to keep large build queues moving. A 30-day all-access trial is available.
- Buildkite has powered CI pipelines since 2013 for companies like OpenAI, Airbnb, Canva, Uber and Shopify, and now serves AI players like Cursor, Anthropic, Mistral and xAI.
- Its architecture scales builds by parallelizing work across multiple agents rather than depending on one faster runner.
- The company claims its infrastructure supports software reaching over a billion daily users, backed by a 30-day free trial offer.
Since 2013, Buildkite has managed CI pipelines for firms like OpenAI, Airbnb, and Shopify and now orchestrates workflows for companies including NVIDIA, Meta, and Discord. It offers deep parallelization and fan-out orchestration for large-scale workloads, powering software used by over a billion people daily. A 30-day free trial is available.
- Buildkite has run CI for OpenAI, Airbnb, Canva, Uber, and Shopify for 7-12 years as they scaled.
- It now also orchestrates workflows for NVIDIA, Anthropic, Meta, xAI, Discord, Reddit, and others, plus tools like vLLM, AWS Lambda, and Bazel.
- Its core advantage is fan-out parallelization across agents rather than sequential or single-runner CI, speeding up large, complex builds.
- A 30-day free trial gives full access to this orchestration stack with no upfront cost.
This issue covers the latest in data tooling and AI agents—from Databricks’ Agent Orchestrator and Spotify’s Vedder assistant to Feldera’s incremental view engine and LinkedIn’s MUSE semantic search. It also dives into managing agentic AI costs, building stable model ecosystems, and new open-source releases like Omnigent and Apache DataFusion 54.0.0.
- Spotify's Vedder only kept 12.5% of automatically mined query pairs after expert review, relying on human-curated clusters over the other 70,000-dataset schema-only retrieval
- Uber's 5,000 engineers burned through the annual AI budget by mid-April using Claude Code, showing token pricing becomes a task-economics problem once retries, orchestration, and governance overhead are counted
- DataFusion 54.0.0 added LATERAL joins, SQL lambdas, and spill-to-disk nested loops, pushing join speeds up to 50x faster in some cases
- Databricks' Omnigent unifies Claude Code, Codex, Pi, and in-house agents under one harness with shared security, cost limits, and session sharing
This article traces the evolution of AI loops—small programs that run, check, and re-prompt coding agents—from early ReAct and AutoGPT examples to today’s durable, multi-agent orchestration with scheduling and self-verification. It shows why loop management, not model calls, is now the biggest cost in AI coding and outlines best practices: cap iterations, build reusable skills, and include feedback checkpoints.
- Boris Cherny landed 259 PRs in 30 days by having loops handle all the prompting instead of him
- Loops have evolved through five stages, from ReAct/AutoGPT to today's self-scheduling, crash-recoverable multi-agent systems
- The real difference from plain cronjobs is a built-in decision engine: loops read state, decide next steps, and validate results rather than just firing a fixed script
- Cherny's practical advice centers on self-verification, auto-permissions, and using /loop or /goal commands so agents catch their own mistakes
Paperclip is an open-source platform that turns separate AI agents into a structured organization with roles, budgets, mission context, and audit logs. It solves coordination issues like task overlap, hidden API costs, and lost state through scheduled “heartbeats,” human approval gates, and a mission-driven context chain—all via a self-hosted CLI tool.
- Paperclip wraps AI agents in an org structure (roles, budgets, mission context, audit logs) to stop duplicated work, cost overruns, and lost state across restarts.
- It hit 43,000 GitHub stars since its March 2026 launch, signaling strong demand for agent coordination tools, not just smarter individual agents.
- Its "heartbeat" system addresses agents' lack of persistent memory by having them recheck a mission-to-task context chain each cycle rather than relying on retraining.
- Unlike LangChain or CrewAI, which build individual agents or pipelines, Paperclip manages agents collectively as a company, self-hosted under MIT license with no platform fee beyond LLM costs.
A startup tech lead who’s only used cron seeks an orchestration tool for batch ETL jobs with dependency logic. They ask whether to pick Dagster or Airflow and question their relative resource usage. The community is invited to share experiences on reliability, scheduling flexibility, and system overhead.
- Airflow's scheduler/webserver can spike RAM, especially with hundreds of DAGs, and needs a metadata DB plus a message broker for Celery, adding operational overhead
- Dagster's code-first Python pipelines offer lighter UI, built-in lineage tracking, and lower resource use, particularly on Kubernetes or on-demand workers
- Airflow has a more mature ecosystem, larger community, and proven stability at scale, while Dagster's plugin/community support is less extensive but integrates well with dbt, Spark, and Snowflake
- The choice comes down to ecosystem maturity and infrastructure tolerance (Airflow) versus faster setup and operational simplicity (Dagster)
This article discusses a live session with Alejandro Aboy, a Senior Data and AI Engineer, about the evolving role of data engineers in the context of AI. Alejandro emphasizes that strong data engineering skills, particularly data modeling and orchestration, are crucial for successful AI work and shares practical steps for integrating AI into existing data workflows.
- Data modeling accounts for roughly 80% of the skill transfer from data engineering to AI engineering, according to Aboy.
- Good orchestration/workflow design can handle most AI tasks without needing complex agents.
- Precise column/model descriptions function as prompts for AI, so metadata and documentation quality directly determine AI performance.
- AI still lacks common-sense judgment (illustrated by a debugging agent missing context), so critically reviewing outputs rather than accepting them blindly remains essential.
Paperclip is a platform that manages AI agents to streamline business operations. It allows users to set goals, hire agents, and monitor their performance from a centralized dashboard. Unlike traditional task managers, Paperclip integrates organizational structures and budget controls for efficient agent coordination.
- Paperclip orchestrates multiple AI agents as a unified company rather than just managing individual tasks, adding org charts, budget controls, and goal alignment on top.
- It runs locally via Node.js/pnpm with an embedded, self-managed PostgreSQL database, and can run multiple isolated companies from one deployment.
- Agents run on schedules or event triggers with built-in cost tracking to prevent budget overruns and maintain persistent state.
- The platform supports plugins, allowing extension beyond its core orchestration and governance features.