macOS - Apple Developer

Open original

This is Apple's developer landing page for macOS, pitching the tools developers can use to build apps that plug into Apple Intelligence, Siri, and the system. The main pieces are App Intents for surfacing app content to Siri, the Foundation Models framework for on-device and cloud AI features, and graphics and video APIs for games and editing apps.

  • App Intents lets apps expose content and actions to Siri and Spotlight through schemas, so users can act on them with natural language and no custom phrases to define.
  • The Foundation Models framework is a Swift API giving access to Apple's on-device and Private Cloud Compute models, and it can also run any provider that conforms to the Language Model protocol.
  • The Video Effects API offers machine-learning tools like Motion Blur, Frame Rate Conversion, and up to 4x super-resolution upscaling for video editing apps.

Apple's developer page for macOS is mostly a pitch to third-party developers, and the substance sits in three frameworks. The first is App Intents, which connects an app's content and actions to Siri and Apple Intelligence. Entity schemas feed your content into the Spotlight semantic index, so the system can understand personal context. Intent schemas let people act on that content in plain language without you writing custom phrases for every command. The View Annotations API goes a step further by letting you map on-screen views to entities, so someone can refer to what they're looking at and act on it. For developers, the practical pitch is less code for more natural voice and conversational control. The second is the Foundation Models framework, a native Swift API that gives direct access to Apple's on-device models and Private Cloud Compute. It also accepts any model provider with a Swift package that conforms to the Language Model protocol, so you aren't locked into Apple's models. It supports multimodal prompts, pairing images with text using on-device Vision framework tools. Dynamic Profiles let you swap models, tools, and instructions mid-session, and the Evaluations framework is there to check that AI features hold up under varied conditions. The page is light on specifics about pricing, latency, or model sizes, so anyone planning a serious build will need to check the documentation themselves. Elsewhere the page covers the rest of the macOS toolkit: Liquid Glass design, Metal 4 for GPU-heavy games with ML inference inside shaders and MetalFX upscaling, and Game Porting Toolkit 4, which adds command-line Metal tools built for AI coding agents. The Video Effects API exposes ML-based processing such as Motion Blur, Frame Rate Conversion for retiming and slow motion, and Image and Video Super-Resolution that upscales by up to 4x. Live Activities and widgets round things out, with iPhone Live Activities showing up in the Mac menu bar and widgets placed on the desktop or in Notification Center.

Ask about this article