foundation-models-on-device

Topics in the source

• FoundationModels: On-Device LLM (iOS 26)
• When to Activate
• Core Pattern — Availability Check
• Core Pattern — Basic Session
• Core Pattern — Guided Generation with @Generable
• 1. Define a Generable Type
• 2. Request Structured Output
• Supported @Guide Constraints

Patterns for integrating Apple's on-device language model into apps using the FoundationModels framework. Covers text generation, structured output with @Generable, custom tool calling, and snapshot streaming — all running on-device for privacy and offline support. Building AI-powered features using Apple Intelligence on-device Generating or summarizing text without cloud dependency Extracting structured data from natural language input Implementing custom tool calling for domain-specific AI actions Streaming structured responses for real-time UI updates Need privacy-preserving AI (no data leaves the device) Always check model availability before creating a session: Key points for instructions: Define the model's role ("You are a mentor") Specify what to do ("Help extract calendar events") Set style preferences ("Respond as briefly as possible") Add safety measures ("Respond with 'I can't help with that' for dangerous requests") Generate structured Swift types instead of raw strings: .range(0...20) — numeric range .count(3) — array element count description: — semantic guidance for generation Let the model invoke custom code for domain-specific tasks: Stream structured responses fo

This is an excerpt. Refer to the complete source and its current requirements.