Apple Intelligence is here!!!
Here are my notes - will rewatch and breakdown
Generative models on your device
Protects privacy
CAPABILITIES
- langauage images and action
- understanding your personal experience
- iphone notification prioratisation
- writing tools, proofread, reviewing before posting
IMAGES
- photos, original images, understands images in your photos,
- 3 styles, sketch,
ACTION
- tap into existing apps
- show me all the photos of me and my dog at the beach
PERSONAL CONTEXT
- retrieve data across apps
- emails or events
PRIVACY
- On device processing
- aware of personal data,
- M chips can process and use LLM’s on device
- cross app communication
- if using off device AI processing, you can control who accesses your info
PRIVATE CLOUD COMPUTE
- apple silicon servers
- if not enough processing on device, use only a small part of private cloud compute
- this is your own private cloud no one can see
- external security checks
Apps & experiences
SIRI
- conversational context, keeps knowledge of last conversations
- typing to siri by tapoing the bottom of the phone
- extensive product knowledge
- describe features on apps to use
- siri has on screen awareness
- action inside apps - writing and image
APP INTENTS
- define actions in apps live
- summary of meeting notes to email
PERSONAL CONTEXT
- photos,
- hotel bookings,
- find information across app
SIRI FOR MAC
- enhanced writing
- email, rewrite - multiple versions,
- get the tone right,
- proofread - structure, language
- summarise email at top
- smart reply to emails for quick response
- busy inbox - summaries of emails
- prioraties of emails / dates
Reduce interuptions
- priotatise notifications
Images
GENMOJI
- generate your own emoji
- emoji of your photo/friend in a message
IMAGE PLAYGROUND
- themes
- preview on device
- build your own style
- personal context knowledge
- total original images
- keynote, freeform,
- image playground app
- API
IMAGE WAND (Notes)
- ipad - draft a pic with pencil, generate image
PHOTO EDITING
- remove items from photos
NATURAL LANGUAGE SEARCH
- search photos
MEMORIES
- search fishing
- brings photos
- incorporates music
- builds slideshow
PRIVACY
- not shared with apple or anyone else
NOTES
- transcribe audio
- makes a summary
- participants are notified of someone recording
INTEGRATION OF AI
- Chat gpt integration with siri
- ask permision for use
- take a picture and share with gpt
- docs and pdf questions
No chat gpt account needed
COMPOSE
DEVELOPERS
- SDK
- Image playground integration
- siri enhancement for external integration
- intelligent and useful features
- ai for swift and xcode
DEVICE
- Apple iphone 15 pro
-IOS 18
- M1 devices
#apple #wwdc #appleintelligence #iphone #macos #ipad #sequia #mchip