Apple is further expanding Apple Intelligence in iOS 16, iPados 16 and MacOS Tahoe with a lot of new functions. Perhaps the most important innovation is the support for Dutch, which is expected later this year. You can also take advantage of new possibilities.
For example, you can also use Visual Intelligence for things on your screen, you can mix emojis and Image Playground has been further expanded with more creative options and styles. You can also use live translation into messages, FaceTime and the telephone app, but unfortunately not in Dutch. We list this and other new Apple Intelligence functions for you.
Visual Intelligence on screen
Visual Intelligence was initially limited to analyzing photos that you took with the camera. From iOS 26 you can now also make screenshots of what is on your iPhone screen and analyze it directly with Visual Intelligence. For example, you can recognize a product, text or place on a screenshot and then request extra information or search for comparable images.
Visual Intelligence can not only recognize animals and plants, but also art, books, sights, natural monuments and sculptures. Because of the integration with Chatgpt you can ask questions about what you see on your screen or in a screenshot, and you immediately get answers or extra context.
Visual intelligence also recognizes when a user looks at an event and proposes to add it to his agenda. Apple Intelligence then picks up the date, time and location to enter this important information in an event.
Genmoji and Image Playground
From software version 26 you can not only make Genmoji with text, but also by combining text and existing emoji. If you make images of friends and family members with Genmoji and Image Playground, you can adjust their expressions or external characteristics such as their hairstyle more easily.
In Image Playground you get access to brand new styles with chatgpt, such as an oil paint or vector style. And if you already have a certain idea, choose a random style and describe exactly what you want. Image Playground sends your description or photo to Chatgpt and makes a unique image. You can always choose whether you want to use chatgpt and also decide for yourself what is shared with Chatgpt.
Translate live into messages, telephone and facetime
Not available in Dutch
Language barriers are a thing of the past with live translation. This feature helps you communicate in different languages, whether you send messages or talk to someone. Live translation is integrated in messages, Facetime and Phone, and is made possible by Apple models that run entirely on your own device, so all your conversations remain private.
In messages you can automatically translate messages with live translation. For example, if you want to meet with new people you have met on a trip, your messages will be translated while you type and displayed in the recipients’ preferred language. And when you receive a response, you can also have it translated immediately. In FaceTime interviews you can follow the translation via live captions while listening to the speaker. And when you call, you will hear the translation immediately during the conversation.
Live translation in messages is available in Chinese (simplified), German, English (VK, US), French (France), Italian, Japanese, Korean, Portuguese (Brazil) and Spanish (Spain). Live translation in telephone and Facetime is available for one -to -discussions in German, Engels (VK, US), Frans (France), Portuguese (Brazil) and Spanish (Spain).
Workout Buddy for Apple Watch
Not available in Dutch
Workout Buddy is a new function in Watchos 26 that uses Apple Intelligence to raise your sports performance to a higher level. You can best compare the function with a virtual AI coach that you motivate in real time during your workout, give feedback and analyze your performance based on your personal training dates and history.
Unfortunately, with the introduction, Workout Buddy is only available in English and only works for a select number of popular workouts. In addition, the function requires an Apple Watch that is connected to an iPhone that supports Apple Intelligence.
AI in assignments
Assignments are more versatile and smarter than ever. Thanks to Apple Intelligence, completely new intelligent promotions are now available. This means that you can process almost all Apple Intelligence functions in assignments and automation. There are special promotions for features such as summarizing text with writing aid or making images with Image Playground.
You can also use Apple Intelligence models directly, on the device itself or with private cloud compute, to generate reactions that you can use in the rest of your assignments. For example, as a student you can create an assignment that Apple Intelligence models uses to compare an audio transcription of a lecture with your own notes-and to supplement it automatically where necessary. You can also generate comments that you can use in assignments with chatgpt.
On a Mac you can also immediately consult Apple Intelligence assignments from Spotlight with the new tasks option. This way you can perform actions in no time.
Apple Intelligence available for developers
Apps can easily use the smart intelligence functions from Apple that runs on your iPhone itself. With the Foundation Models-Framework, developers can quickly add new smart functions that also work offline and protect your privacy. This way all apps can use the Apple Intelligence tools. We explained exactly how this works in the highlighted article below.
Other adjustments
- You can now automatically categorize the relevant promotions from an e-mail, website, note or other content Memories. You can also automatically sort memory lists and reconciles are automatically displayed in the app.
- Apple Wallet Can now retrieve shipping details from the emails that you have received from the webshop and carrier and give you an overview of them. This works for all orders. With this you see all ordering data at a glance and what the status of your package is.
- You can make a poll in To informand with Apple Intelligence, a poll is presented in situations where this can come in handy. You can also adjust the backgrounds in the Message app to give your chats a personal touch. You can choose from existing designs or make a background with Image Playground yourself.