7 New Siri AI Features in iOS 27 You’ll Actually Use

The Tech Girl www.youtube.com

Brief Summary

The video presents the new features of Siri in iOS 27, emphasizing how these improvements enhance user interactions and practical use in everyday life. Key features include:

  • Personal context to access information effortlessly.
  • On-screen awareness to interact directly with displayed content.
  • Follow-up conversation capabilities allowing natural dialogue.
  • A dedicated Siri app for better organization of interactions.
  • Siri camera mode for real-time physical understanding.
  • Writing assistance in any text field.
  • AI-assisted shortcut creation for simplified automations.

New Siri in iOS 27

In iOS 27, Siri receives significant upgrades that transform its usability. Users can have engaging conversations with Siri, which now understands contextual information, comprehends screen data, and takes actions across various applications. The new features make it particularly useful for real-life tasks, with the aim to simplify information retrieval and interaction.

Search Your Memory — Personal Context

The personal context feature allows Siri to recall and search through one’s previous interactions across apps like messages and emails. Users can ask questions such as, “What was the restaurant Gautam recommended?” to quickly retrieve information without searching multiple apps. This feature relies on Siri AI and requires an iPhone 15 Pro or a more recent model.

Siri Understands Your Screen

On-screen awareness enables Siri to recognize information visible on the user’s screen. For instance, if a user receives an address, they can simply say, “Drive me there,” and Siri will provide directions without needing to manually input the address. This feature streamlines tasks like creating calendar events or seeking information about social media posts, effectively saving time and effort.

Follow-Up Siri Conversations

Siri can now maintain context in follow-up conversations. Instead of treating requests as isolated queries, users can refine their inquiries without restating prior information. For example, starting with “Plan a Saturday in Seattle” allows users to gradually adjust the details without repeating the initial context. This capability is especially beneficial for planning trips and making decisions.

The New Dedicated Siri App

Siri now has its own app where users can review previous conversations and start new ones. This app synchronizes across all Apple devices, facilitating continuous planning without losing context. Users can also engage in text chats with Siri, allowing for smoother organization of thoughts and tasks, which was not possible with voice interaction alone.

Siri Camera Mode

The new Siri mode in the camera app allows Siri to recognize physical objects and provide relevant information. Users can ask questions about unfamiliar items, historical landmarks, or dishes on a menu by simply pointing their camera, making the interaction with Siri more dynamic and intuitive.

Write With Siri Anywhere

Siri can now assist with writing in any text field, allowing users to generate text without starting from scratch. This includes creating lists, outlines, and emails by providing verbal instructions. Siri can also refine existing content and adapt to the user's communication style, enhancing the writing experience across different apps.

Build Shortcuts With AI

The new shortcuts feature simplifies creating automations by utilizing natural language. Users can describe the desired outcome in everyday terms, and Siri will determine the necessary actions to achieve it. This development makes the shortcuts app more accessible, enabling users to automate tasks without needing to understand the technical details of the process.

Summarize any YouTube video in seconds

Get summaries like this one for any video, in your language, with the free Summ app.

Download on the App Store
Get it on Google Play

Transcript

Full transcript of “7 New Siri AI Features in iOS 27 You’ll Actually Use”. Click a timestamp to open the video at that moment. Need another video? Use the YouTube transcript generator.

0:00 City finally got a major upgrade in iOS 27. [music] There's now an actual City app. You can have proper back and forth [music] conversations with it. It can understand what's on your screen, look through your personal information, see through your camera, and even take actions across apps. But instead of just going through all the new features, I want to show you seven new ways that I think the new Siri can actually be useful in real life. It's going to be released in just a few days and I think it's going to be incredibly useful. Let's get started. One of the biggest Siri upgrades is personal context. And I think the most useful way to think about this is that you no longer need to remember where everything is. For example, maybe

0:45 someone recommended a restaurant to you a few months ago, but you have no idea where they sent it through messages or email. Instead of searching individual apps, I can ask Siri, "What was the restaurant Gautam recommended me?" Apple says Siri can use personal context to search across apps like messages, mail, photos, and more. You can also try requests like find the email where Gautam shared details about the upcoming trip. Show me the photos from our Alaska trip where we were near the glacier.

1:31 You can invoke Siri by calling it, holding the side button, or on supported iPhones, just swiping down from the dynamic island. The key here is to intentionally be a little vague. Instead of searching with the exact keywords, describe what you remember and see if Siri can connect the dots. Personal context requires Siri AI, so you need an iPhone 15 Pro or newer supported Apple intelligence iPhone. The next feature is oncreen awareness, but there is a much better way to use this than simply asking what's on my screen. Use it whenever you're about to copy information from one app and do something with it somewhere else. Say a friend sends me an address to a party. I can simply invoke Siri and say, "Drive

2:18 me there." Siri will recognize the address on the screen. Start driving directions to the address. Save time by manually typing the address onto Maps and then driving. Similarly, there is a calendar event on an invitation. I can ask Siri to add a calendar event and Siri will understand and do the job for us. Even better, I'm looking at a random social media post and would like to ask questions about it. I can invoke Siri and ask something like what's the price of this watch? Or if it's a travel information, I can ask track the flight status of this reservation. Oncreen awareness makes 10

3:05 steps into one. This sounds like a basic AI feature, but it completely changes how you use Siri. Siri AI now supports proper follow-up conversations. So instead of treating every request like a completely new question, you can keep refining the same idea. So I could ask, "Plan a Saturday in Seattle. Then instead of starting over, I can say make it kid-friendly. Then only give me indoor options and then add somewhere good for

3:51 vegetarian lunch. You don't need to keep saying Seattle, Saturday, or repeat everything that you already told it. And I think this is especially useful when you're comparing something, researching a trip, planning your day, or trying to make a decision instead of coming up with one perfect Siri command. You can start broad and gradually narrow it down. [music] And this is completely new in iOS 27. Siri now finally has its own dedicated app. Open the Siri app and you can see conversations that you have previously had with Siri. Start a new conversation here.

4:43 Search through previous ones and pin conversations that you want to come back to. It even synchronizes across all the Apple devices. This changes how I would use Siri for anything that takes more than 5 minutes. Let's say I'm planning a trip. Instead of having one Siri conversation today and completely losing that context, I can come back to the Siri app later, open that conversation and continue planning. The best part about the app is I can type and chat with Siri instead of a voice conversation. I can copy paste emails, ask it to summarize, draft responses and a lot more now with the dedicated app which was not possible with voice only Siri before.

5:29 [music] Another new feature is Siri mode inside camera app. Open camera, switch to Siri mode, point the phone at something and tap the shutter button. Siri can then use visual intelligence to understand what's physically in front of you. Apple specifically shows things like getting nutritional information from a plate of food and splitting a bill with friends using a cache. But there are a lot more practical ways that I would use this. At a grocery store, point it at something unfamiliar and ask, "What is this and how would I cook it?" While traveling, point it at a landmark and ask about its history. Point it at a menu and ask questions

6:16 about the dishes. Previously, you would probably take a photo, open an AI app, upload it, and ask your question. Now, the camera itself becomes an input for Siri. [music] This is my favorite. Siri is now available in any text field, and that is a huge deal. With the new write with Siri tools, Siri can generate text from scratch virtually anywhere that you can type. So instead of opening notes and staring at a blank page, I could tap here and say create a 3-day packing checklist for New York. Then I can say separate it into clothes, toiletries, and electronics or remove

7:01 anything that I probably don't need. and then you can edit it to your liking. So you don't have to always start from scratch. You can now use the same thing for brainstorming, meal planning, emails, project outlines, or even just organizing random thoughts. Siri can also revise what you have already written, give feedback, and in mail and messages, Apple says it can account for how you normally communicate with a particular recipient. So the useful part isn't simply Siri can write. It's that you can start and refine the content inside the place where you already need it. [music] And this might be the iOS 27 feature that makes the most powerful iOS app in my opinion. The shortcuts app a lot more

7:47 useful to people. Normally if you want a complicated shortcut, you need to understand triggers, actions, variables, and how everything connects. In iOS 27, when you create a new shortcut, there's a new describe a shortcut interface. You explain what you want in normal language and Apple intelligence assembles the required actions. You can even describe changes afterward and have it adjust the shortcut. When I'm leaving home, turn off all the lights at home. Shortcuts figures out the actions needed to make this happen. So, instead of learning how to build an automation, start with the outcome that you want and then describe it. For me, this is probably one of the most practical AI upgrades in iOS 27. So, those are the seven ways I think the

8:32 new Siri in iOS 27 becomes much more useful. The biggest change isn't just that Siri can answer harder questions. It's that Siri now understands more of the context around the question, what you're looking at, what you're talking about, and increasingly what you actually want done. I'll catch you in the next one. This is Sana. Bye-bye.

Share

More video summaries