Apple has begun testing updates that make Siri far more active in the background of your daily life. In developer betas for iOS 27.3 and watchOS 27.3 released this week, Apple introduced new “Audio Intelligence” features that can listen to conversations through your Apple Watch, alongside new capabilities that let Siri take actions inside third-party iPhone apps.
Ambient recording devices have often faced criticism over privacy, particularly regarding bystanders who might not know they are being recorded. According to reports from TechCrunch and The Verge, Apple is attempting to address those concerns by limiting what is stored, omitting sensitive details, and processing audio through dedicated hardware security.
How Live Rewind and Siri Recaps work
The audio features, first previewed at Apple’s September hardware event, include two conversation tools: Live Rewind and Siri Recaps. Both are opt-in and designed for the Apple Watch Series 12 and Apple Watch Ultra 4.
Live Rewind is meant for moments when you miss what someone said, such as a waiter listing dinner specials or a colleague sharing verbal directions. By double-pressing the watch’s Digital Crown, you can pull up a text snippet showing what was said during the previous 15 seconds. According to TechCrunch, the watch plays an audible chime and shows an on-screen animation when you press the crown to signal to nearby people that audio was captured. The snippet automatically deletes after 30 seconds unless you choose to save it to your Siri app.
Siri Recaps goes a step further by using ambient listening to take high-level notes of ongoing discussions. Apple says it does not save raw audio, identify specific speakers, or produce word-for-word transcripts. Instead, the software creates short summaries with factual bullet points, such as deadlines, dates, or pricing mentioned during meetings and appointments.
Users can schedule recaps to run only during set hours, such as work periods, or switch the feature off at any time from the Control Center. Unsaved recaps delete themselves after seven days, and the watch prompts you to review what was captured at the end of each day and when you unlock the device in the morning.
Where your audio and data actually go
Allowing a microphone to listen to your environment raises obvious privacy questions. In an Audio Intelligence Privacy Overview document cited by The Verge, Apple stated that raw audio is processed within dedicated hardware on the watch, is never saved as an audio file, and cannot be accessed by apps, the operating system, or Apple itself.
The system relies on a split architecture. The S11 chip on the Apple Watch uses a hardware-protected buffer to check whether a conversation is taking place. That audio is transferred securely to the paired iPhone, which converts it into text and strips out filler words. That text is then sent via encrypted connection to Apple’s Private Cloud Compute servers to generate the summary bullet points before being deleted from the cloud immediately.
This hybrid setup reflects the broader shift in how modern assistants balance device hardware with remote servers, an approach explored in our guide on on-device AI vs cloud AI. Apple also stated that Siri Recaps automatically filters out personal data, such as government identification numbers, authentication credentials, and financial details, before summaries are saved.
Siri gets broader access to third-party apps
Alongside watchOS audio tools, the iOS 27.3 update expands what Siri can do across your phone. According to The Verge, Apple is opening new developer tools that let Siri understand natural language prompts, personal context, and on-screen content across third-party applications.
A developer feature called “app skills” allows apps to package multi-step tasks into single Siri requests. Because Siri can now track active Live Activities and foreground tasks, you do not have to name the app you are speaking to. For instance, Apple noted that if you order a car and watch its progress, you can say, “Hey Siri, change my ride pickup to a new address,” without mentioning the ride-sharing service by name.
Apple is also adding these deeper interactions to its own built-in apps, including Mail, Notes, Safari, Calendar, and Maps, letting users ask Siri to do things like find recently visited locations or clean up older files.
Who can use these features today?
You cannot use these features on your everyday device just yet unless you are enrolled in Apple’s developer preview programs. After developer testing, Apple plans to roll out the updates to its public beta program before making them available in a standard software release.
There is no separate subscription fee announced for the features; they are built directly into the operating system updates. However, the Audio Intelligence listening tools require an Apple Watch Series 12 or Apple Watch Ultra 4, meaning owners of older watch models will not have access to Live Rewind or Siri Recaps even after the software leaves beta.