In recent years, Apple’s macOS updates have been intriguing, though not particularly thrilling. This is set to change with the introduction of macOS Sequoia, primarily due to one highlight: Apple Intelligence. This innovative AI platform has the potential to transform your daily interactions with your Mac. From generating images and rewriting emails to summarizing audio recordings and enhancing Siri into a more capable virtual assistant, Apple Intelligence may be the most significant new feature to hit macOS in years.
Now that the latest beta of macOS Sequoia is available, I tested Apple Intelligence to determine its efficacy. Here are my initial impressions.
You can explore Apple Intelligence on your Mac for free by downloading the macOS 15.1 developer beta. However, the disappointing aspect is that many features of Apple Intelligence are currently unavailable for testing. While I was able to examine a few components, my experience was far from comprehensive.
Let’s begin with Siri. Once a frontrunner when it debuted in 2011, Siri has fallen behind its competitors. Apple Intelligence presents a pivotal opportunity to narrow this gap, infusing Siri with much-needed enhancements. Unfortunately, many of the anticipated Siri features are not yet operational in macOS Sequoia. For instance, there’s a lack of contextual awareness regarding questions and what is displayed on your screen. Additionally, the ability to execute functions within other apps is still missing.
So, what new Siri functionalities can users currently access? One of the touted updates is Siri’s ability to adapt to your changing commands or verbal mistakes. For instance, you might say, “Siri, set a timer for 10 minutes… no, five minutes, uh, three minutes.” The expectation is that Siri would recognize your final request.
However, my testing revealed significant shortcomings. Although Siri accurately displayed my spoken words, it frequently misconfigured the timer. On many attempts, it defaulted to a five-minute timer, set an eight-minute timer, or even bizarrely opted for six hours, 32 minutes, and 18 seconds. More often than not, it chose an arbitrary duration rather than honoring my specific request. Clearly, further refinement is needed.
What other enhancements have emerged? Interacting with Siri through typing is now streamlined. By simply clicking the Siri icon in your Mac's menu bar, you can type queries immediately. Previously, this feature required adjustments in accessibility settings. This improvement makes Siri more practical in settings like libraries or cafes, where speaking out loud might be disruptive. Curiously, I could use the Type to Siri feature even though it was reportedly disabled in my accessibility settings. Nevertheless, this is a welcome addition to macOS. Siri also sports a new user interface, with glowing edges that pulse while it processes your queries, but it still feels somewhat limited due to the absence of many features from the beta.
When considering artificial intelligence, writing assistants often come to mind. With macOS Sequoia, Apple introduces native tools for writing assistance. These ‘Writing Tools’ offer functionalities such as text rewriting, proofreading, summarizing, and transforming text into lists or tables. You can easily access this by highlighting text, right-clicking, and selecting the Writing Tools option.
These writing features generally perform well, whether for rephrasing or creating summaries. I see significant potential for drafting professional emails or documents. While I may not use them daily, these tools can provide valuable insights for rephrasing tasks. The text manipulation tools, such as summarization and list-making, feel particularly handy when dealing with lengthy text passages.
A standout aspect of Writing Tools is their versatility; they are not confined to a single application and work seamlessly across various third-party Mac apps. This widespread applicability enhances their usability, allowing you to utilize them where you're most comfortable without interrupting your workflow.
Another beneficial feature included in the latest macOS Sequoia beta is audio transcription. This capability assists with phone calls and recordings, as Apple Intelligence generates summaries of what was said. I tested it with a 38-minute recording using the Voice Memos app. Getting started is straightforward: select the recording, then click the speech bubble icon in the app's corner. Remarkably, Apple Intelligence produced a summary in about 25 seconds.
However, the summary was rife with transcription errors. While inaccuracies are common in audio transcription, it’s frustrating that you cannot edit the output. Additionally, the tool does not distinguish between different speakers, limiting its utility for interviews or calls. It may suffice for quick and informal transcriptions, but for important cases, you'd likely want to rely on a professional service or a more refined AI tool. However, the Writing Tools feature can effectively summarize your transcriptions — my 38-minute recording condensed neatly into four insightful paragraphs.
At this stage, Apple Intelligence’s transcription tools are still evolving, but their potential is clear — provided Apple smooths out the rough edges. As it stands, these are the key Apple Intelligence features available in macOS Sequoia. More functionalities are poised for release, with anticipated arrival dates ranging from shortly after macOS Sequoia’s launch to well into 2025.
Exciting tools like image creation features (Genmoji for custom emojis, the Image Playground, and the Image Wand for refining sketches) as well as ChatGPT integration and priority notifications are notably absent. Many Siri features, including enhanced contextual awareness and app control, are also still missing. Apple’s Mail app is set for a redesign and intends to incorporate smart, AI-assisted replies, yet these enhancements remain unreleased.
Lastly, it appears that AI-driven features in the Photos app, such as natural language image searches and background removal, either exist or are just out of reach for testing, as I encountered crashes attempting to open the Photos app. Overall, this reflects the current state of Apple Intelligence in the macOS Sequoia beta: limited but promising. While there are several features worth exploring, many remain underdeveloped or entirely absent. There’s considerable potential ahead, but patience is key as we await further enhancements from Apple Intelligence in the coming months.
Ranking
