NYT: Apple’s AI Push to Focus on Siri →

Tripp Mickle, Brian X. Chen and Cade Metz:

Apple is expected to show off its A.I. work at its annual developers conference on June 10 when it releases an improved Siri that is more conversational and versatile, according to three people familiar with the company’s work, who didn’t have permission to speak publicly. Siri’s underlying technology will include a new generative A.I. system that will allow it to chat rather than respond to questions one at a time.

[…]

Apple executives worry that new A.I. technology threatens the company’s dominance of the global smartphone market because it has the potential to become the primary operating system, displacing the iPhone’s iOS software, said two people familiar with the thinking of Apple’s leadership, who didn’t have permission to speak publicly. This new technology could also create an ecosystem of A.I. apps, known as agents, that can order Ubers or make calendar appointments, undermining Apple’s App Store, which generates about $24 billion in annual sales.

While “AI apps and agents” are a ways off — ahem — Apple’s not wrong to think defensively about the iPhone as newer, younger technologies come on the scene.

There is one part of this article that jumped out at me, though:

Apple’s top software executives decided early last year that Siri, the company’s virtual assistant, needed a brain transplant.

The decision came after the executives Craig Federighi and John Giannandrea spent weeks testing OpenAI’s new chatbot, ChatGPT. The product’s use of generative artificial intelligence, which can write poetry, create computer code and answer complex questions, made Siri look antiquated, said two people familiar with the company’s work, who didn’t have permission to speak publicly.

I would bet money that Apple has known Siri needed serious work long before ChatGPT showed up on the scene. If not, then, in the words of Elon Musk… concerning.

Logitech’s Mouse Software Now Includes ChatGPT Support, Adds Janky ‘ai_overlay_tmp’ Directory to Users’ Home Folders

I recently noticed a new folder in the root level of my Home directory, named ai_overlay_tmp:

ai_overlay_tmp

In preparation for a Mac Power Users episode, I’ve been playing with a bunch of AI software, and I assumed something I downloaded generated this folder. I deleted it, just to be frustrated when the folder reappeared on its own.

Adding a new folder to the Home directory is a Cardinal Sin of Mac Programming, so I was on a mission to root out the cause. After some searching online, it seems that this folder was generated by Logi Options+, the software that came with my mouse, the Logitech MX Master 3S.1

Version 1.70 of Logi Options+ launched last week with — I kid you not — AI tools you can launch anywhere your cursor is located:

In today’s fast-paced, technology-enabled world, everyone is learning to work differently with breakthroughs in Generative AI.

Mastering prompt building enhances your efficiency and creativity. That’s why we developed the Logi AI Prompt Builder, a time and click-saving solution. Rephrase, summarize, and create custom-made prompt recipes with ChatGPT faster, with virtually no disruption to your workflow.

I cannot tell how little I want THE SOFTWARE FOR MY MOUSE to include features tied to ChatGPT … let alone a mouse with a built-in button to start a prompt.

These features are spun up into their own process named “Logi Al Prompt Builder” as you can see here:

Logi AI Prompt Builder

Best I can tell, there’s no way to disable these features, and they are automatically loaded with the Logi Options+ software is running. Some people have suggested running the “Offline” version of Options+ to avoid these features.

Update: You can also jump through these hoops to disable the AI features in the regular versions of Options+.

That seems to have done it for me, but only after I nuked everything Logitech off my system, including a 700 MB support folder buried in my Home folder. (Thanks, Hazel!)

Of course, you don’t need Logitech software to use a Logitech mouse once the initial settings are in place. For future tinkering, I’ve decided to check out SteerMouse and keep Logitech software off of my system.

As you can see, it can be used to adjust parameters on my MX Master 3S just fine, without any AI-powered bloatware:

Steermouse

I know AI is all the rage right now and having a deal to bring ChatGPT into your software is trendy, but including a tool like this in what is basically a mouse driver is ridiculous. I’m not opposed to using AI in software. I’m just opposed to when it shows up as an unexpected, poorly-implemented feature in software that doesn’t need it.

At least Logitech’s Mac developers did such a bad job with it, that it was easy to spot.


Sam Altman Now Works at Microsoft (Update: Maybe?) →

Tom Warren at The Verge:

Microsoft is hiring former OpenAI CEO Sam Altman and co-founder Greg Brockman.

Altman was fired from OpenAI on Friday after the board said it “no longer has confidence in his ability to continue leading OpenAI.” After a weekend of negotiations to potentially bring Altman back to OpenAI, Microsoft CEO Satya Nadella announced that both Altman and Brockman will be joining to lead Microsoft’s new advanced AI research team. Altman will have the CEO title of this new group.

“We’re extremely excited to share the news that Sam Altman and Greg Brockman, together with colleagues, will be joining Microsoft to lead a new advanced AI research team,” says Nadella. “We look forward to moving quickly to provide them with the resources needed for their success.”

Remember when Nadella said he wanted to make Google dance? My word.

Update: Well, maybe not, or at least not for long…

More on Sam Altman’s Sudden Departure from OpenAI

In the 24 hours since Sam Altman was fired from OpenAI, we’ve learned more about what is going on at the nonprofit. Let’s start with Kevin Roose, writing at The New York Times:

I’ll start by saying: I don’t know all the details about why Mr. Altman was pushed out. Neither, it seems, do OpenAI’s shellshocked employees, investors and business partners, many of whom learned of the move at the same time as the general public. In a blog post on Friday, the company said that Mr. Altman “was not consistently candid in his communications” with the board, but gave no other details.

An all-hands meeting for OpenAI employees on Friday afternoon didn’t reveal much more. Ilya Sutskever, the company’s chief scientist and a member of its board, defended the ouster, according to a person briefed on his remarks. He dismissed employees’ suggestions that pushing Mr. Altman out amounted to a “hostile takeover” and claimed it was necessary to protect OpenAI’s mission of making artificial intelligence beneficial to humanity, the person said.

Roose continues:

Brad Lightcap, an OpenAI executive, told employees on Saturday morning that the company had been talking with the board to “better understand the reason and process behind their decision,” according to an internal message I obtained.

“We can say definitively that the board’s decision was not made in response to malfeasance or anything related to our financial, business, safety or security/privacy practices,” he wrote. “This was a breakdown in communication between Sam and the board.”

It seems like what is left of the board is having second thoughts, according to Alex Heath and Nilay Patel:

The OpenAI board is in discussions with Sam Altman to return to CEO, according to multiple people familiar with the matter. One of them said Altman, who was suddenly fired by the board on Friday with no notice, is “ambivalent” about coming back and would want significant governance changes.

Altman holding talks with the company just a day after he was ousted indicates that OpenAI is in a state of free-fall without him. Hours after he was axed, Greg Brockman, OpenAI’s president and former board chairman, resigned, and the two have been talking to friends and investors about starting another company. A string of senior researchers also resigned on Friday, and people close to OpenAI say more departures are in the works.

Siri, play the theme song from Curb Your Enthusiasm.

(For what it’s worth, I think Steve Troughton-Smith’s take on all of this is exactly right.)

Sam Altman Out at OpenAI →

OpenAI has some big news this Friday afternoon:

The board of directors of OpenAI, Inc, the 501(c)(3) that acts as the overall governing body for all OpenAI activities, today announced that Sam Altman will depart as CEO and leave the board of directors. Mira Murati, the company’s chief technology officer, will serve as interim CEO, effective immediately.

A member of OpenAI’s leadership team for five years, Mira has played a critical role in OpenAI’s evolution into a global AI leader. She brings a unique skill set, understanding of the company’s values, operations, and business, and already leads the company’s research, product, and safety functions. Given her long tenure and close engagement with all aspects of the company, including her experience in AI governance and policy, the board believes she is uniquely qualified for the role and anticipates a seamless transition while it conducts a formal search for a permanent CEO.

The reason for this change is unclear, but clearly serious:

Mr. Altman’s departure follows a deliberative review process by the board, which concluded that he was not consistently candid in his communications with the board, hindering its ability to exercise its responsibilities. The board no longer has confidence in his ability to continue leading OpenAI.

In addition to Altman’s firing, OpenAI’s Greg Brockman is stepping down as board chairman, but he will “remain in his role at the company, reporting to the CEO.” and has left the company.

Ah Yes, Branding →

Tom Warren, reporting on the news that Microsoft rebranding “Bing Chat” to bring it more in line with the company’s other AI-powered products, which wear the far superior “Copilot” name:

“Bing Chat and Bing Chat Enterprise will now simply become Copilot,” explains Colette Stallbaumer, general manager of Microsoft 365. The official name change comes just a couple of months after Microsoft picked Copilot as its branding for its chatbot inside Windows 11. At the time it wasn’t clear that the Bing Chat branding would fully disappear, but it is today.

This makes a lot of sense to me. But then Microsoft had to go Microsoft it up:

Microsoft is now pitching Copilot as the free version of its AI chatbot, with Copilot for Microsoft 365 (which used to be Microsoft 365 Copilot) as the paid option. The free version of Copilot will still be accessible in Bing and Windows, but it will also have its own dedicated domain over at copilot.microsoft.com — much like ChatGPT.

Business users will sign into Microsoft Copilot with an Entra ID, while consumers will need a Microsoft Account to access the free Copilot service. Microsoft Copilot is currently officially supported only in Microsoft Edge or Chrome, and on Windows or macOS.

The Humane AI Pin →

After a lot of hype — and a massive last-minute leak — Humane has launched its first product, the AI Pin.

(Humane spells the product name differently in various places on its website, but I’m going with this style.)

Humane AI Pin

I encourage you to take ten minutes and watch the introductory video, which shows off the hardware, software and services that the team has stitched together to create the $700 device.

And what a team it is. Humane is led by husband and wife Imran Chaudhri and Bethany Bongiorno, who both had long careers at Apple before leaving in 2016. What came next is detailed in a New York Times profile of the pair and their new device:

A Buddhist monk named Brother Spirit led them to Humane. Mr. Chaudhri and Ms. Bongiorno had developed concepts for two A.I. products: a women’s health device and the pin. Brother Spirit, whom they met through their acupuncturist, recommended that they share the ideas with his friend, Marc Benioff, the founder of Salesforce.

Sitting beneath a palm tree on a cliff above the ocean at Mr. Benioff’s Hawaiian home in 2018, they explained both devices. “This one,” Mr. Benioff said, pointing at the Ai Pin, as dolphins breached the surf below, “is huge.”

“It’s going to be a massive company,” he added.

Time will tell if Benioff is correct, but there’s no arguing that this device has a hard road ahead of it. Historically, products designed to help people use their phones less haven’t done well. The Apple Watch is the only successful product that can help you live phone-free days, but even then, most people wearing one have an iPhone in their pocket all the time anyway.

As Marco Arment has often said on ATP, don’t bet against the smartphone.

Yet that is exactly what Humane is doing. Instead of looking down at your phone, you can simply tap and talk to the small device on your chest — held on by an array of hardware accessories that often double as batteries — and it will respond by taking a photo, recording a video, playing music from Tidal or answering a query using artificial intelligence.

That last one is the biggest play here, and the biggest risk. In the introduction video, something jumped out at me, as it did to Nick Heer:

In a video, Humane co-founder Imran Chaudhri asks the A.I. Pin when the next eclipse will occur and where it will be visible. It responded that it will be on April 8, 2024, and that the “best places to see it are Exmouth, Australia and East Timor”. So I looked it up, and that is not right at all. This solar eclipse will almost exclusively be visible across North America and it will not be seen anywhere near Australia. In fact, its path is so specific that there is a marketing campaign about the “Great American Eclipse”.

(Siri got it correct on my Apple Watch.)

Getting basic facts wrong is one (pretty bad) thing, but the device’s focus on food and health is also concerning. Heer continues:

Speaking of small handfuls, the pin also said the almonds in Chaudhri’s hand contained fifteen grams of protein, which was off by at least a factor of two.

It blows my mind that these errors were left in the video. Clearly the thing was edited; why would you leave such an incorrect statement in the video courting early adopters? We all know AI systems get things wrong, but it’s another to leave those errors in your marketing materials. Did anyone at Humane fact-check these things? Or did they automatically trust that the answers were correct? Both possibilities are troubling. The lesson here is not to leave your launch video in the hands of ChatGPT, I suppose.

I’m nowhere close to being sold on the features I’ve written about so far, but the one thing that intrigues me the most is the user interface, powered by a laser projection system. I’m not saying it’s good, just that having a little user interface projected on to your hand that can track gestures is perhaps the most interesting thing here.

It’s clear that Humane is swinging for the fences here, and a lot about the AI Pin feels futuristic. I’m just not sure it’s a future we’re destined to experience.

Generative AI Fill in Photoshop Feels Like Magic

A few years ago, I took a Halloween photo that I really like. It’s of my wife Merri, dressed as a hot dog:

Hot dog Merri

I recently wanted to use it as a wallpaper on my iPhone, but its landscape nature didn’t really play nicely with the modern lock screen.1 Then I remembered that Photoshop has a bunch of AI tools, and after some tinkering with its generative fill feature, I had something that worked pretty well:

Hot dog Merri wallpaper

The work isn’t perfect, and if you pixel peep things get a little weird in the new tree line, but given the fact that all of that is out of focus thanks to the original photo, I’m pretty happy with it.

She’s going to kill me when she sees this on the Internet.


  1. After he saw this post, Myke Hurley texted me saying that this would be a great feature for Apple to add the lock screen configurator tools in iOS. He’s totally right about that. 

Eating Disorder Helpline Chatbot Goes Terribly Wrong →

Last week, news broke that the National Eating Disorders Association (NEDA) planned on firing its staff and volunteer helpline folks and replace them with a chatbot named Tessa, less than a week after the workers formed a union.

That is going about as well as you would think, as Chloe Xiang writes:

As of Tuesday, Tessa was taken down by the organization following a viral social media post displaying how the chatbot encouraged unhealthy eating habits rather than helping someone with an eating disorder.

“It came to our attention last night that the current version of the Tessa Chatbot, running the Body Positive program, may have given information that was harmful and unrelated to the program,” NEDA said in an Instagram post. We are investigating this immediately and have taken down that program until further notice for a complete investigation.”

It’s one thing to have an AI hallucinate and get some simple fact incorrect. This is way, way worse. Shame on the people at NEDA who made this call.

S-GPT →

Federico Viticci has created something wild:

It’s the inaugural week of the second annual edition of Automation April, and to celebrate the occasion, I’ve been working on something special: today, I’m introducing S-GPT, an advanced conversational shortcut for ChatGPT that bridges OpenAI’s assistant to native system features of iOS, iPadOS, macOS, and watchOS.

S-GPT (which stands for Shortcuts-GPT) is free to use for everyone, but it requires an OpenAI account with an associated pay-as-you-go billing plan since it takes advantage of OpenAI’s developer API, which has a cost. S-GPT was built with the latest ChatGPT API, and it can be used both with the existing ChatGPT 3.5 model or – if you have access to it – the ChatGPT 4 API.

I have been playing with this for a little while, and it’s some of Ticci’s best work. Having ChatGPT available though Shortcuts is one thing, but to have it interact with content on my devices is another thing altogether. We’ll be talking more about it on today’s Connected, I assure you.

I Asked Bing to Make Some macOS Wallpapers

I love macOS wallpapers, so when I saw that Bing had incorporated image creation into its probably-not-going-to-kill-us-all-but-maybe AI tools, I took it for a spin with this prompt:

Make some wallpapers in the style of Mac OS wallpapers from Jaguar, Panther and Tiger

I got these back:

That’s not really what I had in mind, so while the AI’s reading of my prompt made me laugh, I decided to try again:

Make some wallpapers in the style of the blue wallpapers found in early versions of Mac OS X

This went a little better:

I wanted to see if I could get something closer to my beloved OS X images, so I got rid of the OS X language and asked Bing to create wallpapers using various shades of blue that are calming but still portray some level of movement and happiness. I got these back:

Honestly, the last one isn’t too bad.