Meta is expanding its Muse personal AI agent with a range of new features, including a digital avatar, smart glasses integration, Mac computer control, email capabilities and shopping partnerships.
Meta CEO Mark Zuckerberg unveiled the updates during the company’s annual Connect event, describing Muse as the centrepiece of the company’s consumer AI strategy.
Muse launched in early September and is powered by Meta’s Muse Spark multimodal AI model. The company says the agent is designed to handle everyday tasks by connecting with users’ apps and digital services.
Muse gets a digital avatar
Meta is developing a new Muse Realtime Avatar model that will allow users to create a digital avatar for their personal AI agent and interact with it through live video conversations.
The avatar will have a face, body and voice, allowing users to ask questions and assign tasks through real-time conversations.
Zuckerberg said the physical avatar associated with Muse is named Jolly.
Muse is coming to Meta smart glasses
Meta is also bringing Muse to its smart glasses, allowing users to interact with the AI agent through voice commands.
The company said Muse will be activated using a wake word and could help users with tasks such as personalised workouts, logging meals, booking appointments and purchasing products they see while wearing the glasses.
Meta said Muse will be able to work in the background and notify users when a task is completed.
The feature is expected to arrive in the coming months.
Muse will operate Mac computers
Meta is also expanding Muse’s computer-use capabilities to Mac devices.
The company said users will be able to delegate tasks to Muse, which can operate apps on a desktop while the user is away.
Meta Chief AI Officer Alexandr Wang said the feature could help users with tasks ranging from running a small business to completing routine computer work.
Muse is getting an email address
Meta is developing a dedicated email address for Muse, allowing the agent to participate in email workflows.
Users will eventually be able to add Muse to email threads or forward messages to the agent so it can handle tasks on their behalf.
Meta did not provide a specific launch date for the feature, saying it would be available soon.
More shopping and app integrations
Meta is expanding Muse’s connections with shopping and payment services through partnerships with companies including Stripe and Shopify.
According to Wang, Muse will be able to access Shopify’s product catalogue and support purchases through services including Shop Pay, while Meta has also expanded payment support for PayPal.
The company announced additional integrations with retailers and services including Best Buy, Gap, Sephora, Walmart, Wayfair and Expedia, with Instacart also planned.
Other connectors include GitHub, Granola and Notion.
Meta recently opened its platform to developers so they can build connectors for Muse. Wang said the company received more than 1,500 applications within less than a week.
Meta’s broader AI ambitions
Zuckerberg said Meta expects Muse to eventually develop into a personal AI system used by billions of people to accomplish everyday goals.
Meta also plans to keep Muse free for a large amount of usage initially, while Zuckerberg said the company expects to eventually generate revenue by taking a small fee from transactions carried out through the agent.
