The Verge writer says Amazon Bee Frontier distorted conversations and memories

Victoria Song, a senior reviewer at The Verge, says her experience with Amazon Bee Frontier, an always-recording AI wearable, left her questioning its transcripts and summaries of her conversations. Song wrote about the device in The Verge’s Optimizer newsletter.

Bee listens to conversations and uses AI to transcribe and summarize them. It also offers features for suggesting tasks, identifying areas for improvement, and analyzing conversations, along with a chatbot that answers questions about what was said. Song says that over 19 months the device improved at distinguishing her speech from television dialogue and gained the ability to use calendar and photo information. She says it sometimes helped her recall work-related talking points.

But Song describes repeated errors, including attributing claims to her that she says she never made and interpreting jokes as facts. She also says Bee mistook nicknames for her two cats as separate cats. More seriously, after a therapy session, the device generated a fact about childhood domestic violence and a summary titled “Reclaiming Reality from Manipulative Power.” Song writes that seeing the event reduced to a blunt statement felt awful.

Song says the experience has made her feel “perpetually gaslit” because Bee’s interpretations can differ from her own memories. In the article, she says her therapist asked her to throw the device out a window after the third week of discussing it. Song also notes she had to ask her therapist’s consent to wear it during a session.