Sesame, the AI startup behind the viral voice assistant Maya, has officially launched its open-source AI voice model, CSM-1B, under the Apache 2.0 license. While this move opens doors for global developers to explore new AI-driven voice applications, it also stirs concerns about ethics and security in AI-generated voice technology.

What Is CSM-1B?

CSM-1B is a 1-billion-parameter AI voice model designed to generate human-like speech from text and audio inputs. Using residual vector quantization (RVQ)—a technique also found in Google’s SoundStream and Meta’s Encodec—the model encodes and reconstructs realistic speech patterns.

Here’s how it works:

• The AI analyzes text or voice inputs.
• RVQ converts the input into discrete audio tokens.
• A decoder reconstructs the tokens into speech that mimics human voices.

Sesame built CSM-1B on Meta’s Llama model, adding an advanced audio decoder for speech synthesis. However, the model has its limitations—it struggles with non-English languages and lacks fine-tuning for specific voices.

No Built-in Safeguards—A Dangerous Oversight?

The biggest controversy surrounding CSM-1B is its lack of security measures. Unlike other AI voice cloning tools that implement safeguards, Sesame relies on an honor system, merely advising users not to misuse the model.

This approach has sparked major concerns. Consumer Reports recently flagged AI voice cloning as a rising cybersecurity threat, warning that CSM-1B, like many other models, has no built-in protections against fraud, impersonation, or misinformation.

Tests on Hugging Face revealed that CSM-1B can clone a voice in under a minute. This makes it alarmingly easy to generate speech on sensitive topics—such as political propaganda or deepfake scams.

A recent example? A cloned voice of Donald Trump Jr. went viral, seemingly endorsing Russia over Ukraine. Before fact-checkers could intervene, misinformation had already spread. Without effective AI voice regulations, experts fear these incidents will become more frequent.

Sesame’s Bigger Plans—AI-Powered Wearables Incoming?

Despite the growing concerns, Sesame is moving full speed ahead with its ambitious AI roadmap. The company, co-founded by Oculus co-creator Brendan Iribe, has secured funding from Andreessen Horowitz, Spark Capital, and Matrix Partners.

While its AI voice assistants Maya and Miles remain its biggest successes, Sesame is now venturing into AI-powered smart glasses. These glasses—designed for all-day AI assistance—could challenge industry giants like Apple and Meta in the wearable tech space.

What’s Next? The AI Voice Arms Race Continues

With CSM-1B in the wild, the debate over AI voice cloning is only intensifying. Will regulators step in to enforce stricter controls? Or will open-source innovation continue without boundaries?

One thing is clear: AI-generated voices are here to stay, and the world must prepare for both the opportunities and the threats they bring.