"The first time I heard a clone of my own voice, I felt a cold dread. It sounded like me, but it was a hollow, soulless version of me. It was a stark reminder that a voice is more than just a collection of soundwaves. It’s a part of our identity, and when it’s replicated without the spark of life, it’s just plain creepy."
I’ve been neck-deep in AI voice for the past few years. It’s an obsession. Not the clunky, robotic voices from a decade ago, but the new breed of AI that can clone a voice with terrifying accuracy. As an investor in companies like Anthropic and OpenAI, I’ve had a front-row seat to the AI revolution, and I’ve put my money where my mouth is in the AI voice space, backing companies like ElevenLabs and Resemble AI. It’s a rollercoaster of a field, and I’ve learned a ton. Here are 10 more lessons from the trenches.
1. The Uncanny Valley is a Real Place, and It’s a Ghost Town
We all know the uncanny valley from CGI movies, where characters look almost human, but something is off. It’s the same with AI voice, but I’d argue it’s even more jarring. I’ll never forget the first time I heard a clone of my own voice. It was a demo from a startup I was considering investing in. On paper, the tech was brilliant. But when I heard my own voice saying things I’d never said, I felt a cold dread. It sounded like me, but it was a hollow, soulless version of me. It was a stark reminder that a voice is more than just a collection of soundwaves. It’s a part of our identity, and when it’s replicated without the spark of life, it’s just plain creepy.
I remember playing the audio file over and over again, trying to pinpoint what was so unsettling. It was the little things. The way the clone pronounced certain words with a perfect, almost robotic precision. The lack of any background noise, any sign of life. It was like listening to a ghost.
That experience taught me a valuable lesson. The goal of AI voice shouldn’t be to create a perfect replica of a human voice. The goal should be to create a voice that’s authentic and believable. A voice that has character and personality. A voice that feels alive.
2. Perfection is the Enemy of Authenticity
This is a lesson I’ve learned over and over again, not just in AI voice, but in business and in life. We’re so often taught to strive for perfection, but in the world of AI voice, perfection is the last thing you want. The most realistic voice clones are the ones that embrace imperfection. The slight hesitations, the almost imperceptible cracks in the voice, the subtle shifts in tone – these are the things that make a voice human.
I once advised a startup that was developing a voice cloning technology for celebrities. They had a team of brilliant engineers and a ton of funding, but they were obsessed with creating a “perfect” voice. They spent months trying to eliminate every little imperfection, every stutter, every pause. The result was a voice that was technically flawless, but completely devoid of personality. It sounded like a robot doing a bad impression of a celebrity.
The startup eventually failed, and I think a big part of the reason was their misguided pursuit of perfection. They were so focused on the technical details that they lost sight of what really matters: authenticity. The best voice clones are the ones that capture the essence of a person’s voice, not just the sound of it.
3. The 3-Second Rule is a Double-Edged Sword
It’s true. You can now create a pretty convincing voice clone with just a few seconds of audio. I’ve seen it done. It’s a testament to the incredible progress that’s been made in the field. For content creators, this is a dream come true. You can now create a podcast in any voice you want, or have your blog posts read by a voice that sounds like a professional voice actor.
But there’s a dark side to this. The ease with which voices can be cloned also opens the door to a whole new world of scams and misinformation. I recently saw a video of a well-known CEO supposedly announcing a massive giveaway. The voice was a perfect clone, and the video was incredibly convincing. It was only when I looked closer that I noticed the subtle signs of a deepfake.
This is the double-edged sword of the 3-second rule. On the one hand, it’s a powerful tool for creativity and expression. On the other hand, it’s a dangerous weapon in the wrong hands. As we continue to push the boundaries of AI voice, we need to be mindful of the potential for misuse and take steps to mitigate the risks.
4. The Ethical Tightrope of Voice Cloning
I’ve had some intense conversations with the founders of the AI voice companies I’ve invested in. We’ve talked late into the night about the ethical implications of what they’re building. The potential for misuse is staggering. Imagine a world where you can’t trust any audio you hear. A world where a political candidate’s voice can be cloned to make them say things they never said. It’s a scary thought.
That’s why I’m a vocal advocate for strong ethical guidelines and regulations in the AI voice space. We need to build in safeguards to prevent this technology from being used for malicious purposes. This includes things like watermarking cloned voices, creating a registry of voice clones, and developing new tools for detecting deepfakes.
It’s a tightrope walk, but it’s one we have to get right. The future of AI voice depends on it.
5. Conversational AI is the Holy Grail
Voice cloning is just the tip of the iceberg. The real holy grail is conversational AI. I’m talking about AI that can not only understand what you’re saying, but can also respond in a way that’s natural, engaging, and emotionally intelligent. We’re seeing the first glimmers of this with products like the Humane AI Pin and the Rabbit R1, but we’re still a long way off.
I’ve invested in a few stealth startups that are working on this, and the demos I’ve seen are mind-blowing. We’re talking about AI that can be a true companion, a creative partner, and a personal assistant all rolled into one. It’s the kind of AI that you can have a real conversation with, not just a series of commands and responses.
This is the future of AI, and it’s going to change everything. It’s going to change the way we work, the way we learn, and the way we connect with each other. It’s a future that I’m incredibly excited about, and I’m proud to be a part of it.
6. Data is the New Oil, and Most of it is Dirty
This is a cliché in the AI world, but it’s true. The quality of an AI model is directly proportional to the quality of the data it’s trained on. And when it comes to AI voice, most of the data out there is dirty. It’s full of background noise, echoes, and other imperfections.
That’s why I’ve become a data hoarder. I’ve spent countless hours recording my own voice in a professional studio, creating a pristine dataset that I can use for my own experiments. I’ve also been working with a few companies that are developing new techniques for cleaning and augmenting audio data. It’s not glamorous work, but it’s absolutely essential.
The future of AI voice depends on our ability to collect and curate high-quality datasets. It’s a challenge, but it’s one that we have to solve if we want to unlock the full potential of this technology.
7. The Rise of the Voicepreneur
The internet gave rise to the entrepreneur. Social media gave rise to the influencer. And I believe that AI voice will give rise to the “voicepreneur.” These are people who will build entire businesses around their voice. I’m talking about personalized audiobooks, voice-based coaching, and even virtual companions.
I’ve already met a few people who are doing this, and they’re crushing it. One guy I know is making a six-figure income from creating personalized meditations in his soothing voice. Another woman is building a business around creating custom voiceovers for small businesses. It’s a whole new frontier, and the opportunities are endless.
If you have a unique voice and something to say, there’s never been a better time to be a voicepreneur. The tools are there, the market is there, and the potential is limitless.
8. Your Voice is Your Brand, So Own It
In a world that’s becoming increasingly noisy and crowded, your voice is your most valuable asset. It’s what makes you unique. It’s what makes you, you. That’s why I’m so passionate about AI voice. It’s a tool that can help you amplify your voice and build a powerful brand.
Whether you’re a podcaster, a YouTuber, a CEO, or just someone with something to say, your voice is your superpower. Don’t be afraid to use it. Own it. And let it be a reflection of who you are and what you stand for.
9. The End of the Screen as We Know It
For the past few decades, we’ve been tethered to our screens. Our lives have been mediated through a glowing rectangle of glass. But I believe that’s about to change. The rise of AI voice is going to usher in a new era of computing, an era where we interact with technology in a more natural and intuitive way.
I’m not saying that screens are going to disappear overnight, but I do think that we’re going to see a shift away from screen-based interfaces and towards voice-based interfaces. It’s a paradigm shift that’s going to have a profound impact on our lives. It’s going to make technology more accessible, more personal, and more human.
10. We’re at the Dawn of a New Era
It’s easy to get caught up in the hype and the headlines, but the truth is that we’re still at the very beginning of the AI voice revolution. The technology is still in its infancy, and there’s so much more to discover. I feel incredibly lucky to be a part of this journey, both as an investor and as a builder. It’s a wild ride, full of twists and turns, but I wouldn’t have it any other way. The future of voice is unwritten, and I can’t wait to see what we write together.
Frequently Asked Questions
Can I implement all of these at once?
I'd strongly recommend against it. Pick the 2-3 items that resonate most with your current situation and focus there. Trying to do everything simultaneously is a recipe for doing nothing well.
Are these recommendations still relevant in 2026?
Absolutely. While specific tools and tactics change, the underlying principles remain consistent. I update my thinking regularly based on what I'm seeing in the market and across my portfolio companies.
Which item on this list has the highest impact?
It depends on your stage and context, but in my experience, the items near the top of the list tend to have the broadest applicability. That said, sometimes the less obvious items create the biggest breakthroughs for specific situations.