Site icon GT's Blog | Startups and AI

Attack of the fakes – part 1

Did you know I can change my voice ? No ? Try listening to these samples:

https://www.gauravtripathi.com/wp-content/uploads/2019/03/1b7aae5a-3168-4323-b8ef-65d476271f9bresult.wav
Do I sound like “Mark” ?
https://www.gauravtripathi.com/wp-content/uploads/2019/03/c01dc777-4e1e-4dd5-a32b-b827c125c2d9result.wav
Do I sound like “Linda” ?

Impressed ? I s’ld give a try to dubbing movies I guess 😉

These “modulations” are powered by a service called Modulate.ai, a company based in Cambridge, Massachusetts. They use a combination of machine learning, signal processing, and hard-won intuition to develop real-time “voice skins”. Given now AI has started getting “creative”, I thought of coming up with a series of blog posts around these – I call it “Attach of the Fakes” as this is what I see happening in very near future.

Those who have been following Generative Adversarial Networks or GANs can already guess the use of adversarial training. Modulate team has detailed their approach in this excellent blog post. They have built a new kind of voice conversion architecture: parallel sample generation, adversarially trained for voice conversion, inspired by parallel wavenet architecture. They secured a seed round of $2M just last week but have got a lot of buzz and excitement around their technology already. To read more you can go to this post as well on MIT Technology Review which has featured them last week.

Now with this technology you can already imagine yourself impersonating _ANYBODY_ and hence this is rightfully giving nightmares to activists already. But this is true for a lot of recent development around AI and Modulate team is very well aware of the potential of misuse. Given the fact that humanity has overcome so many challenges I am sure this is a problem which will be solved 🙂

Btw, I have more of my “voice skins”, listen to me as “Evan” and “Katie” below:

https://www.gauravtripathi.com/wp-content/uploads/2019/03/634253a6-5c6b-4c0f-8529-d1c39f32bcacresult.wav
Now, I am Evan!
https://www.gauravtripathi.com/wp-content/uploads/2019/03/0bf02b4e-ec01-459b-ba5a-ab634d082354result.wav
I like Katie somehow
https://www.gauravtripathi.com/wp-content/uploads/2019/03/3616a657-2a1b-4ee0-8aea-6f588e694e3cresult.wav
And finally a judicious mix of Evan and Katie!

DO try it out yourself at modulate.ai/convert  – its fun 🙂

Exit mobile version