Recently, Adobe released a Free AI Audio Processing Tool This can enhance some poor-quality recordings by removing background noise and making voices sound stronger. When it works, the result sounds like it was recorded with a high-quality microphone in a professional recording studio.
The new tool, called Enhance Speech, grew out of an artificial intelligence research project called Project Shasta.Recently, Adobe renamed the Shasta Project arrive Adobe Podcast.
Using Enhance Speech is free, but it requires creating an Adobe account and works best with desktop web browsers. After registration, users can upload MP3 or WAV files up to one hour or 1GB in size. After a few minutes, you can listen to the results in your browser or download the cleaned audio.
In our tests of the service, Enhance Speech worked best on audio that contained speech without crosstalk or excessive noise. For example, we recorded audio from a person’s iMac’s built-in microphone 10 feet away, including nearby fan noise, and the resulting audio (after Enhance Speech processing) sounded like it was in a studio with a professional microphone recorded close up without noise .
How does it work? Adobe didn’t provide any details, but we suspect the company trained a deep learning model on many (possibly thousands) of hours of clean and noisy audio. The model can then “learn” to pick out human voice frequencies and synthesize a facsimile that exactly matches the source. Until Adobe provides more technical details, this is speculation, and we’ve reached out to the company for comment.
For that matter, some Hacker News commenters argued that report hallucinations The results — anomalous output like phantoms where the AI misinterprets input audio — from extremely noisy audio (such as speech recorded next to a waterfall) or from non-English language sources suggest that Enhance Speech does more than traditional noise reduction technology.
Enhance Speech isn’t the first tool to offer this kind of AI-powered noise reduction.a named Mayawaz and a named car studio For example, do something like.
It’s worth noting that Enhance Speech is part of a larger set of AI-powered podcasting tools from Adobe, including Microphone Check Tool (also currently available for free) and a transcription-based audio editing tool that is still in invite-only beta testing.