Phase 06

Speech And Audio

The other half of human communication. Hear, understand, speak.

01Audio Fundamentals — Waveforms, Sampling, Fourier TransformLearn~45 minutes 02Spectrograms, Mel Scale & Audio FeaturesBuild~45 minutes 03Audio Classification — From k-NN on MFCCs to AST and BEATsBuild~75 minutes 04Speech Recognition (ASR) — CTC, RNN-T, AttentionBuild~45 minutes 05Whisper — Architecture & Fine-TuningBuild~75 minutes 06Speaker Recognition & VerificationBuild~45 minutes 07Text-to-Speech (TTS) — From Tacotron to F5 and KokoroBuild~75 minutes 08Voice Cloning & Voice ConversionBuild~75 minutes 09Music Generation — MusicGen, Stable Audio, Suno, and the Licensing EarthquakeBuild~75 minutes 10Audio-Language Models — Qwen2.5-Omni, Audio Flamingo, GPT-4o AudioLearn~45 minutes 11Real-Time Audio ProcessingBuild~75 minutes 12Build a Voice Assistant Pipeline — The Phase 6 CapstoneBuild~120 minutes 13Neural Audio Codecs — EnCodec, SNAC, Mimi, DAC and the Semantic-Acoustic SplitLearn~60 minutes 14Voice Activity Detection & Turn-Taking — Silero, Cobra, and the Flush TrickBuild~45 minutes 15Streaming Speech-to-Speech — Moshi, Hibiki, and Full-Duplex DialogueLearn~75 minutes 16Voice Anti-Spoofing & Audio Watermarking — ASVspoof 5, AudioSeal, WaveVerifyBuild~75 minutes 17Audio Evaluation — WER, MOS, UTMOS, MMAU, FAD, and the Open LeaderboardsLearn~60 minutes

“Stay hungry, stay foolish.”

— Steve Jobs