Got an extended abstract paper accepted at the GLOW workshop at IJCAI :) Turns out you can just delete 6 layers from the Whisper encoder and it doesn’t hurt transcription performance all that much (but you have to be pretty specific about which layers)

4 likes 0 replies