I believe all you need to do with Teensy 4.0 & 4.1 is edit the sample rate number in AudioStream.h.
That file is located inside your Arduino folder. When you search for that file, you should find 2 copies. Pay attention to the folder name, as you want to edit the copy used by Teensy 4 rather than the other file for Teensy 3.