Interestingly, I was just contemplating using a Teensy 4.1 for a very similar purpose.
While I have not implemented anything yet, my current thinking (on the Teensy 4.1) is to use one of the LPSPI interfaces in slave mode, with an external clock to get the exact bit rate required, and a DMA...