The computational power of the teensy is what is impressive.
I have not used the SPI bus on the teensy, but I expect that it would come down to how interrupts interact with each other. I do not know if the SPI system could put up with a delay of a microecond or two while the quadrature encoder...