https://www.pjrc.com/teensy/td_libs_AudioNewObjects.html
I see from this that the each step in an audio chain should take about 2.9 milliseconds.
This is regardless of how fast or how little the Teensy does the work.
It will wait 128 samples, before updating again. And if the work is not...