I just bought a Teensy 4.1 to try some stuff for eurorack. I am also havin some DSP's around which are ok to control with a esp32 over i2c.
The DSP's have a latency of around 3 ms. How about the teensy? I want to do stuff in direction envelope follower and don't know whether this is too much already