I have a similar problem : the teensy3 is connected (Serial1, reset, Vcc) to a panstamp (3V3 as well, so no 5V level issue here).
But if I connect the USB on the Teensy, the two 3V3 regulators will be in parallel. To avoid that, I could/should ? cut the connection between the two pads. But then...