Check the schematic … it would take some board modification if powered by USB through Vin - or powered by Vin. If the Teensy is powered there will be 3.3V on that pin. 3.3V can be supplied externally to that pin - then taking away that power would turn off the pin.
Must be an interesting reason for this?