First, make sure you've cut the VUSB-VIN trace. That last thing you want is for 11 volts directly from a battery to connect to a USB cable and damage an expensive computer!
The voltage regulator is
Texas Instruments part LP38691. If you read the datasheet, section 7.1 " Absolute Maximum Ratings" on page 4 says "V(max) All pins (with respect to GND)" is -0.3 to 12 volts. The first footnote explains:
(1) Absolute maximum ratings indicate limits beyond which damage to the component may occur. Operating ratings indicate conditions for
which the device is intended to be functional, but do not ensure specific performance limits. For ensured specifications, see Electrical
Characteristics. Specifications do not apply when operating the device outside of its rated operating conditions.
Of course, TI recommends only using it up to 10 volts.
Also, please consider the Teensy 3.2 PCB is capable of dissipating about half a watt of heat from the regulator. At half a watt, it runs pretty hot, but still well within the regulator's capability.
If you have 12 volts input and 3.3V output, that's 7.8 volts across the regulator. If Teensy draws 35 mA, the result will be 0.3 watts. Even small increases in current on the 3.3V line result in pushing closer to the 0.5 watt maximum recommendation.
So in terms of your question "could it be ok", anything over 10 volts is pushing your luck and going over 12 volts is very risky, and even Teensy's normal current draw puts you close to the maximum heat the PCB can dissipate, so there's very little margin to power anything else from that 3.3V power.
I certainly wouldn't sell a product built this way, nor would I install such a thing in an unattended difficult-to-service location... but for a one-time project with an urgent deadline (something like a trade show demo), I might risk it. There's no question this is risky, so you'll have to make your own judgment call.