When you're measuring this voltage, is the Teensy connected up to external circuitry?
If this is the case, disconnect the teensy from anything else (apart from the USB cable of course) and remeasure the voltage.
I suspect it's something in your external circuitry trying to drive that pin to that voltage.
Can you unplug it from that Sparkfun board and test with only the USB cable?