Hi Tmp

Battery circuit design is an art in and off itself and is a closed book to me, but a couple of thoughts:

Teensy 3 is a 3.3V board so quite possible your 5V supplied LEDs will glow...