This is indeed how the spec is designed, however many software don't respect that topology and send more universes.
There is nothing in the Art-Net library for Teensy that prevents it from receiving more than 4 universes, however, it is possible that the client only sends a maximum of 4 universes.