I went the osh park + digikey route to get an Ethernet connector for the Teensy 4.1, and I can report that it does work that way :)

After getting the lwip_iperf example working, I had to tune lwip...