Yup, PCM1808 is really simple. You can use either I2S or I2S2 on Teensy 4.x. Just connect the 4 signals. MCLK is named SCKI on that chip. The other 3 have names the same as Teensy uses.
PCM1808 has 3 config pins. Connect all of them to GND.
Be careful with the power pins. PCM1808 needs 3.3V for digital and 5V for analog. If you get them mixed up, it could damage the PCM1808, and before it dies it could send a 5V signal to Teensy, possibly also causing Teensy to be damaged.