Figure 14-2 on pages 1016-1017 is the best way to see which peripherals can run from which clock sources.

The original reason to run GPT & PIT from the 24 MHz clock was to keep them consistent and accurate when the CPU and peripheral clock change.