It depends on the multiplexer and the ground current peaks it generates during input switching or not. Normally, the logical GND of a multiplexer IC like a CD4051 would go to GND, while the reference potential of the switched/multiplexed inputs would be connected to AGND. Best results always by mentally anticipating switching effects and to verify the optimal S/N ratio with an oscilloscope.