Three things might help a bit.

You can add capacitors to lower the AC impedance, which might give you cleaner measurements. But these capacitors must be on the pot side of the mux, between each...