This actually helps save a bit of power (at least for sysmgr_3) since
the "always-on" clk_base is slower.
The SoC needs more time to compute frames, but the same number of
cycles so that doesn't change the power on clk_sys itself really.
This will also be helpful for upcoming commits where we switch to
a Vex that has better IPC but doesn't easily meet 24 MHz constraint.
Signed-off-by: Sylvain Munaut <tnt@246tNt.com>