How much better is cl46 than cl40 for 5600mhz RAM?

Having instability with my 4800mhz ram I got for my Ryzen FW 13, so I'm just gonna get new ram. Hurts the wallet though, so how much would it impact performance to have this latency difference?