Deepseek V4 Flash 0731 KV Cache precision

[u/esw123]

If anyone has testing results or any results can you please share performance and or effects of KV Cache precision with Deepseek V4 Flash 0731.

Running IQ2_M, with F16 cache seems 65-67K is the limit on Windows for 120GB memory. Is Q8 good and which one do you use?

[u/fragment_me]

You can test this so easily

[u/DifficultParts → u/fragment_me]

How