Day 4 exam

Inference 12 questions drawn. Draw a new set

Question 1 of 12

Derivation: enter a number

tpu-inference's KV cache has a packing dimension p = 32 / bits per value. For an fp8 KV cache, what is p?