Day 5 exam

Compiler 12 questions drawn. Draw a new set

Question 1 of 12

Derivation: enter a number

An all-reduce has replica_groups={{0,16,32,48,64,80,96,112},...}. How many ways is the model sharded along the axis it reduces over?

ways