Why did Hannah not go with her husband to the temple for the yearly sacrifice?

Because she was still nursing her son. [1:21; 1:23]