He built the city all around ... Joab restored the rest of the city

The word "he" refers to David. The reader should understand that David and Joab were probably in charge of other men who made the fortifications.

the Millo

This likely refers to a terraced structure that consisted of retaining walls with dirt filled in behind them.