To weep over something means to weep because of something. The word "it" refers to the city of Jerusalem, but it represents the people who lived in that city. Alternate translation: "he cried about the people of Jerusalem" (See: [[rc://en/ta/man/jit/figs-metonymy]])