# from Abishai
"from Abishai and his soldiers"
# into the city
Here "the city" refers to Rabbah, the capital city of the Ammonites.
# went back to Jerusalem
"returned to Jerusalem"