Possible meanings are 1) "The priests and Levites ... supported Rehoboam from within their borders" or 2) "The priests and Levites ... traveled from within their borders to join Rehoboam."
To "drive away" is an idiom that means to forcefully cause someone to leave. AT: "Jeroboam and his sons had forced them to leave" (See: [[rc://en/ta/man/translate/figs-idiom]])
It might be best to translate so that the reader understands that other people helped Jeroboam make these idols. AT: "the goat idols and calf idols that he had his craftsmen make" (See: [[rc://en/ta/man/translate/figs-metonymy]])