Here "they" refers to the tribe of Ephraim and the entire nation of Israel, who followed Ephraim's example.
Part of idol worship was kissing idol figures that were images of calves.