The words "you" and "your" in these verses refer to the people of Judah.
"the place in Shiloh where I first allowed my people to worship me"