a place where there are no people
This means that people were continually coming to the apostles and then going away from them.
The word "they" refers to the apostles.