are now desolate in the streets

These people no longer have homes, so they live outside along the streets and do not have enough to eat.

Those who were brought up wearing scarlet clothing

"those who grew up wearing scarlet clothing" or "those who wore expensive clothing when they were growing up"