# You must break down their altars

"you must pull apart the altars of those nations" or "you must destroy the altars of those nations"

# dash in pieces

"break into pieces" or "shatter"

# destroy their name

"destroy them so completely that no one will remember them" or "destroy anything that represents these false gods" 

# that place

This refers to each place where the nations worshiped their gods.