So I gave them over to their own stubborn way

"Therefore, I let them be stubborn"

they might follow their own devices

"they might follow their own plans" or "they might do what they think is right"