But if the woman is not willing to follow you

"But if the woman refuses to come with you."

you will be free from this oath of mine

"you will not have to do what you swore to me that you would do"