I have completely removed from

These are the first words of another statement that the Israelite was supposed to say.

neither have I forgotten them

This means that he has obeyed all of God's commandments.