For all his righteous decrees ... I have not turned away from them

Both of these clauses have similar meanings. The writer repeats these ideas for emphasis. (See: rc://en/ta/man/jit/figs-parallelism)

have been before me

"have guided me" or "I have remembered"