we have spoken against Yahweh and you

"we have said bad things about Yahweh and you"

we have spoken ... from us

The words "we" and "us" here refer to the people but not to Moses. (See: rc://en/ta/man/jit/figs-exclusive)