the foot of the arrogant man ... the hand of the wicked

Here "foot" and "hand" refer to the evil people. These are not specific men. This refers to evil people in general. Alternate translation: "arrogant people ... wicked people" (See: rc://en/ta/man/jit/figs-synecdoche and rc://en/ta/man/jit/figs-genericnoun)

drive me away

"send me away" or "make me leave my place"