For that would be a terrible crime

The word "that" refers to Job sleeping with another woman.

it would be a crime to be punished by judges

"it would be a crime for which judges should punish me"