If ... I have hidden my sins

"If ... I have tried to keep my sins a secret"

by hiding my guilt inside my bosom

"like one who hides the evidence of his guilt inside his tunic". This represents trying to keep people from knowing that he is guilty.