He built up siege works against me

Siege works are ramps that an army builds around a city to enable them to climb over the city walls and invade the city.

surrounded me with bitterness and hardship

"caused me to experience much bitterness and hardship" or "caused me to suffer and have many problems"