For he has founded it upon the seas and established it on the rivers

"For he formed its foundation on the seas and built it on the deep waters"

the seas ... the rivers

These phrases are used together to refer to the huge deep ocean below the earth.