you certainly give

Paul is speaking to the Corinthians as if they were one person, so the word "you" here is singular.

the other person is not built up

"the other person is not strengthened" or "what you say does not strengthen any outsider who might hear you"