He is the man whom I met yesterday.
A relative pronoun can be omitted when it doesn't refer to the subject of the clause. So we can omit the relative pronoun 'whom' from the clause. But the clause is at the end of the sentence. It doesn't sound well after omitting the relative pronoun.
He is the man I met yesterday.
Is it correct to omit the relative pronoun?