Update: I had answered this question not knowing that the question had several assumptions behind it that were not made clear until comments were added to this answer.
The use of that is more acceptable in formal writing than informal writing.
Formality is better expressed with longer sentences.
I disagree with both of these assumptions. Formal writing can be precise and and follow a stricter set of adherence to grammar, while at the same time exercise style choices that aid comprehension. There is no context that can't benefit from the application of plain language.
If there is a situation where that hinders comprehension because it slows down the parsing of text, and where removing it doesn't damage the grammar, then it doesn't serve a purpose. The need for comprehension is even more important in formal text.
Omitting that is mostly one of style and, unless you're following a house style guide, it's quite subjective.
It really has little to do with it being informal or formal. Those who would argue against its overuse would want it removed from formal contexts too. In fact, people writing informally will seldom pay attention to the frequent use of that. It's actually more likely they will bethat those concerned with its overuse would removed more often init from formal writing than the reversethey would from informal writing.