The closer some constructs together in the sentence, the stronger semantic relationship between them. By the same token, the farther they are from each other in the sentence/statement, the weaker the connection.
When you move "by his views" away from "he" and still leave it close to "you" -- as in the second sentence -- it alludes that "by his views" modifies mostly "you are [influenced]", but not "he is influenced", thus suggesting that "he is influenced" by something else rather than by his views. But by what? It's unclear, and therefore confusing.
When you place "by his views" in the middle, as in your first sentence, it, being essentially equidistant to "he" and "you", applies in the mind of the listener/reader to both, which is what you intended, I think.