You could say that without breaking grammar rules, but no one expresses that feeling in that way, and if they did, it would come across fairly rude. Depending on whether your friend made the decision (in actuality) and whether they told you it was their choice (presentation), you would express the sentiment of wanting them to be with you in a few different ways. I believe Case 4 is what you're looking for, but I am not entirely sure, so I listed several solutions depending on the context.
Case 1: Friend wants to be there but has an obligation preventing it.
You could reply, "I really wish you could be here." You may add additional information to the end such as "for the event tomorrow" or even a bit of consolation like "Let's make plans to get together for a movie soon." In most cases, these responses are polite, and will not instigate interpersonal issues, as the person knows that you understand the obligation is outside their control.
Case 2: Friend does not want to be there, and is suspected of inventing an excuse.
In this case, native speakers usually give the advice to "take the hint." This means that it is reasonably obvious that the person making the excuse does not want to participate, but also does not want to hurt feelings. It is also often true that the person making the excuse this time may want to accept invitations to future events, and also still values the relationship. In this case, not pressing the situation is the best course of action. Reply with: "Okay, no problem. I just wanted to extend the invitation. Maybe next time!" and then don't attempt to coerce a different response.
Case 3: Friend does not want to be there and has stated plainly that this is the case.
Be grateful for their honesty and accept the answer. This is handled in much the same way as Case 2, but the friend's straightforwardness may be an indication that they are mad at you about something. That is very much dependent on the personality of your friend.
Case 4: Friend is promising to be there, but has made subtle implications that he may not be.
A good reply is: "I understand if you can't make it tomorrow, but I really look forward to seeing you."