"You can go first."
The word can implies that you are giving the person the option to do or not do a certain action.
"You go first."
Removing it implies that you are giving order or forcing someone to do something. You are not giving that person the choice of not doing it.