It appears to me that we say
to a group of boys/girls, but do not say
to a group of men/women.
Is this the case in your particular variety of English? If so, is there a term or reason for this difference, why one form is used and the other is not?