I would say "be sure to turn off the light" or "make sure you turn off the light" interchangeably, with a slight preference for the second form. I think "make sure to turn off the light" is okay grammatically. It's just less common.
This answer on ELUThis answer on ELU has some good, objective information about the relative frequency of the different phrases that's consistent with my first reaction.