As far as I understood from PEU we use at first to making a contrast with what happened erlier and later. In other cases we use just first. But I faced with the example
at first Hugo tried to be patient
At first was used although we didn't making a contrast. Couldn't you explain?