Many agree that there's no difference "between start/begin + infinitive" and "start/begin + gerund."
But in sentences like "When we first started to talk/started talking," the gerund version is a lot more common.
Maybe grammatically, both versions are correct. But colloquially, the gerund version is more common?