"You've met Malfoy before?"
Harry explained about their meeting in Diagon Alley.
"I've heard of his family," said Ron darkly. "They were some of the first to come back to our side after You-Know-Who disappeared. Said they'd been bewitched. My dad doesn't believe it. He says Malfoy's father didn't need an excuse to go over to the Dark Side."
(Harry Potter and the Sorcerer's Stone)
I suspect to-infinitive needs to have the perfect tense, because their participation in the Dark Side precedes the time when Malfoy’s family excuse. Then why does it not use the tense?