I see that I hadn't noticed is commonly used by native speakers, more than the pair I didn't notice and I haven't noticed ,in the following example
People are being more careful nowadays, don't you think?
I hadn't noticed that!
Is it a rule or is it just preference? And could I use that said pair as well (didn't/haven't noticed)? Or they differ?