"We use in with morning, afternoon, evening and night, but we use on when we talk about a specific morning, afternoon, etc., or when we describe the part of the day."(Cambridge Dictionary)
As Cambridge says we use "on+morning+when" with specific mornings and nights. But after searching a little bit, I found that "in+morning+when" is much more common. Source
For example : Which of the following example is true?
1- I had panic attacks in the night when I heard him coming.
2- I had panic attacks on the night when I heard him coming.
But on the other hand we use a bit more "on+night+when" than "in+night+when". Source
For example : Which of the following example is true?
3- We saw him in the night when he left.
4- We saw him on the night when he left.