It seems that
"make noise: emit a noise (could be any noise such as one from music, TV, people talking, ...)" Source
"make a noise (about something): (informal) to complain loudly (talking about human only)" Source
"make noises (about something) (informal):
- to talk in an indirect way about something that you think you might do
The company has been making noises about closing several factories.
- to complain about something" Source
But I am not sure if my research is right or not?