I was watching "Olympus" TV series. A character says that "It was all I had growing up."
"It was all I had (when I was) growing up." Is that the completed sentence of it? If so, when and how can we omit words in speaking? What are the rules of omitting?