I'm not sure but it's quite obvious that I've heard and read of such questions occasionally. Is this acceptable in terms of grammatical writing?
As a regular statement, normally "Where did he go?" would be used.
However your other phrase could be used in spoken language to show disbelief or amazement. "where" would be emphasized.
He went where?