Those are correct:
How soon will he arrive?
When will he arrive?
Yesterday I said: In how long will he arrive? -- Is this wrong?
Also, I remember my Indian roommate used to say something like: At what time will he arrive? -- Not nice English, right?
Thank you.