Yes letters are countable. But thy can also be thought of as abstract ideals with names:
This is V. V is a consonant. This is W which looks like two Vs put together.
Still in most contexts "It's a V" would be better than "It's V". Honestly I think the problem here is with the textbook, or rather i suspect that, since I haven't seen the text.