Does the phrase 'little too' mean same as 'very', or is it mild form of very ? For instance, I am little too comfortable talking to you. Does it mean same as 'I am very comfortable talking to you' ?
First of all, it should probably be "I am a little too comfortable talking to you".
And being "a little too X" doesn't exactly mean you're "very X" - just to a degree that you consider slightly above the limit. So being "a little too comfortable" talking to someone means that you're just slightly more comfortable talking than you feel is appropriate.
Also note that depending on the delivery, it might either be a genuine concern, or a joking acknowledgement of the relationship growing.