I wonder whether I could use "see eye to eye" when I agree with someone spontaneously like this,
" I see eye to eye with you"
or when I disagree with someone
" I don't see eye to eye with you"
Google ngrams suggests that use of the expression peaked in the 1940s. Both of these have been said to me within the past ten years, but not often, and I have heard the expression used in reported speech: "Bill said that he did not see eye to eye with Jeremy".
looking at contemporary uses of this idiom in COCA (corpus of contemporary English), almost all uses are with a plural subject i.e. not "I" and without a preposition.
He and Bitsy obviously didn't see eye to eye about that.
She liked that they could meet eye to eye
she and David were eye to eye.
it's a well-known fact they are groups who don't see eye to eye.
In conclusion, it's not correct to use the idiom with the preposition "with" and "I" as a subject alone (or it's not a common use at least) as in the examples you've provided. It's best if you say "you and I don't see eye to eye" (plural subject, without a preposition)
source : https://corpus.byu.edu/coca/
*note: saying "you and I don't seem eye to eye" to someone, might sound a bit direct. you might want to soften a bit using I guess or I think, this way you won't come off as rude or curt. I don't think You and I see eye to eye or you could say something like :
"I'm not quite sure about that (what you're saying)"
if you want to say that you have a different opinion or you don't agree with what they say.
"let's agree to disagree
this is also a respectful way of saying you don't agree with someone's opinion on a matter
This expression is generally used in the negative- "don't see eye to eye".
It is generally used with the two parties as the subject, rather than a single subject and a with-phrase for the second party:
Tom and Linda don't see eye to eye. - normal
Tom doesn't see eye to eye with Linda - less common
It's a way of informing a third party of a situation, so you wouldn't use it with you as one of the parties (they already know). You might, however, use it with you to form a rhetorical question:
You and Tom don't see eye to eye, do you?
If the speaker is one of the parties, I will be the second party- as in any other and-phrase that includes the speaker:
Tom and I don't see eye to eye.
It tends to suggest that there are far-reaching (for example, ideological) differences of opinion between the two parties, unless you add an about-phrase:
Tom and Linda don't see eye to eye about sending James to public school
It is often used in a euphemistic way about a disagreement that is quite deep-rooted and emotional.
For the positive situation with a specific subject, it would be better to say
I'm with you
I'm with you on that
For the negative, you could say
I'm sorry, but I don't agree with you about that
I don't agree with you
If you have a lengthy discussion and cannot reach agreement, you can finish it by saying
I think that we're going to have to agree to differ.