This is actually very straightforward. The pattern in the sentence:
Any problems that may occur have ultimately been caused by you
follows the same pattern as, for instance:
All that you see here has been built by me.
The perfect tense or aspect is not dedicated to cause and effect (past causes and present/future effects), but to the completeness of an action. It's just a kind of verb tense that occurs in some languages which indicates that an action is complete. To be "perfect" is to be complete. In contrast, an "imperfective" verb form in some languages indicates an action which is somehow not done (the action is habitual, repetitive, or ongoing).
Your example sentence is based on the participle of the verb to cause, and that is what makes it about cause and effect, not the perfect aspect.
If we want to blame any present effect on a cause, that cause has to be something which already happened, and so the grammar of the perfect aspect fits the semantic situation, making it useful in expressing causes and effects. However, is not confined just to causes and effects.
Moreover, we don't have to use the perfect aspect grammar in order to make clear cause and effect relationships. For instance:
The mistakes you made in the past are causing current problems and will continue to cause future problems.
Note that are causing is ongoing, hence imperfective, the very opposite of the perfect, yet used to say the same kind of thing: that past causes are responsible for current or future problems.
And, by the way, another thing worth a remark is that your sentence is passive.
This slightly complicates in a way that is irrelevant to the discussion of the perfect aspect. We can turn it into an active sentence like this:
You have caused all the problems that may occur.
(Note how "any" has to become "all" due to the perspective reversal.)
The analysis is the same. It is still present perfect, and saying that past causes are the reason for current or future problems.
If the causes are not necessarily in the past, the future perfect can be used:
You will have caused all the problems that will occur. [You have not caused anything now. But you will in the future. There will come times when you will complete various irresponsible actions, and these will result in the occurrence of problems.]