"Let's keep it between us / among us."
This is not idiomatic. This is preposterous to the natives. Usual grammatical rule is not applicable here.
Instead, one should say :
Let's keep it between you and me. Let's keep it between you and us. Let's keep it between ourselves. [OURSELVES : AmE, , meaning 'between you and me', Collins Dictionary ]