Yes, "Did we finish the jam?" is perfectly natural-sounding.
Other possibilities:
Did you eat the last of the jam?
Is there any jam left?
Did we finish off that jam from last week?
Yes, "Did we finish the jam?" is perfectly natural-sounding.
Other possibilities:
Did you eat the last of the jam?
Is there any jam left?
Did we finish off that jam from last week?