There's the communal memory of a thing as well. Let's say you and I both know about a vase. We can describe it, we know what it looks like.
It breaks. That vase lives on only in memory, of you, and I. To anyone else, ignorant of its existence, it was just a 'vase', to us, it was 'that vase'; and people we tell about it will have that same communal memory.
As long as the essence of that memory continues to exist, does the vase also, if its physical form is no more?