Yep, that is the heart and core of justice. And, why justice is pretty much only something that can be discussed in ivory towers. Justice evaporates as soon as any logic is applied to it.
Metaphysically speaking, the "victim" brought the incident to them. The "victim" and the "perpetrator" co-created the incident. But, we are a long way from having people even tentatively accept the law of attraction and even longer before they can understand its full manifestations.
So, given that. What is justice?
You find out that two people were secretly hurting (emotionally), and now they are hurting even more. Well, the correct thing to do is to help both of them heal. But no, what we like to do is make them both hurt some more by insisting on vengeance.